-- Logs begin at Fri 2021-12-24 04:20:00 UTC, end at Fri 2021-12-24 05:29:04 UTC. -- Dec 24 04:51:05.986946 dv-cinder-816443-2-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Dec 24 04:51:08.774950 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.common.config [-] Logging enabled! Dec 24 04:51:08.775539 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev321 Dec 24 04:51:08.775716 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102369) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Dec 24 04:51:08.778874 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.common.config [-] Logging enabled! Dec 24 04:51:08.779120 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev321 Dec 24 04:51:08.779424 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102369) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Dec 24 04:51:08.780345 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 24 04:51:08.780576 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 24 04:51:08.780966 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 24 04:51:08.781209 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 24 04:51:08.781430 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 24 04:51:08.781749 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.782176 dv-cinder-816443-2-iscsi neutron-server[102369]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Dec 24 04:51:08.782484 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.782775 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.783063 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.783354 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.783625 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.783903 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.784183 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.784472 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.784782 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.785058 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.785333 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.785619 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.785902 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] config_source = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.786181 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.786445 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.786722 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] debug = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.787001 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.787427 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.787845 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.788121 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.788404 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.788703 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.789020 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.789298 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.789578 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.789899 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] host = dv-cinder-816443-2-iscsi {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.790172 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.790454 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.790733 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.791012 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.791281 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.791550 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.791828 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.792094 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] log_dir = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.792358 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] log_file = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.792658 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.792940 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.793217 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.793500 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.793720 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.793938 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.794237 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.794518 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.794788 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.795056 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.795325 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.795594 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.795862 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.796126 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.796404 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.796716 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.796991 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.797256 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.797525 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.797791 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.798056 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.798333 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.798600 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.798866 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.799134 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.799412 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.799676 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.799943 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.800233 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.800512 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.800807 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.801082 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.801349 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.801627 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.801928 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.802177 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] use_journal = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.802430 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] use_json = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.802697 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.802963 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.803238 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.803507 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.803798 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.804044 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.804310 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.804643 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:08.804933 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.805220 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.805517 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.805796 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.806095 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.806400 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.806708 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.806973 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.807213 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.807683 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.807786 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.808070 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.808360 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.808669 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.808954 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.809254 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.809536 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.809803 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.810071 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.810337 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.810601 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.810874 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.811148 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.811423 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.811706 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.811983 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.812252 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.812557 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.812840 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.813112 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.813397 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.813664 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.813940 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.814226 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.814504 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.814770 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.815042 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.815324 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.815597 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.815862 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.816136 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.816408 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.816701 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.816966 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.817243 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.817524 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.817794 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.818058 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.818323 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.818594 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.818858 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.819138 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.819411 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.819675 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.819939 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.820268 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.820574 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.820841 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.821256 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.821531 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.821807 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.822076 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.822343 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.822612 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.822880 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.823146 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.823414 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.823681 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.823954 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.824223 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.824489 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.824789 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.825059 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.825325 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.825608 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.825902 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.826175 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.826445 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.826716 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.826989 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.827260 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.827532 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.827802 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.828073 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.828338 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.828646 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.828923 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.829206 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.829488 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.829789 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.830082 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.830358 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.830636 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.830908 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.831183 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.831460 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.831740 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.832029 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.832319 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.832629 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.832917 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.833206 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.833482 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.833784 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.834411 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:08.834627 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 24 04:51:08.834874 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=102369) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Dec 24 04:51:09.259035 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=102369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:51:09.259291 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=102369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:51:09.259586 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=102369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 24 04:51:09.259923 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.manager [-] Loading core plugin: ml2 Dec 24 04:51:09.581299 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:09.581534 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:09.581809 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:09.583124 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:09.583391 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:09.583651 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:09.628388 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:09.628684 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:09.628946 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:09.642948 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:09.643246 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:09.643501 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:09.671606 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:09.671874 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:09.672138 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:09.708761 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:09.709365 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:09.709633 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.045120 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.045773 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.045773 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.045773 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.046476 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.144858 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.145148 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.145464 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.145711 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.145969 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.146248 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.146531 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.146773 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.147016 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.147293 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.147542 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.147783 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.148030 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.148270 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.148612 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.148872 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.149123 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.149382 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.149628 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.149878 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.150141 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.150386 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.150664 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.151042 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.151284 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.151522 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.151912 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=102369) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 24 04:51:10.152147 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=102369) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 24 04:51:10.152380 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=102369) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 24 04:51:10.152634 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=102369) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 24 04:51:10.152866 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=102369) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 24 04:51:10.153099 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=102369) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 24 04:51:10.153467 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Dec 24 04:51:10.156780 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Dec 24 04:51:10.160767 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Dec 24 04:51:10.164785 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(100, 149)])]) Dec 24 04:51:10.166709 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Dec 24 04:51:10.167236 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Dec 24 04:51:10.167571 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Dec 24 04:51:10.167957 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Dec 24 04:51:10.170818 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Dec 24 04:51:10.171069 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Dec 24 04:51:10.171404 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Dec 24 04:51:10.176903 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Dec 24 04:51:10.199453 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Dec 24 04:51:10.199910 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.200204 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=102369) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:88}} Dec 24 04:51:10.200562 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.202040 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=102369) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Dec 24 04:51:10.202314 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Dec 24 04:51:10.202551 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Dec 24 04:51:10.205818 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.206091 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.270771 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Dec 24 04:51:10.270977 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Dec 24 04:51:10.271231 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Dec 24 04:51:10.271595 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Dec 24 04:51:10.294980 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_db.sqlalchemy.engines [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 24 04:51:10.725801 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.managers [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Initializing driver for type 'gre' Dec 24 04:51:10.726247 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] gre ID ranges: [(1, 1000)] Dec 24 04:51:10.783444 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.managers [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Initializing driver for type 'local' Dec 24 04:51:10.783925 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.managers [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Initializing driver for type 'vlan' Dec 24 04:51:10.803453 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] VlanTypeDriver initialization complete Dec 24 04:51:10.803899 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.managers [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Initializing driver for type 'vxlan' Dec 24 04:51:10.804995 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] vxlan ID ranges: [(1, 1000)] Dec 24 04:51:10.857879 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.managers [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Initializing extension driver 'port_security' Dec 24 04:51:10.858308 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.extensions.port_security [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] PortSecurityExtensionDriver initialization complete Dec 24 04:51:10.858741 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.managers [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Initializing mechanism driver 'openvswitch' Dec 24 04:51:10.859084 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.managers [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Initializing mechanism driver 'hyperv' Dec 24 04:51:10.865805 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.plugins.ml2.plugin [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=102369) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:51:10.866483 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > port after_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.866856 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > port after_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.867297 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > port after_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.867833 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=102369) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 24 04:51:10.868253 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > subnet after_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.868632 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > subnet after_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.868980 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > subnet after_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.869380 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=102369) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 24 04:51:10.869800 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > network after_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.870138 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > network after_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.870550 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > network after_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.870873 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=102369) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 24 04:51:10.871277 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > security_group after_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.871624 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > security_group after_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.871960 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > security_group after_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.872493 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=102369) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 24 04:51:10.872928 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.873278 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.873622 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.874021 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=102369) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 24 04:51:10.874429 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > address_group after_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.874774 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > address_group after_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.875113 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > address_group after_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.875502 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=102369) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 24 04:51:10.875881 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] ML2 OVO RPC backend initialized. {{(pid=102369) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Dec 24 04:51:10.876610 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router_interface after_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.876966 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.877387 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > network before_response 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.877735 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > networks before_response 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.878080 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > port before_response 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.878419 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > ports before_response 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.878760 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > subnet before_response 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.879105 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > subnets before_response 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.879449 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > network after_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.879786 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > network after_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.880118 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > network after_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.880450 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > port after_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.880803 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > port after_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.881134 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > port after_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.881467 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > subnet after_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.881798 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > subnet after_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.882128 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > subnet after_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.882710 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.plugin [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Modular L2 Plugin initialization complete Dec 24 04:51:10.883043 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading services supported by the core plugin {{(pid=102369) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Dec 24 04:51:10.883364 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.plugins.ml2.managers [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Got port-security extension from driver 'port_security' Dec 24 04:51:10.883826 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.extensions.vlantransparent [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Disabled vlantransparent extension. Dec 24 04:51:10.884310 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=102369) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Dec 24 04:51:10.884652 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading Plugin: router Dec 24 04:51:10.920692 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router_interface before_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.921080 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router after_create 55549900 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.921456 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router before_create 55549900 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.921823 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router_interface before_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.922206 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.922561 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router after_delete 55549900 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.922928 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > floatingip after_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.923280 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > floatingip after_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.923643 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router after_create 55549900 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.923992 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router after_update 55549900 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.924350 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router after_update 55549900 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.924731 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.925077 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router after_update 55549900 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.925488 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router precommit_update 55549900 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.925860 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: port after_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.926203 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: port after_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.926541 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: subnet after_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.926877 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.927226 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > port precommit_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.927579 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router precommit_create 55549900 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.927923 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: port before_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.928268 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router precommit_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.928654 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router after_update 55549900 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.928999 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router precommit_delete 55549900 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.929354 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router precommit_create 55549900 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.929784 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router_interface after_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.930129 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router precommit_update 55549900 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.930496 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > agent after_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.930852 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > agent after_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.931201 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > network after_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.932065 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Tracking information for resource: router configured {{(pid=102369) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 24 04:51:10.932402 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Tracking information for resource: floatingip configured {{(pid=102369) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 24 04:51:10.937455 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.db.l3_agentschedulers_db [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Dec 24 04:51:10.938027 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: port after_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.938419 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: port after_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.938771 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: port after_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.939118 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: port after_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.939902 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router before_create 55550100 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.940267 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router precommit_delete 55550100 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.940662 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router precommit_create 55550100 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.941020 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > router precommit_update 55550100 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.945842 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.services.provider_configuration [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Service providers = [] {{(pid=102369) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Dec 24 04:51:10.946200 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.db.servicetype_db [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=102369) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Dec 24 04:51:10.949132 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.services.service_base [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=102369) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 24 04:51:10.949480 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.services.service_base [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=102369) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 24 04:51:10.949824 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.services.service_base [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=102369) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 24 04:51:10.950715 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.services.service_base [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=102369) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 24 04:51:10.951090 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.services.service_base [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Default provider is not specified for service type L3_ROUTER_NAT Dec 24 04:51:10.951467 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=102369) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 24 04:51:10.951776 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Dec 24 04:51:10.962926 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Successfully loaded METERING plugin. Description: METERING {{(pid=102369) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 24 04:51:10.963260 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading Plugin: auto_allocate Dec 24 04:51:10.969121 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: network precommit_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.969492 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: network precommit_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.970002 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=102369) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 24 04:51:10.970327 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading Plugin: tag Dec 24 04:51:10.977046 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=102369) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 24 04:51:10.977314 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading Plugin: timestamp Dec 24 04:51:10.981344 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=102369) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 24 04:51:10.981674 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading Plugin: network_ip_availability Dec 24 04:51:10.987160 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.987530 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.987888 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:10.988620 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=102369) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 24 04:51:10.988939 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading Plugin: flavors Dec 24 04:51:10.993802 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=102369) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 24 04:51:10.994140 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading Plugin: revisions Dec 24 04:51:10.998472 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=102369) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 24 04:51:10.998862 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_concurrency.lockutils [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.739s {{(pid=102369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 24 04:51:10.999597 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=102369) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Dec 24 04:51:10.999932 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Initializing extension manager. Dec 24 04:51:11.000452 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: __init__.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.000824 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: __pycache__ {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.001158 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.001490 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: address_group.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.002249 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.002816 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: address-group Dec 24 04:51:11.003137 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: address_scope.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.005301 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.005841 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: address-scope Dec 24 04:51:11.006182 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: admin_state_down_before_update.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.007119 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.007640 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: router-admin-state-down-before-update Dec 24 04:51:11.008024 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: agent.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.008766 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.009278 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: agent Dec 24 04:51:11.009602 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: agent_resources_synced.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.010502 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.011000 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: agent-resources-synced Dec 24 04:51:11.011324 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: allowedaddresspairs.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.013123 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.013656 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: allowed-address-pairs Dec 24 04:51:11.013979 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: auto_allocated_topology.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.015063 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.015584 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: auto-allocated-topology Dec 24 04:51:11.015909 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: availability_zone.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.016629 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.017139 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: availability_zone Dec 24 04:51:11.017457 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: availability_zone_filter.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.018377 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.018887 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: availability_zone_filter Dec 24 04:51:11.019204 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: data_plane_status.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.020114 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.020646 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension data-plane-status not supported by any of loaded plugins Dec 24 04:51:11.020962 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: default_subnetpools.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.021874 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.022382 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: default-subnetpools Dec 24 04:51:11.022699 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: dhcpagentscheduler.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.023541 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.024045 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: dhcp_agent_scheduler Dec 24 04:51:11.024367 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: dns.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.025298 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.025801 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension dns-integration not supported by any of loaded plugins Dec 24 04:51:11.026119 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: dns_domain_ports.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.027032 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.027541 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension dns-domain-ports not supported by any of loaded plugins Dec 24 04:51:11.027868 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.028809 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.029313 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Dec 24 04:51:11.029630 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: dvr.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.030297 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.030810 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: dvr Dec 24 04:51:11.031122 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: ecmp_routes.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.032030 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.032550 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension ecmp_routes not supported by any of loaded plugins Dec 24 04:51:11.032955 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: empty_string_filtering.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.033864 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.034367 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: empty-string-filtering Dec 24 04:51:11.034689 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.035588 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.036089 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Dec 24 04:51:11.036411 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.037344 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.037851 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Dec 24 04:51:11.038174 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: external_net.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.039184 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.039702 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: external-net Dec 24 04:51:11.040019 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: extra_dhcp_opt.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.040958 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.041469 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: extra_dhcp_opt Dec 24 04:51:11.041790 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: extraroute.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.042685 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.043201 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: extraroute Dec 24 04:51:11.043529 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: extraroute_atomic.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.044566 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.045112 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: extraroute-atomic Dec 24 04:51:11.045434 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: filter_validation.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.046093 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.046600 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: filter-validation Dec 24 04:51:11.046922 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: fip_pf_description.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.047850 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.048342 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Dec 24 04:51:11.048694 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: fip_port_details.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.049603 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.050104 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: fip-port-details Dec 24 04:51:11.050423 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: flavors.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.051650 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.052168 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: flavors Dec 24 04:51:11.052491 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.054206 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.054856 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Dec 24 04:51:11.055280 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: floatingip_pools.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.056075 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.056615 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: floatingip-pools Dec 24 04:51:11.056943 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: ip_allocation.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.057862 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.058367 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension ip_allocation not supported by any of loaded plugins Dec 24 04:51:11.058689 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: ip_substring_port_filtering.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.059609 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.060116 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: ip-substring-filtering Dec 24 04:51:11.060438 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: l2_adjacency.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.061390 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.061893 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension l2_adjacency not supported by any of loaded plugins Dec 24 04:51:11.062212 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: l3.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.063322 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.063844 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: router Dec 24 04:51:11.064174 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: l3_conntrack_helper.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.066465 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.066989 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension l3-conntrack-helper not supported by any of loaded plugins Dec 24 04:51:11.067318 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: l3_ext_gw_mode.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.068243 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.068796 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: ext-gw-mode Dec 24 04:51:11.069121 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: l3_ext_ha_mode.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.070054 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.070632 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: l3-ha Dec 24 04:51:11.070971 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: l3_flavors.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.071879 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.072386 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: l3-flavors Dec 24 04:51:11.072739 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.073653 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.074159 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: l3-port-ip-change-not-allowed Dec 24 04:51:11.074478 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: l3agentscheduler.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.075515 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.076035 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: l3_agent_scheduler Dec 24 04:51:11.076366 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: local_ip.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.078170 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.078697 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension local_ip not supported by any of loaded plugins Dec 24 04:51:11.079028 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: logging.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.080540 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.081073 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension logging not supported by any of loaded plugins Dec 24 04:51:11.081409 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: metering.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.082152 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.082732 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: metering Dec 24 04:51:11.083059 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.084473 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.085034 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: metering_source_and_destination_fields Dec 24 04:51:11.085361 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: multiprovidernet.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.086470 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.086989 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: multi-provider Dec 24 04:51:11.087311 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: netmtu.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.088228 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.088769 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: net-mtu Dec 24 04:51:11.089090 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: netmtu_writable.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.090013 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.090535 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: net-mtu-writable Dec 24 04:51:11.090859 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: network_availability_zone.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.091531 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.092035 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: network_availability_zone Dec 24 04:51:11.092354 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: network_ip_availability.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.093506 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.094029 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: network-ip-availability Dec 24 04:51:11.094356 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: network_segment_range.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.095116 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.095616 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension network-segment-range not supported by any of loaded plugins Dec 24 04:51:11.095935 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: pagination.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.096943 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.097402 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: pagination Dec 24 04:51:11.097727 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: port_device_profile.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.098639 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.099155 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: port-device-profile Dec 24 04:51:11.099473 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: port_mac_address_regenerate.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.100385 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.100943 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: port-mac-address-regenerate Dec 24 04:51:11.101267 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: port_numa_affinity_policy.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.102280 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.102790 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: port-numa-affinity-policy Dec 24 04:51:11.103112 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: port_resource_request.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.104028 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.104550 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension port-resource-request not supported by any of loaded plugins Dec 24 04:51:11.104882 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: port_resource_request_groups.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.105842 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.106342 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension port-resource-request-groups not supported by any of loaded plugins Dec 24 04:51:11.106666 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: portbindings.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.107599 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.108109 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: binding Dec 24 04:51:11.108430 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: portbindings_extended.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.109742 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.110262 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: binding-extended Dec 24 04:51:11.110587 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: portsecurity.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.111505 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.112027 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: port-security Dec 24 04:51:11.112347 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: project_id.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.113368 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.113701 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: project-id Dec 24 04:51:11.114018 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: providernet.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.114939 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.115462 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: provider Dec 24 04:51:11.115786 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: qos.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.119488 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.120031 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension qos not supported by any of loaded plugins Dec 24 04:51:11.120350 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: qos_bw_limit_direction.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.121625 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.122137 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Dec 24 04:51:11.122467 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.123403 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.123911 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Dec 24 04:51:11.124232 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: qos_default.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.125189 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.125695 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension qos-default not supported by any of loaded plugins Dec 24 04:51:11.126015 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: qos_fip.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.126671 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.127163 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension qos-fip not supported by any of loaded plugins Dec 24 04:51:11.127481 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: qos_fip_network_policy.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.128389 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="QoS floating IP network policy ID" alias="qos-fip-network-policy" description="Adds a the QoS network ID to the floating IP definition" updated="2021-11-15T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.128926 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension qos-fip-network-policy not supported by any of loaded plugins Dec 24 04:51:11.129249 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: qos_gateway_ip.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.130166 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.130674 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension qos-gateway-ip not supported by any of loaded plugins Dec 24 04:51:11.130997 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: qos_port_network_policy.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.131903 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.132416 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension qos-port-network-policy not supported by any of loaded plugins Dec 24 04:51:11.132895 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.133982 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.134494 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension qos-pps-minimum not supported by any of loaded plugins Dec 24 04:51:11.134816 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: qos_pps_rule.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.136006 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.136518 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension qos-pps not supported by any of loaded plugins Dec 24 04:51:11.136867 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: qos_rule_type_details.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.137780 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.138285 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension qos-rule-type-details not supported by any of loaded plugins Dec 24 04:51:11.138605 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: qos_rules_alias.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.139646 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.140151 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension qos-rules-alias not supported by any of loaded plugins Dec 24 04:51:11.140471 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: quota_check_limit.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.141407 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.141915 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: quota-check-limit Dec 24 04:51:11.142236 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: quotasv2.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.143156 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.143486 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: quotas Dec 24 04:51:11.143799 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: quotasv2_detail.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.147193 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.147542 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: quota_details Dec 24 04:51:11.147887 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: rbac.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.149239 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.149775 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: rbac-policies Dec 24 04:51:11.150142 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: rbac_address_group.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.151053 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.151570 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: rbac-address-group Dec 24 04:51:11.151894 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: rbac_address_scope.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.152845 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.153357 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: rbac-address-scope Dec 24 04:51:11.153681 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: rbac_security_groups.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.154612 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.155123 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: rbac-security-groups Dec 24 04:51:11.155443 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: rbac_subnetpool.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.156356 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.156986 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: rbac-subnetpool Dec 24 04:51:11.157311 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: revisionifmatch.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.158229 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.158741 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: revision-if-match Dec 24 04:51:11.159060 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: revisions.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.160203 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.160733 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: standard-attr-revisions Dec 24 04:51:11.161054 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: router_availability_zone.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.161726 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.162238 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: router_availability_zone Dec 24 04:51:11.162558 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: routerservicetype.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.163482 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.164102 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension router-service-type not supported by any of loaded plugins Dec 24 04:51:11.164438 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.165454 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.165966 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: security-groups-normalized-cidr Dec 24 04:51:11.166285 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: security_groups_port_filtering.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.167202 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.167706 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: port-security-groups-filtering Dec 24 04:51:11.168026 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: security_groups_remote_address_group.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.168975 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.169488 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: security-groups-remote-address-group Dec 24 04:51:11.169807 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: security_groups_shared_filtering.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.170734 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.171246 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: security-groups-shared-filtering Dec 24 04:51:11.171566 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.172155 dv-cinder-816443-2-iscsi neutron-server[102369]: WARNING neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Dec 24 04:51:11.172472 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: securitygroup.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.182362 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.182905 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: security-group Dec 24 04:51:11.183241 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: segment.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.184038 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.184562 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension segment not supported by any of loaded plugins Dec 24 04:51:11.184912 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.185849 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.186359 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Dec 24 04:51:11.186683 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: servicetype.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.187792 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.188322 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: service-type Dec 24 04:51:11.188686 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: sorting.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.189675 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.190008 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: sorting Dec 24 04:51:11.190330 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: standard_attr_segment.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.191237 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.191748 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension standard-attr-segment not supported by any of loaded plugins Dec 24 04:51:11.192073 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: standardattrdescription.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.192810 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.193315 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: standard-attr-description Dec 24 04:51:11.193642 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: stateful_security_group.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.194574 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.195087 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: stateful-security-group Dec 24 04:51:11.195579 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: stdattrs_common.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.196493 dv-cinder-816443-2-iscsi neutron-server[102369]: WARNING neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Dec 24 04:51:11.197076 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.198456 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.198981 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Dec 24 04:51:11.199306 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: subnet_onboard.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.200722 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.201512 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: subnet_onboard Dec 24 04:51:11.202068 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: subnet_segmentid_writable.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.203286 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.203831 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Dec 24 04:51:11.204154 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: subnet_service_types.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.205117 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.205634 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: subnet-service-types Dec 24 04:51:11.205961 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: subnetallocation.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.207040 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.207556 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: subnet_allocation Dec 24 04:51:11.207879 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.208564 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.209395 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: subnetpool-prefix-ops Dec 24 04:51:11.209719 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.210694 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.211237 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Dec 24 04:51:11.211698 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: tagging.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.212793 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.213315 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: standard-attr-tag Dec 24 04:51:11.213641 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: timestamp.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.214836 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.215353 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loaded extension: standard-attr-timestamp Dec 24 04:51:11.215677 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: trunk.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.216757 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.217276 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension trunk not supported by any of loaded plugins Dec 24 04:51:11.217597 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: trunk_details.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.218521 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.219036 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension trunk-details not supported by any of loaded plugins Dec 24 04:51:11.219360 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: uplink_status_propagation.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.220278 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.220821 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension uplink-status-propagation not supported by any of loaded plugins Dec 24 04:51:11.221144 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Loading extension file: vlantransparent.py {{(pid=102369) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 24 04:51:11.221826 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=102369) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 24 04:51:11.222328 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extension vlan-transparent not supported by any of loaded plugins Dec 24 04:51:11.224969 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Creating instance of TrackedResource for resource:network Dec 24 04:51:11.225516 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Creating instance of TrackedResource for resource:subnet Dec 24 04:51:11.225911 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Creating instance of TrackedResource for resource:subnetpool Dec 24 04:51:11.226301 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Creating instance of TrackedResource for resource:port Dec 24 04:51:11.227744 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.v2.resource_helper [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102369) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 24 04:51:11.228128 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.v2.resource_helper [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Service FLAVORS assigned prefix: {{(pid=102369) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 24 04:51:11.228760 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.v2.resource_helper [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102369) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 24 04:51:11.229190 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.v2.resource_helper [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102369) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 24 04:51:11.229520 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Creating instance of TrackedResource for resource:router Dec 24 04:51:11.229950 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Creating instance of TrackedResource for resource:floatingip Dec 24 04:51:11.230433 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.v2.resource_helper [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Service METERING assigned prefix: /metering {{(pid=102369) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 24 04:51:11.231919 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:11.232281 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:11.232662 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102369) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:51:11.233677 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Creating instance of CountableResource for resource:rbac_policy Dec 24 04:51:11.234115 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Creating instance of TrackedResource for resource:security_group Dec 24 04:51:11.234556 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Creating instance of TrackedResource for resource:security_group_rule Dec 24 04:51:11.235147 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.v2.resource_helper [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Service CORE assigned prefix: {{(pid=102369) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 24 04:51:11.235476 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Creating instance of TrackedResource for resource:subnetpool Dec 24 04:51:11.235819 dv-cinder-816443-2-iscsi neutron-server[102369]: WARNING neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] subnetpool is already registered Dec 24 04:51:11.236244 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.v2.resource_helper [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Service CORE assigned prefix: {{(pid=102369) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 24 04:51:11.236575 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Creating instance of TrackedResource for resource:subnetpool Dec 24 04:51:11.236919 dv-cinder-816443-2-iscsi neutron-server[102369]: WARNING neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] subnetpool is already registered Dec 24 04:51:11.239207 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.v2.resource_helper [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102369) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 24 04:51:11.239632 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.v2.resource_helper [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Service FLAVORS assigned prefix: {{(pid=102369) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 24 04:51:11.240207 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.v2.resource_helper [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102369) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 24 04:51:11.240665 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.v2.resource_helper [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102369) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 24 04:51:11.240998 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Creating instance of TrackedResource for resource:router Dec 24 04:51:11.241331 dv-cinder-816443-2-iscsi neutron-server[102369]: WARNING neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] router is already registered Dec 24 04:51:11.241738 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Creating instance of TrackedResource for resource:floatingip Dec 24 04:51:11.242085 dv-cinder-816443-2-iscsi neutron-server[102369]: WARNING neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] floatingip is already registered Dec 24 04:51:11.242533 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.v2.resource_helper [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Service METERING assigned prefix: /metering {{(pid=102369) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 24 04:51:11.243195 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Creating instance of CountableResource for resource:rbac_policy Dec 24 04:51:11.243522 dv-cinder-816443-2-iscsi neutron-server[102369]: WARNING neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] rbac_policy is already registered Dec 24 04:51:11.243924 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Creating instance of TrackedResource for resource:security_group Dec 24 04:51:11.244255 dv-cinder-816443-2-iscsi neutron-server[102369]: WARNING neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] security_group is already registered Dec 24 04:51:11.244662 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Creating instance of TrackedResource for resource:security_group_rule Dec 24 04:51:11.244992 dv-cinder-816443-2-iscsi neutron-server[102369]: WARNING neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] security_group_rule is already registered Dec 24 04:51:11.245607 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.v2.resource_helper [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Service CORE assigned prefix: {{(pid=102369) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 24 04:51:11.245935 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Creating instance of TrackedResource for resource:subnetpool Dec 24 04:51:11.246266 dv-cinder-816443-2-iscsi neutron-server[102369]: WARNING neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] subnetpool is already registered Dec 24 04:51:11.246685 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.v2.resource_helper [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Service CORE assigned prefix: {{(pid=102369) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 24 04:51:11.247007 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Creating instance of TrackedResource for resource:subnetpool Dec 24 04:51:11.247336 dv-cinder-816443-2-iscsi neutron-server[102369]: WARNING neutron.quota.resource_registry [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] subnetpool is already registered Dec 24 04:51:11.247801 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: extensions {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.249313 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: address-groups {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.250809 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: address-scopes {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.252165 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: agents {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.253398 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: auto-allocated-topology {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.254672 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: availability_zones {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.255930 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: dhcp-networks {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.257487 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: dhcp-agents {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.259186 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: routers {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.262446 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: flavors {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.263667 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: service_profiles {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.264923 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: next_providers {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.266374 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: service_profiles {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.267948 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: floatingip-pools {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.269232 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: routers {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.271354 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: floatingips {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.272691 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: l3-routers {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.274117 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: l3-agents {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.275545 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: metering-labels {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.276933 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: metering-label-rules {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.278226 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: network-ip-availabilities {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.279505 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: bindings {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.281196 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: quotas {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.282855 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: quotas {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.284410 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: rbac-policies {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.285752 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: security-groups {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.286974 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: security-group-rules {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.288213 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: service-providers {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.289718 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: subnetpools {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.291160 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: subnetpools {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.292649 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: tags {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.294348 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: tags {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.296262 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: tags {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.298091 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: tags {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.299874 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: tags {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.301744 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: tags {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.303531 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: tags {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.306195 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: tags {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.309556 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: tags {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.311471 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron.api.extensions [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Extended resource: tags {{(pid=102369) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 24 04:51:11.319091 dv-cinder-816443-2-iscsi neutron-server[102369]: WARNING keystonemiddleware.auth_token [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 24 04:51:11.323580 dv-cinder-816443-2-iscsi neutron-server[102369]: WARNING keystonemiddleware.auth_token [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 24 04:51:11.332116 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_concurrency.lockutils [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Acquired lock "singleton_lock" {{(pid=102369) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 24 04:51:11.332586 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_concurrency.lockutils [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Releasing lock "singleton_lock" {{(pid=102369) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 24 04:51:11.333268 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO oslo_service.service [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Starting 2 workers Dec 24 04:51:11.338352 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Started child 102476 {{(pid=102369) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 24 04:51:11.342697 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Started child 102477 {{(pid=102369) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 24 04:51:11.343790 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:11.344457 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO neutron.service [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Neutron service started, listening on 0.0.0.0:9696 Dec 24 04:51:11.344819 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Publish callbacks [] for process, before_spawn {{(pid=102369) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:11.345224 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [-] (102476) wsgi starting up on http://0.0.0.0:9696 Dec 24 04:51:11.347158 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO oslo_service.service [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Starting 1 workers Dec 24 04:51:11.347409 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:11.348731 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [-] (102477) wsgi starting up on http://0.0.0.0:9696 Dec 24 04:51:11.352224 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Started child 102478 {{(pid=102369) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 24 04:51:11.352831 dv-cinder-816443-2-iscsi neutron-server[102369]: INFO oslo_service.service [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Starting 1 workers Dec 24 04:51:11.355979 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.service [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] calling RpcWorker wait() {{(pid=102478) _wait /opt/stack/neutron/neutron/service.py:128}} Dec 24 04:51:11.356572 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.service [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] returning from RpcWorker wait() {{(pid=102478) _wait /opt/stack/neutron/neutron/service.py:135}} Dec 24 04:51:11.357282 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Started child 102479 {{(pid=102369) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 24 04:51:11.357753 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:11.358073 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG neutron_lib.callbacks.manager [None req-93aed350-4ead-431f-889c-ddbdeeff12ba None None] Publish callbacks [] for process, after_spawn {{(pid=102369) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:11.358225 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:51:11.360008 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102369) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Dec 24 04:51:11.360218 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 24 04:51:11.360371 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 24 04:51:11.360632 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 24 04:51:11.360956 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 24 04:51:11.361101 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 24 04:51:11.361626 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.361868 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.362133 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.362231 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:11.362692 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.362692 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.363270 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.363493 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.363719 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.363976 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.364243 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.364369 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.364569 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.364917 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.365129 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.365464 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.365698 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.365957 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.366160 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.366325 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.366604 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.366816 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.367096 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.367573 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] debug = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.367847 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.368328 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.368580 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.368823 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.369039 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.369309 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.369566 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.369814 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.370033 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.370267 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.370503 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.370746 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.370983 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.371198 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.371436 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.371649 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.371922 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.372155 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.372637 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] host = dv-cinder-816443-2-iscsi {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.372871 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.373083 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.373309 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.373552 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.373799 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.374033 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.374286 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.374543 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.374779 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.375016 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.375260 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.375501 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.375713 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.375933 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] log_file = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.376098 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] log_options = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.376312 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.376595 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.376862 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.377056 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.377218 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.377387 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.377650 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.377813 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.378059 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.378302 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.378513 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.378724 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.378935 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.379166 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.379417 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.379675 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.379879 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.381135 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.382322 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.382815 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.383065 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.383347 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.383713 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:51:11.383864 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.384140 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.384390 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.384616 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.384862 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.385094 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.385523 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.386547 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.386547 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.386800 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.387005 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.387251 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.387520 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.387778 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.388192 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.388977 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.389290 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.389546 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.389825 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.390093 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.390335 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.390592 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.390836 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.391073 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.391305 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] use_json = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.391530 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.391793 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.392585 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.392585 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.392585 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.392967 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.392967 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.394437 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.394437 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.394437 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.394437 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.394437 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.394870 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.394962 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.395151 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.395397 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.395664 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.395900 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.396542 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.396542 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.396929 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.397297 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.397589 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.397949 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.398212 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.398715 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.399047 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.399312 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.399550 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.399795 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.400065 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.400310 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.400581 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.400826 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.401096 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.401405 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.401666 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.402009 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.402290 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.402548 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.43/identity {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.402848 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.403043 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.403295 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.403547 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.403788 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.404010 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.404229 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.404496 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.404749 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.404967 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.405210 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.405460 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.405693 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.405924 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.406171 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.406424 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.406675 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.406901 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.407119 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.407364 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.407602 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.407826 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.408099 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.408343 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.408643 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.408937 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.409164 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.409378 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.409613 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.409835 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.410068 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.410285 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.410499 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.410705 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.410944 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.411156 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.411471 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.411694 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.411908 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.412147 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.412397 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.412655 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.412897 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.413110 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.413323 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.413540 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.413756 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.413998 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.414311 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.414613 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.414836 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.415063 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.415275 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.415710 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.415919 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.416127 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.416335 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.417693 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.417693 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.417693 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.417693 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.418856 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.419121 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.419343 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.419828 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.420092 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.420342 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.421670 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.421670 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.421670 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.421670 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.421958 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.422037 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.422224 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.422468 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.422732 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.422959 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.423203 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.423429 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.423653 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.423872 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.424149 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.424383 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.424655 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.424913 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.425338 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.425781 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.426193 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.426618 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.427019 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.427440 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.427742 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.428174 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.428660 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.429112 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.429369 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.429785 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.430084 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.430364 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.430675 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.430879 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.431089 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.431339 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.431754 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.432000 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.432256 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.432589 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.432843 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.433083 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.433304 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.433576 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.433808 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.434056 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.434320 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.434575 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.434838 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.435096 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.435337 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.43/identity {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.435742 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.436144 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.436588 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.436807 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.437053 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.437304 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.437542 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.437780 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.438020 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.438293 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.438767 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.438767 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.438956 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.439181 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.439399 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.439630 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.439994 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.440386 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.440666 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.440904 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.441151 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.441371 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.441617 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.442324 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.442577 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.442851 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.443100 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.443332 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.443565 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.443832 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.444090 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.444306 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.444703 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.444943 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.445182 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.445416 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.445655 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.445866 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.446274 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.446514 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.446758 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.447040 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.447306 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.447628 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.447880 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.448133 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.448381 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.448622 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.448863 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.449116 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.449353 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.449575 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.449794 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.450015 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.450276 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.450536 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.450803 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.451017 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.451227 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.451442 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.451680 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.451891 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.452172 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.452413 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.452673 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.452930 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.453165 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.453394 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.453631 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.453871 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.454082 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.454325 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.454548 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.454756 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.454984 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.455197 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.455411 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.455653 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.455890 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.456157 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.456412 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.456648 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.456858 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.457098 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.457313 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.457521 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.457750 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.457961 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.458171 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.458393 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.458609 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.458838 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.459379 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.459585 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.459789 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.460038 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.460273 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.460483 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.460882 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.461283 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.461609 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.461821 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.462059 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.462322 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.462545 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.462888 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.463105 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.463345 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.463584 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.463805 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.464025 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.464293 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.464623 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.464909 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.465122 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:51:11.465213 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.465408 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.465707 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.465995 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:100:149'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.466252 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.466467 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.466745 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.467048 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.467312 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.467571 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.467820 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.468077 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.468304 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.468950 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.469202 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.469435 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.469651 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.470279 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.470922 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.471330 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.471704 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.471960 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.472194 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.472442 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.472899 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.473303 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.473545 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.473707 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 24 04:51:11.474241 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102369) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Dec 24 04:51:11.474407 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 24 04:51:11.474565 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 24 04:51:11.474737 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 24 04:51:11.474910 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 24 04:51:11.475133 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 24 04:51:11.475268 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.475586 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.475760 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.475918 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.476080 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.476276 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.476654 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.476919 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.476919 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.477174 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.477301 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.477429 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.477570 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.477652 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.477876 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.477982 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.478123 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.478280 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.478599 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.478764 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.478923 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.479084 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.479245 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] debug = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.479408 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.479625 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.479789 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.480094 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.480254 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.480566 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.480888 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.481045 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.481346 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.481509 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.481669 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.481831 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.481989 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.482301 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.482445 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.482767 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.482910 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.483206 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.483384 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] host = dv-cinder-816443-2-iscsi {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.483540 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.483710 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.483859 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.484030 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.484179 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.484348 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.484582 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.484675 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.484816 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.484992 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.485141 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.485319 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.485467 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.485635 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] log_file = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.485784 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] log_options = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.485930 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.486107 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.486243 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.486441 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.486593 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.486764 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.486955 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.487060 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.487222 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.487381 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.487540 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.487700 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.487859 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.488913 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.488913 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.488913 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.488913 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.489379 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.489379 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.489607 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.489740 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.489859 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.489977 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.490095 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.490242 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.490403 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.490711 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.490872 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.491032 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.491191 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.491350 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.491508 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.491815 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.491961 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.492194 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.492337 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.492471 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.492687 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.492853 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.493009 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.493173 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.493332 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.493492 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.493651 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.493812 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.493970 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.494131 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] use_json = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.494289 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.494446 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.494605 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.494763 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.494921 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.495080 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.495242 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.495402 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 24 04:51:11.495582 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.495745 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.495918 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.496081 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.496242 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.496405 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.496589 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.496752 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.496913 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.497074 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.497243 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.497406 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.497578 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.497739 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.497899 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.498063 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.498226 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.498387 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.498548 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.498709 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.498871 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.499032 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.499204 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.499366 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.499527 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.499690 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.499851 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.500019 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.500180 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.500356 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.500518 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.500704 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.43/identity {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.500865 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.501026 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.501189 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.501350 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.501900 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.501900 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.501900 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.502225 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.502225 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.502448 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.502448 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.502668 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.502785 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.502891 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.503016 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.503213 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.503345 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.503475 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.503596 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.503759 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.503922 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.504085 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.504246 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.504409 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.504592 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.504765 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.504926 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.505089 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.505249 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.505411 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.505574 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.505736 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.505897 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.506058 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.506219 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.506379 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.506554 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.506715 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.506877 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.507038 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.507201 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.507362 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.507524 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.507726 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.507890 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.508089 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.508275 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.508357 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.508511 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.508693 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.508872 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.509006 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.509169 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.509330 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.509491 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.509652 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.509815 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.509977 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.510139 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.510310 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.510486 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.510648 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.510809 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.511298 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.511298 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.511298 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.511522 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.511601 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.511711 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.511871 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.512032 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.512193 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.512356 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.512542 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.512704 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.512865 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.513025 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.513207 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.513352 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.513513 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.513674 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.513835 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.513996 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.514156 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.514317 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.514478 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.514648 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.514810 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.514974 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.515136 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.515309 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.515479 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.515642 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.515803 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.515964 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.516128 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.516289 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.516449 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.516630 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.516793 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.516954 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.517115 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.517287 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.517450 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.517612 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.517775 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.517961 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.518121 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.518284 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.518446 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.518607 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.518769 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.518930 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.519092 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.519254 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.519418 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.519579 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.519741 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.43/identity {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.519903 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.520064 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.520226 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.520386 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.520565 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.520730 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.520892 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.521054 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.521218 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.521380 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.521542 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.521704 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.521865 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.522025 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.522185 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.522347 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.522513 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.522675 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.522836 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.522996 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.523157 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.523362 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.523524 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.523685 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.523845 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.524008 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.524170 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.524333 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.524497 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.524681 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.524842 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.525003 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.525165 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.525326 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.525487 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.525648 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.525810 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.525971 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.526132 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.526293 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.526456 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.526617 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.526781 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.526956 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.527117 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.527276 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.527436 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.527597 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.527758 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.527918 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.528079 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.528239 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.528401 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.528580 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.528749 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.528911 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.529071 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.529233 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.529392 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.529553 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.529713 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.529873 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.530048 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.530211 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.530372 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.530535 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.530722 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.530859 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.531030 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.531194 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.531354 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.531516 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.531676 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.531837 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.532008 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.532169 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.532328 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.532496 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.532677 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.532839 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.533009 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.533171 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.533332 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.533494 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.533655 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.533816 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.533985 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.534146 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.534307 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.534468 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.534628 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.534788 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.534959 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.535120 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.535281 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.535443 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.535604 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.535764 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.535936 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.536098 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.536260 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.536428 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.536609 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.536771 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.536930 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.537103 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.537263 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.537427 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.537588 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.537751 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.537912 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.538074 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.538239 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.538412 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.538582 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.538744 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.538941 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.539091 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:100:149'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.539263 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.539424 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.539591 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.539763 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.539923 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.540083 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.540244 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.540405 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.540591 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.540749 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.540910 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.541070 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.541230 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.541390 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.541551 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.541711 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.541871 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.542031 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.542191 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.542356 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.542517 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.542678 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.542838 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 24 04:51:11.542991 dv-cinder-816443-2-iscsi neutron-server[102369]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 24 04:51:11.664056 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 49642) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:51:11.677758 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [-] 10.222.0.43 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0101724 Dec 24 04:51:23.199203 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e17dcce4-2c2f-44c4-90a2-dbec9248a797 None None] get_active_networks_info from dv-cinder-816443-2-iscsi {{(pid=102478) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 24 04:51:23.254640 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e17dcce4-2c2f-44c4-90a2-dbec9248a797 None None] No non-hosted networks {{(pid=102478) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Dec 24 04:51:23.272339 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-4d190a15-d21b-40ce-99da-44d5064d9bdd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-548406'] for agent, after_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:25.237852 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-548cd64a-8e43-4ea2-8da9-5a5d63f85dee None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-548406'] for agent, after_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:25.280375 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8e0083bb-c81e-44a8-a989-72efba8f1ab5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:26.424886 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-548406'] for agent, after_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:27.838404 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-548406'] for agent, after_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:28.576610 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-548406'] for agent, after_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:28.577445 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:28.577831 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:28.578254 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:28.578641 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:28.579169 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:28.579823 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:28.580332 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:28.581125 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:28.581620 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:28.582468 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:28.583792 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:28.584627 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:28.585149 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:28.585647 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-816443-2-iscsi', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2', 'LocalIPAssociation': '1.0'}) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:51:28.598418 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-816443-2-iscsi', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2', 'LocalIPAssociation': '1.0'}} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:51:32.216001 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 49742) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:51:32.652558 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.db.l3_hamode_db [None req-dbee4e64-f743-45cf-8082-080d389405b4 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Dec 24 04:51:32.727295 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbee4e64-f743-45cf-8082-080d389405b4 None None] Routers set() bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 04:51:32.727643 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbee4e64-f743-45cf-8082-080d389405b4 None None] Router IDs set() for agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Dec 24 04:51:32.748605 dv-cinder-816443-2-iscsi neutron-server[102476]: WARNING oslo_policy.policy [None req-3117b354-d825-41eb-a0ca-a2d52b408017 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 24 04:51:32.749414 dv-cinder-816443-2-iscsi neutron-server[102476]: WARNING oslo_policy.policy [None req-3117b354-d825-41eb-a0ca-a2d52b408017 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 24 04:51:32.979998 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [None req-3117b354-d825-41eb-a0ca-a2d52b408017 admin admin] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102476) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 24 04:51:32.981255 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-3117b354-d825-41eb-a0ca-a2d52b408017 admin admin] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7629550 Dec 24 04:51:36.048816 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 49758) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:51:36.397845 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-8b7173ce-4fe0-4abd-9231-dc35104bebaa admin admin] Request body: {'subnetpool': {'shared': True, 'tenant_id': '49af853a7d674e84987f8788493d4239', 'prefixes': ['172.20.0.0/16'], 'name': 'shared-default-subnetpool-v4', 'default_prefixlen': 26, 'is_default': True}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:51:36.492138 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.policy [None req-8b7173ce-4fe0-4abd-9231-dc35104bebaa admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=102476) register_rules /opt/stack/neutron/neutron/policy.py:73}} Dec 24 04:51:36.536705 dv-cinder-816443-2-iscsi neutron-server[102476]: WARNING oslo_policy.policy [None req-8b7173ce-4fe0-4abd-9231-dc35104bebaa admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 24 04:51:36.537002 dv-cinder-816443-2-iscsi neutron-server[102476]: WARNING oslo_policy.policy [None req-8b7173ce-4fe0-4abd-9231-dc35104bebaa admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 24 04:51:36.545456 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.quota [None req-8b7173ce-4fe0-4abd-9231-dc35104bebaa admin admin] Loaded quota_driver: . Dec 24 04:51:36.638960 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-8b7173ce-4fe0-4abd-9231-dc35104bebaa admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8750577847038', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8750577845421', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8750577865521', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8750577861688', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8750577817955', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8750577843723', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-3738844', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-3747666', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-532447', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1506333'] for rbac-policy, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:36.712139 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-8b7173ce-4fe0-4abd-9231-dc35104bebaa admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:36.713399 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-8b7173ce-4fe0-4abd-9231-dc35104bebaa admin admin] 10.222.0.43 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.6635766 Dec 24 04:51:39.594606 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 49770) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:51:39.922865 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Request body: {'network': {'project_id': '036a37ec848b4c9bb369e71b5c2453c7', 'tenant_id': '036a37ec848b4c9bb369e71b5c2453c7', 'name': 'private', 'admin_state_up': True}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:51:39.955040 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Made reservation on behalf of 036a37ec848b4c9bb369e71b5c2453c7 for: {'network': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:51:39.958079 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for network, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:39.975026 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:40.105936 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:40.111296 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:40.135637 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] vlan segment allocate from pool success with {'vlan_id': 131, 'physical_network': 'physnet1'} {{(pid=102476) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 24 04:51:40.159439 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8750577966933', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:40.159987 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Unsubscribe: segment precommit_create {{(pid=102476) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Dec 24 04:51:40.160470 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.segments_db [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Added segment e00e29d1-c240-4daa-b51a-387411404502 of type vlan for network 51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8 Dec 24 04:51:40.166068 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a0f9ba01-06be-464b-9007-50e931d96d46,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:51:40.203344 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:40.203662 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:40.203993 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:40.204317 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:40.204682 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:40.205005 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:40.205323 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:40.205646 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:40.205978 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:40.206312 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:40.206629 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:40.206940 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:40.207249 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Tracked resource versions report: Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: pushed versions: Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: { 'AddressGroup': {'1.2'}, Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: 'ConntrackHelper': {'1.0'}, Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: 'LocalIPAssociation': {'1.0'}, Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: 'Log': {'1.0'}, Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: 'Network': {'1.1'}, Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: 'Port': {'1.7'}, Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: 'PortForwarding': {'1.2'}, Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: 'QosPolicy': {'1.10'}, Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: 'SecurityGroup': {'1.5'}, Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: 'SecurityGroupRule': {'1.2'}, Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: 'SubPort': {'1.0'}, Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: 'Subnet': {'1.1'}, Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: 'Trunk': {'1.1'}} Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: consumer versions: Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: { DHCP agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: L3 agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: Metadata agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: Metering agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: Open vSwitch agent@dv-cinder-816443-2-iscsi: { 'AddressGroup': '1.2', Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: 'ConntrackHelper': '1.0', Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: 'LocalIPAssociation': '1.0', Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: 'Log': '1.0', Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: 'Network': '1.1', Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: 'Port': '1.7', Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: 'PortForwarding': '1.2', Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: 'QosPolicy': '1.10', Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: 'SecurityGroup': '1.5', Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: 'SecurityGroupRule': '1.2', Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: 'SubPort': '1.0', Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: 'Subnet': '1.1', Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: 'Trunk': '1.1'}} Dec 24 04:51:40.208612 dv-cinder-816443-2-iscsi neutron-server[102476]: {{(pid=102476) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 24 04:51:40.273167 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750577486812'] for network, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:40.312882 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for network, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:40.314297 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:51:40.315166 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:40.372510 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.7767591 Dec 24 04:51:40.416656 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e7bb26d-15fd-4b8e-8637-fa81d41134a5 admin admin] Pushing event updated for resources: {'Network': ['ID=51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:51:40.429032 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Network 51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8 details requested by agent ovs-agent-dv-cinder-816443-2-iscsi with host dv-cinder-816443-2-iscsi {{(pid=102478) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 24 04:51:43.305379 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 49784) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:51:43.747096 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-822dc4ee-73fc-42b0-bd9b-94ba76f7b5d5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:51:43.749038 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-822dc4ee-73fc-42b0-bd9b-94ba76f7b5d5 admin admin] 10.222.0.43 "GET /v2.0/networks/51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8 HTTP/1.1" status: 200 len: 825 time: 0.4424744 Dec 24 04:51:43.778023 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-047c4840-089a-412e-9f57-ddbba065ea6e admin admin] 10.222.0.43 "GET /v2.0/subnetpools/474562d4-9ec7-42c5-9ba4-c439229b5b91 HTTP/1.1" status: 200 len: 734 time: 0.0194814 Dec 24 04:51:43.787152 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-429e0994-a4cd-4c3c-b18f-52df71139d52 admin admin] Request body: {'subnet': {'ip_version': 4, 'gateway_ip': '172.20.0.1', 'name': 'private-subnet', 'tenant_id': '036a37ec848b4c9bb369e71b5c2453c7', 'subnetpool_id': '474562d4-9ec7-42c5-9ba4-c439229b5b91', 'network_id': '51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:51:43.814068 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-429e0994-a4cd-4c3c-b18f-52df71139d52 admin admin] Made reservation on behalf of 036a37ec848b4c9bb369e71b5c2453c7 for: {'subnet': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:51:43.816276 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-429e0994-a4cd-4c3c-b18f-52df71139d52 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:44.112844 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-429e0994-a4cd-4c3c-b18f-52df71139d52 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for subnet, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:44.180932 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429e0994-a4cd-4c3c-b18f-52df71139d52 admin admin] Pushing event updated for resources: {'Subnet': ['ID=03cfca50-3175-40b4-ba43-f0875647d4ab,revision_number=0']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:51:44.189429 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-429e0994-a4cd-4c3c-b18f-52df71139d52 admin admin] Checking segment: {'id': 'e00e29d1-c240-4daa-b51a-387411404502', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:51:44.189820 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-429e0994-a4cd-4c3c-b18f-52df71139d52 admin admin] Network hostable DHCP agents. Network: 51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8, hostable agents: ['01bc2530-0600-4d1b-b486-2fd9d63a2d51'], hosted agents: [] {{(pid=102476) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 24 04:51:44.211126 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-429e0994-a4cd-4c3c-b18f-52df71139d52 admin admin] Network 51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8 is scheduled to be hosted by DHCP agent 01bc2530-0600-4d1b-b486-2fd9d63a2d51 with binding_index 1 {{(pid=102476) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 24 04:51:44.222618 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-429e0994-a4cd-4c3c-b18f-52df71139d52 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816443-2-iscsi, 51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8) {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:51:44.228774 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-429e0994-a4cd-4c3c-b18f-52df71139d52 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:51:44.229651 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-429e0994-a4cd-4c3c-b18f-52df71139d52 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:44.232877 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-80d1f99a-e5d3-4495-9276-7881675ed41e None None] Network 51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 04:51:44.248107 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-429e0994-a4cd-4c3c-b18f-52df71139d52 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.4641879 Dec 24 04:51:44.501510 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpd2866d45-53d6-5577-9724-7d7a303c375f-51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8', 'network_id': '51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8', 'project_id': '036a37ec848b4c9bb369e71b5c2453c7', 'fixed_ips': [{'subnet_id': '03cfca50-3175-40b4-ba43-f0875647d4ab'}]}} from dv-cinder-816443-2-iscsi. {{(pid=102478) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 24 04:51:44.502717 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:44.800289 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.db_base_plugin_common [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Allocated IP 172.20.0.2 (51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8/03cfca50-3175-40b4-ba43-f0875647d4ab/6c0eddd5-2f62-451c-8dd9-9bcc155b51aa) {{(pid=102478) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 04:51:45.039189 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Publish callbacks [] for port, precommit_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:45.048650 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001'] for port, after_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:45.121875 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Network 51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8 is already hosted by enough agents. {{(pid=102478) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 04:51:45.126559 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.scheduler.base_scheduler [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Resources bound (agent type, host, resource id): {{(pid=102478) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:51:45.130386 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Received port after_create {{(pid=102478) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 04:51:45.163518 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Pushing event updated for resources: {'Port': ['ID=6c0eddd5-2f62-451c-8dd9-9bcc155b51aa,revision_number=1']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:51:45.187695 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:45.188272 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:45.188658 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:45.188994 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:45.189318 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:45.189638 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:45.189957 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:45.190294 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:45.190579 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:45.190877 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:45.191224 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:45.191533 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:45.191848 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Tracked resource versions report: Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: pushed versions: Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: { 'AddressGroup': {'1.2'}, Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: 'ConntrackHelper': {'1.0'}, Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: 'LocalIPAssociation': {'1.0'}, Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: 'Log': {'1.0'}, Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: 'Network': {'1.1'}, Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: 'Port': {'1.7'}, Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: 'PortForwarding': {'1.2'}, Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: 'QosPolicy': {'1.10'}, Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: 'SecurityGroup': {'1.5'}, Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: 'SecurityGroupRule': {'1.2'}, Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: 'SubPort': {'1.0'}, Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: 'Subnet': {'1.1'}, Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: 'Trunk': {'1.1'}} Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: consumer versions: Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: { DHCP agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: L3 agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: Metadata agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: Metering agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: Open vSwitch agent@dv-cinder-816443-2-iscsi: { 'AddressGroup': '1.2', Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: 'ConntrackHelper': '1.0', Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: 'LocalIPAssociation': '1.0', Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: 'Log': '1.0', Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: 'Network': '1.1', Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: 'Port': '1.7', Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: 'PortForwarding': '1.2', Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: 'QosPolicy': '1.10', Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: 'SecurityGroup': '1.5', Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: 'SecurityGroupRule': '1.2', Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: 'SubPort': '1.0', Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: 'Subnet': '1.1', Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: 'Trunk': '1.1'}} Dec 24 04:51:45.193435 dv-cinder-816443-2-iscsi neutron-server[102478]: {{(pid=102478) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 24 04:51:45.221412 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Attempting to bind port 6c0eddd5-2f62-451c-8dd9-9bcc155b51aa on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 04:51:45.221806 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Attempting to bind port 6c0eddd5-2f62-451c-8dd9-9bcc155b51aa by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': 'e00e29d1-c240-4daa-b51a-387411404502', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8'}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 04:51:45.222202 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Attempting to bind port 6c0eddd5-2f62-451c-8dd9-9bcc155b51aa on network 51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8 {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 04:51:45.227853 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 4, 51, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 04:51:45.228330 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Checking segment: {'id': 'e00e29d1-c240-4daa-b51a-387411404502', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102478) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:51:45.228912 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:45.229375 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Bound using segment: {'id': 'e00e29d1-c240-4daa-b51a-387411404502', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8'} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 04:51:45.229878 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Bound port: 6c0eddd5-2f62-451c-8dd9-9bcc155b51aa, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e00e29d1-c240-4daa-b51a-387411404502', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8'}}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 04:51:45.230354 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:45.296546 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] For port 6c0eddd5-2f62-451c-8dd9-9bcc155b51aa, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102478) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 04:51:45.301016 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] For port 6c0eddd5-2f62-451c-8dd9-9bcc155b51aa, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=6c0eddd5-2f62-451c-8dd9-9bcc155b51aa,segment=NetworkSegment(e00e29d1-c240-4daa-b51a-387411404502),segment_id=e00e29d1-c240-4daa-b51a-387411404502)] {{(pid=102478) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 04:51:45.305812 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:45.368804 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb5b3e93-345d-4a56-b34a-106b26cc9ba9 None None] Pushing event updated for resources: {'Port': ['ID=6c0eddd5-2f62-451c-8dd9-9bcc155b51aa,revision_number=2']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:51:46.819921 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 49792) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:51:47.350506 dv-cinder-816443-2-iscsi neutron-server[102477]: WARNING oslo_policy.policy [None req-9b26036d-d433-4a0c-9dee-8af85d0cebb1 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 24 04:51:47.351073 dv-cinder-816443-2-iscsi neutron-server[102477]: WARNING oslo_policy.policy [None req-9b26036d-d433-4a0c-9dee-8af85d0cebb1 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 24 04:51:47.577783 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [None req-9b26036d-d433-4a0c-9dee-8af85d0cebb1 admin admin] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102477) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 24 04:51:47.578886 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-9b26036d-d433-4a0c-9dee-8af85d0cebb1 admin admin] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7578938 Dec 24 04:51:50.235008 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 49806) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:51:50.562015 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [None req-4e5f4080-dd2e-43b2-980d-dad7d964ed95 admin admin] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102477) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 24 04:51:50.563101 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-4e5f4080-dd2e-43b2-980d-dad7d964ed95 admin admin] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3271933 Dec 24 04:51:53.140907 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-03adda39-8628-486d-bfcd-e49a664ba7ae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:53.426859 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 49820) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:51:53.760888 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-0b4bdfa2-e2df-452c-aa77-228c6dd972b1 admin admin] Request body: {'router': {'name': 'router1', 'tenant_id': '036a37ec848b4c9bb369e71b5c2453c7', 'admin_state_up': True}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:51:53.825793 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.policy [None req-0b4bdfa2-e2df-452c-aa77-228c6dd972b1 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=102477) register_rules /opt/stack/neutron/neutron/policy.py:73}} Dec 24 04:51:53.872437 dv-cinder-816443-2-iscsi neutron-server[102477]: WARNING oslo_policy.policy [None req-0b4bdfa2-e2df-452c-aa77-228c6dd972b1 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 24 04:51:53.872856 dv-cinder-816443-2-iscsi neutron-server[102477]: WARNING oslo_policy.policy [None req-0b4bdfa2-e2df-452c-aa77-228c6dd972b1 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 24 04:51:53.881467 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.quota [None req-0b4bdfa2-e2df-452c-aa77-228c6dd972b1 admin admin] Loaded quota_driver: . Dec 24 04:51:53.940327 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-0b4bdfa2-e2df-452c-aa77-228c6dd972b1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-546186', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2070334'] for router, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:53.942167 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-0b4bdfa2-e2df-452c-aa77-228c6dd972b1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-546302', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-549497', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-553463', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2070311'] for router, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:54.094895 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-0b4bdfa2-e2df-452c-aa77-228c6dd972b1 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:54.101508 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-0b4bdfa2-e2df-452c-aa77-228c6dd972b1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-546295', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-545958'] for router, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:54.123340 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-0b4bdfa2-e2df-452c-aa77-228c6dd972b1 admin admin] Publish callbacks [] for router, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:54.124635 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-0b4bdfa2-e2df-452c-aa77-228c6dd972b1 admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.6967697 Dec 24 04:51:54.358031 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 6c0eddd5-2f62-451c-8dd9-9bcc155b51aa up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 04:51:54.361282 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-811ff4a2-26e6-4cca-a1fe-8ec88056d7cd None None] Network 51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 04:51:54.507028 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-c57f530b-1844-4aef-8008-f9820d3f7174 None None] Provisioning complete for port 6c0eddd5-2f62-451c-8dd9-9bcc155b51aa triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:51:54.507262 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-c57f530b-1844-4aef-8008-f9820d3f7174 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:54.576738 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 6c0eddd5-2f62-451c-8dd9-9bcc155b51aa triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:51:54.577113 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:54.704886 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-c57f530b-1844-4aef-8008-f9820d3f7174 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:54.768238 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-c57f530b-1844-4aef-8008-f9820d3f7174 None None] For port 6c0eddd5-2f62-451c-8dd9-9bcc155b51aa, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=6c0eddd5-2f62-451c-8dd9-9bcc155b51aa,segment=NetworkSegment(e00e29d1-c240-4daa-b51a-387411404502),segment_id=e00e29d1-c240-4daa-b51a-387411404502)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 04:51:54.769354 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:54.778595 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-c57f530b-1844-4aef-8008-f9820d3f7174 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:54.865225 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c57f530b-1844-4aef-8008-f9820d3f7174 None None] Pushing event updated for resources: {'Port': ['ID=6c0eddd5-2f62-451c-8dd9-9bcc155b51aa,revision_number=3']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:51:54.870529 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.db.api [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102478) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 24 04:51:54.870943 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG oslo_db.api [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 24 04:51:55.064844 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-f3166439-037d-4b5c-a01d-9cca0aceba91 None None] Provisioning complete for port 6c0eddd5-2f62-451c-8dd9-9bcc155b51aa triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:51:55.065231 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-f3166439-037d-4b5c-a01d-9cca0aceba91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:55.239163 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-ef7cd6d0-5adc-4189-aebf-a308ce824013 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:56.324809 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 6c0eddd5-2f62-451c-8dd9-9bcc155b51aa up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 04:51:56.384802 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:56.386415 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 6c0eddd5-2f62-451c-8dd9-9bcc155b51aa triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:51:56.386806 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:56.765116 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 49842) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:51:56.923184 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [None req-745f8a71-4aad-490f-9fdb-fb7894ea7a41 admin admin] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102476) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 24 04:51:56.924190 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-745f8a71-4aad-490f-9fdb-fb7894ea7a41 admin admin] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1578593 Dec 24 04:51:57.804331 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:58.580198 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:59.438076 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 49862) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:51:59.497299 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-14f05c05-da0a-4700-b77a-b3ccbd4a04f2 admin admin] Request body: {'network': {'admin_state_up': True, 'is_default': True, 'name': 'public', 'provider:physical_network': 'physnet1', 'router:external': True, 'tenant_id': '49af853a7d674e84987f8788493d4239', 'project_id': '49af853a7d674e84987f8788493d4239', 'provider:network_type': 'flat'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:51:59.525743 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-14f05c05-da0a-4700-b77a-b3ccbd4a04f2 admin admin] Made reservation on behalf of 49af853a7d674e84987f8788493d4239 for: {'network': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:51:59.528115 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-14f05c05-da0a-4700-b77a-b3ccbd4a04f2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for network, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:59.536406 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-14f05c05-da0a-4700-b77a-b3ccbd4a04f2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:59.613043 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-14f05c05-da0a-4700-b77a-b3ccbd4a04f2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:59.618957 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-14f05c05-da0a-4700-b77a-b3ccbd4a04f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:59.637900 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-14f05c05-da0a-4700-b77a-b3ccbd4a04f2 admin admin] Reserving flat network on physical network physnet1 {{(pid=102476) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Dec 24 04:51:59.657713 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14f05c05-da0a-4700-b77a-b3ccbd4a04f2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f5dd71b9-dfb9-4a05-8867-03f18125f843,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:51:59.664606 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-14f05c05-da0a-4700-b77a-b3ccbd4a04f2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:59.664952 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.segments_db [None req-14f05c05-da0a-4700-b77a-b3ccbd4a04f2 admin admin] Added segment 826ebba6-2eef-449f-97d0-d8ba20232e56 of type flat for network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d Dec 24 04:51:59.719033 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-14f05c05-da0a-4700-b77a-b3ccbd4a04f2 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750577486812'] for network, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:59.754662 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-14f05c05-da0a-4700-b77a-b3ccbd4a04f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for network, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:59.755578 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14f05c05-da0a-4700-b77a-b3ccbd4a04f2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:51:59.756144 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-14f05c05-da0a-4700-b77a-b3ccbd4a04f2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:51:59.787512 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-14f05c05-da0a-4700-b77a-b3ccbd4a04f2 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.3483105 Dec 24 04:51:59.816714 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14f05c05-da0a-4700-b77a-b3ccbd4a04f2 admin admin] Pushing event updated for resources: {'Network': ['ID=9b4e4b31-551f-45a9-b26a-cb44ee20a17d,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:51:59.829252 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d details requested by agent ovs-agent-dv-cinder-816443-2-iscsi with host dv-cinder-816443-2-iscsi {{(pid=102478) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 24 04:52:02.221989 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 49870) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:52:02.316239 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2924ad57-5483-4857-aa1d-d2faa84f9891 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:52:02.317621 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-2924ad57-5483-4857-aa1d-d2faa84f9891 admin admin] 10.222.0.43 "GET /v2.0/subnets/03cfca50-3175-40b4-ba43-f0875647d4ab HTTP/1.1" status: 200 len: 849 time: 0.0946920 Dec 24 04:52:02.473195 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-d9b97b58-7d46-4331-aef6-e0ae1a2fafe9 admin admin] 10.222.0.43 "GET /v2.0/routers/fc2d1ce4-e326-4181-9a78-d9a384f93bbc HTTP/1.1" status: 200 len: 704 time: 0.1490703 Dec 24 04:52:02.744091 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4dedc5e3-84fa-47cf-9a70-a05db2062902 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:03.055334 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [None req-4dedc5e3-84fa-47cf-9a70-a05db2062902 admin admin] Allocated IP 172.20.0.1 (51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8/03cfca50-3175-40b4-ba43-f0875647d4ab/cb3dbb13-9998-41c9-b98c-5a89f38a2e57) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 04:52:03.217482 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4dedc5e3-84fa-47cf-9a70-a05db2062902 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:03.335023 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4dedc5e3-84fa-47cf-9a70-a05db2062902 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:03.400935 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 5 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 04:52:03.418590 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4dedc5e3-84fa-47cf-9a70-a05db2062902 admin admin] Network 51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8 is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 04:52:03.423290 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-4dedc5e3-84fa-47cf-9a70-a05db2062902 admin admin] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:52:03.431700 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4dedc5e3-84fa-47cf-9a70-a05db2062902 admin admin] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 04:52:03.432409 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4dedc5e3-84fa-47cf-9a70-a05db2062902 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-545913'] for router_interface, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:03.453450 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dedc5e3-84fa-47cf-9a70-a05db2062902 admin admin] Pushing event updated for resources: {'Port': ['ID=cb3dbb13-9998-41c9-b98c-5a89f38a2e57,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:52:03.626623 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a7c7f3-e259-4a94-93f8-f22c5fb65f80 None None] Provisioning complete for port cb3dbb13-9998-41c9-b98c-5a89f38a2e57 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:52:03.627244 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a7c7f3-e259-4a94-93f8-f22c5fb65f80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:03.630887 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4dedc5e3-84fa-47cf-9a70-a05db2062902 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:03.666716 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-b8a7c7f3-e259-4a94-93f8-f22c5fb65f80 None None] Port cb3dbb13-9998-41c9-b98c-5a89f38a2e57 cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 04:52:03.849244 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4dedc5e3-84fa-47cf-9a70-a05db2062902 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:03.855962 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4dedc5e3-84fa-47cf-9a70-a05db2062902 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:03.856706 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4dedc5e3-84fa-47cf-9a70-a05db2062902 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-627486', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-548585'] for router_interface, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:03.912259 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dedc5e3-84fa-47cf-9a70-a05db2062902 admin admin] Pushing event updated for resources: {'Port': ['ID=cb3dbb13-9998-41c9-b98c-5a89f38a2e57,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:52:03.981561 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4dedc5e3-84fa-47cf-9a70-a05db2062902 admin admin] Network 51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8 is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 04:52:03.983904 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-4dedc5e3-84fa-47cf-9a70-a05db2062902 admin admin] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:52:04.146505 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4dedc5e3-84fa-47cf-9a70-a05db2062902 admin admin] Router fc2d1ce4-e326-4181-9a78-d9a384f93bbc is scheduled to L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 with binding_index 1 {{(pid=102476) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 24 04:52:04.189536 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-08798749-94e2-4491-87c2-4d6d17583cc5 None None] Provisioning complete for port cb3dbb13-9998-41c9-b98c-5a89f38a2e57 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:52:04.189823 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-08798749-94e2-4491-87c2-4d6d17583cc5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:04.226221 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-08798749-94e2-4491-87c2-4d6d17583cc5 None None] Port cb3dbb13-9998-41c9-b98c-5a89f38a2e57 cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 04:52:04.237226 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4dedc5e3-84fa-47cf-9a70-a05db2062902 admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 04:52:04.242571 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-4dedc5e3-84fa-47cf-9a70-a05db2062902 admin admin] 10.222.0.43 "PUT /v2.0/routers/fc2d1ce4-e326-4181-9a78-d9a384f93bbc/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.7606955 Dec 24 04:52:04.246811 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] Sync routers for ids ['fc2d1ce4-e326-4181-9a78-d9a384f93bbc'] in dv-cinder-816443-2-iscsi {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 04:52:04.259681 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] Routers {'fc2d1ce4-e326-4181-9a78-d9a384f93bbc'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 04:52:04.260428 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T04:51:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['fc2d1ce4-e326-4181-9a78-d9a384f93bbc'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:52:04.446123 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] Set router fc2d1ce4-e326-4181-9a78-d9a384f93bbc gateway port host: None {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 04:52:04.876436 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fc2d1ce4-e326-4181-9a78-d9a384f93bbc', 'name': 'router1', 'tenant_id': '036a37ec848b4c9bb369e71b5c2453c7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:51:53Z', 'updated_at': '2021-12-24T04:52:03Z', 'revision_number': 2, 'project_id': '036a37ec848b4c9bb369e71b5c2453c7', 'gw_port_host': None, '_interfaces': [{'id': 'cb3dbb13-9998-41c9-b98c-5a89f38a2e57', 'name': '', 'network_id': '51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8', 'tenant_id': '036a37ec848b4c9bb369e71b5c2453c7', 'mac_address': 'fa:16:3e:0e:64:bf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fc2d1ce4-e326-4181-9a78-d9a384f93bbc', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '03cfca50-3175-40b4-ba43-f0875647d4ab', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:52:02Z', 'updated_at': '2021-12-24T04:52:03Z', 'revision_number': 2, 'project_id': '036a37ec848b4c9bb369e71b5c2453c7', 'subnets': [{'id': '03cfca50-3175-40b4-ba43-f0875647d4ab', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '474562d4-9ec7-42c5-9ba4-c439229b5b91'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:52:04.928015 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] Checking router: fc2d1ce4-e326-4181-9a78-d9a384f93bbc for host: dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 04:52:04.928378 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] Updating router fc2d1ce4-e326-4181-9a78-d9a384f93bbc port cb3dbb13-9998-41c9-b98c-5a89f38a2e57 binding host dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 24 04:52:04.977786 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:05.489185 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] Publish callbacks [] for port, precommit_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:05.497147 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:05.663933 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] Attempting to bind port cb3dbb13-9998-41c9-b98c-5a89f38a2e57 on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 04:52:05.664328 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] Attempting to bind port cb3dbb13-9998-41c9-b98c-5a89f38a2e57 by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': 'e00e29d1-c240-4daa-b51a-387411404502', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8'}] {{(pid=102479) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 04:52:05.664788 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] Attempting to bind port cb3dbb13-9998-41c9-b98c-5a89f38a2e57 on network 51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8 {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 04:52:05.673718 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 4, 51, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 04:52:05.674135 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] Checking segment: {'id': 'e00e29d1-c240-4daa-b51a-387411404502', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102479) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:52:05.674650 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:05.674980 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] Bound using segment: {'id': 'e00e29d1-c240-4daa-b51a-387411404502', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8'} {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 04:52:05.675441 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] Bound port: cb3dbb13-9998-41c9-b98c-5a89f38a2e57, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e00e29d1-c240-4daa-b51a-387411404502', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8'}}] {{(pid=102479) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 04:52:05.675845 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:05.679161 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2191247e-0b8c-4694-829d-92e2332a84df None None] Pushing event updated for resources: {'Port': ['ID=cb3dbb13-9998-41c9-b98c-5a89f38a2e57,revision_number=3']} {{(pid=102479) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:52:05.693168 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2191247e-0b8c-4694-829d-92e2332a84df None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:52:05.693525 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2191247e-0b8c-4694-829d-92e2332a84df None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:52:05.693869 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2191247e-0b8c-4694-829d-92e2332a84df None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:52:05.697872 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2191247e-0b8c-4694-829d-92e2332a84df None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:52:05.698221 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2191247e-0b8c-4694-829d-92e2332a84df None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:52:05.698554 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2191247e-0b8c-4694-829d-92e2332a84df None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:52:05.698881 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2191247e-0b8c-4694-829d-92e2332a84df None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:52:05.699204 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2191247e-0b8c-4694-829d-92e2332a84df None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:52:05.699523 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2191247e-0b8c-4694-829d-92e2332a84df None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:52:05.699841 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2191247e-0b8c-4694-829d-92e2332a84df None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:52:05.700156 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2191247e-0b8c-4694-829d-92e2332a84df None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:52:05.700473 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2191247e-0b8c-4694-829d-92e2332a84df None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:52:05.700807 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2191247e-0b8c-4694-829d-92e2332a84df None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2191247e-0b8c-4694-829d-92e2332a84df None None] Tracked resource versions report: Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: pushed versions: Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: { 'AddressGroup': {'1.2'}, Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: 'ConntrackHelper': {'1.0'}, Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: 'LocalIPAssociation': {'1.0'}, Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: 'Log': {'1.0'}, Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: 'Network': {'1.1'}, Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: 'Port': {'1.7'}, Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: 'PortForwarding': {'1.2'}, Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: 'QosPolicy': {'1.10'}, Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: 'SecurityGroup': {'1.5'}, Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: 'SecurityGroupRule': {'1.2'}, Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: 'SubPort': {'1.0'}, Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: 'Subnet': {'1.1'}, Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: 'Trunk': {'1.1'}} Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: consumer versions: Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: { DHCP agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: L3 agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: Metadata agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: Metering agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: Open vSwitch agent@dv-cinder-816443-2-iscsi: { 'AddressGroup': '1.2', Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: 'ConntrackHelper': '1.0', Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: 'LocalIPAssociation': '1.0', Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: 'Log': '1.0', Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: 'Network': '1.1', Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: 'Port': '1.7', Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: 'PortForwarding': '1.2', Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: 'QosPolicy': '1.10', Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: 'SecurityGroup': '1.5', Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: 'SecurityGroupRule': '1.2', Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: 'SubPort': '1.0', Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: 'Subnet': '1.1', Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: 'Trunk': '1.1'}} Dec 24 04:52:05.702139 dv-cinder-816443-2-iscsi neutron-server[102479]: {{(pid=102479) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 24 04:52:05.758249 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-d4f1af06-4385-4e07-8add-f290227a2e19 None None] Provisioning complete for port cb3dbb13-9998-41c9-b98c-5a89f38a2e57 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:52:05.759285 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-d4f1af06-4385-4e07-8add-f290227a2e19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:05.767772 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.db [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] For port cb3dbb13-9998-41c9-b98c-5a89f38a2e57, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102479) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 04:52:05.788512 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.db [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] For port cb3dbb13-9998-41c9-b98c-5a89f38a2e57, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=cb3dbb13-9998-41c9-b98c-5a89f38a2e57,segment=NetworkSegment(e00e29d1-c240-4daa-b51a-387411404502),segment_id=e00e29d1-c240-4daa-b51a-387411404502)] {{(pid=102479) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 04:52:05.796748 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:05.797903 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-d4f1af06-4385-4e07-8add-f290227a2e19 None None] Port cb3dbb13-9998-41c9-b98c-5a89f38a2e57 cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 04:52:05.853142 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] Routers {'fc2d1ce4-e326-4181-9a78-d9a384f93bbc'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 04:52:05.853770 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T04:51:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['fc2d1ce4-e326-4181-9a78-d9a384f93bbc'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:52:05.889346 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2191247e-0b8c-4694-829d-92e2332a84df None None] Pushing event updated for resources: {'Port': ['ID=cb3dbb13-9998-41c9-b98c-5a89f38a2e57,revision_number=4']} {{(pid=102479) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:52:05.943570 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] Set router fc2d1ce4-e326-4181-9a78-d9a384f93bbc gateway port host: None {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 04:52:06.019625 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-13b0bd20-3264-4971-b85c-f108daaf1b7b None None] Provisioning complete for port cb3dbb13-9998-41c9-b98c-5a89f38a2e57 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:52:06.019999 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-13b0bd20-3264-4971-b85c-f108daaf1b7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:06.107621 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-13b0bd20-3264-4971-b85c-f108daaf1b7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:06.138866 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-13b0bd20-3264-4971-b85c-f108daaf1b7b None None] For port cb3dbb13-9998-41c9-b98c-5a89f38a2e57, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=cb3dbb13-9998-41c9-b98c-5a89f38a2e57,segment=NetworkSegment(e00e29d1-c240-4daa-b51a-387411404502),segment_id=e00e29d1-c240-4daa-b51a-387411404502)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 04:52:06.144429 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-13b0bd20-3264-4971-b85c-f108daaf1b7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:06.163279 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fc2d1ce4-e326-4181-9a78-d9a384f93bbc', 'name': 'router1', 'tenant_id': '036a37ec848b4c9bb369e71b5c2453c7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:51:53Z', 'updated_at': '2021-12-24T04:52:03Z', 'revision_number': 2, 'project_id': '036a37ec848b4c9bb369e71b5c2453c7', 'gw_port_host': None, '_interfaces': [{'id': 'cb3dbb13-9998-41c9-b98c-5a89f38a2e57', 'name': '', 'network_id': '51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8', 'tenant_id': '036a37ec848b4c9bb369e71b5c2453c7', 'mac_address': 'fa:16:3e:0e:64:bf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fc2d1ce4-e326-4181-9a78-d9a384f93bbc', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '03cfca50-3175-40b4-ba43-f0875647d4ab', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:52:02Z', 'updated_at': '2021-12-24T04:52:05Z', 'revision_number': 4, 'project_id': '036a37ec848b4c9bb369e71b5c2453c7', 'subnets': [{'id': '03cfca50-3175-40b4-ba43-f0875647d4ab', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '474562d4-9ec7-42c5-9ba4-c439229b5b91'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:52:06.192647 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1a173cc-8839-4544-8009-dd97f7116911 None None] The sync data for ids ['fc2d1ce4-e326-4181-9a78-d9a384f93bbc'] in dv-cinder-816443-2-iscsi is: [{'id': 'fc2d1ce4-e326-4181-9a78-d9a384f93bbc', 'name': 'router1', 'tenant_id': '036a37ec848b4c9bb369e71b5c2453c7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:51:53Z', 'updated_at': '2021-12-24T04:52:03Z', 'revision_number': 2, 'project_id': '036a37ec848b4c9bb369e71b5c2453c7', 'gw_port_host': None, '_interfaces': [{'id': 'cb3dbb13-9998-41c9-b98c-5a89f38a2e57', 'name': '', 'network_id': '51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8', 'tenant_id': '036a37ec848b4c9bb369e71b5c2453c7', 'mac_address': 'fa:16:3e:0e:64:bf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fc2d1ce4-e326-4181-9a78-d9a384f93bbc', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '03cfca50-3175-40b4-ba43-f0875647d4ab', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:52:02Z', 'updated_at': '2021-12-24T04:52:05Z', 'revision_number': 4, 'project_id': '036a37ec848b4c9bb369e71b5c2453c7', 'subnets': [{'id': '03cfca50-3175-40b4-ba43-f0875647d4ab', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '474562d4-9ec7-42c5-9ba4-c439229b5b91'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 04:52:06.194170 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13b0bd20-3264-4971-b85c-f108daaf1b7b None None] Pushing event updated for resources: {'Port': ['ID=cb3dbb13-9998-41c9-b98c-5a89f38a2e57,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:52:09.151334 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 49888) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:52:09.265372 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-868efde7-d938-4cea-8f68-41cdb14bb099 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:52:09.272828 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-868efde7-d938-4cea-8f68-41cdb14bb099 admin admin] 10.222.0.43 "GET /v2.0/networks/9b4e4b31-551f-45a9-b26a-cb44ee20a17d HTTP/1.1" status: 200 len: 842 time: 0.1143897 Dec 24 04:52:09.277371 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-a0691a77-a9b5-406b-9559-dd39f2a60d4c admin admin] Request body: {'subnet': {'name': 'public-subnet', 'enable_dhcp': False, 'gateway_ip': '172.27.1.1', 'ip_version': 4, 'cidr': '172.27.1.0/24', 'tenant_id': '49af853a7d674e84987f8788493d4239', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:52:09.308870 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a0691a77-a9b5-406b-9559-dd39f2a60d4c admin admin] Made reservation on behalf of 49af853a7d674e84987f8788493d4239 for: {'subnet': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:52:09.309677 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a0691a77-a9b5-406b-9559-dd39f2a60d4c admin admin] Publish callbacks [] for subnet, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:09.594232 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.objects.ports [None req-a0691a77-a9b5-406b-9559-dd39f2a60d4c admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=102476) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 24 04:52:09.594555 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a0691a77-a9b5-406b-9559-dd39f2a60d4c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for subnet, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:09.720154 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0691a77-a9b5-406b-9559-dd39f2a60d4c admin admin] Pushing event updated for resources: {'Subnet': ['ID=f277b899-8779-420e-8a8d-bfcd5eb7f012,revision_number=0']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:52:09.729732 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0691a77-a9b5-406b-9559-dd39f2a60d4c admin admin] Checking segment: {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:52:09.730093 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a0691a77-a9b5-406b-9559-dd39f2a60d4c admin admin] Network hostable DHCP agents. Network: 9b4e4b31-551f-45a9-b26a-cb44ee20a17d, hostable agents: ['01bc2530-0600-4d1b-b486-2fd9d63a2d51'], hosted agents: [] {{(pid=102476) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 24 04:52:09.747122 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a0691a77-a9b5-406b-9559-dd39f2a60d4c admin admin] Network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d is scheduled to be hosted by DHCP agent 01bc2530-0600-4d1b-b486-2fd9d63a2d51 with binding_index 1 {{(pid=102476) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 24 04:52:09.755714 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-a0691a77-a9b5-406b-9559-dd39f2a60d4c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816443-2-iscsi, 9b4e4b31-551f-45a9-b26a-cb44ee20a17d) {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:52:09.760213 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0691a77-a9b5-406b-9559-dd39f2a60d4c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:52:09.761062 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a0691a77-a9b5-406b-9559-dd39f2a60d4c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:09.769499 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-911b3fe0-cf31-48f7-8d16-7d53310c8adf None None] Network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 04:52:09.781815 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-a0691a77-a9b5-406b-9559-dd39f2a60d4c admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.5080581 Dec 24 04:52:09.898314 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e080397-9aca-40a2-9298-ce54ca89d076 None None] Network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 04:52:12.295410 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 49900) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:52:12.355940 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device cb3dbb13-9998-41c9-b98c-5a89f38a2e57 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 04:52:12.408997 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port cb3dbb13-9998-41c9-b98c-5a89f38a2e57 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:52:12.409379 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:12.450331 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-eed9e950-56f9-4bd8-b04f-e86a76809f2d admin admin] 10.222.0.43 "GET /v2.0/routers/fc2d1ce4-e326-4181-9a78-d9a384f93bbc HTTP/1.1" status: 200 len: 710 time: 0.1537826 Dec 24 04:52:12.540717 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e4fac8e-0786-4ab8-a626-b4275647c035 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:52:12.542116 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-8e4fac8e-0786-4ab8-a626-b4275647c035 admin admin] 10.222.0.43 "GET /v2.0/networks/9b4e4b31-551f-45a9-b26a-cb44ee20a17d HTTP/1.1" status: 200 len: 886 time: 0.0858357 Dec 24 04:52:12.551769 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-d76e0f38-d062-47d5-a9bf-a5395d6dfa59 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:52:12.792650 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d76e0f38-d062-47d5-a9bf-a5395d6dfa59 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:13.028696 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d76e0f38-d062-47d5-a9bf-a5395d6dfa59 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:13.106512 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d76e0f38-d062-47d5-a9bf-a5395d6dfa59 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:13.215779 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [None req-d76e0f38-d062-47d5-a9bf-a5395d6dfa59 admin admin] Allocated IP 172.27.1.220 (9b4e4b31-551f-45a9-b26a-cb44ee20a17d/f277b899-8779-420e-8a8d-bfcd5eb7f012/e64e245e-b691-4205-89b8-11e616ebc33b) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 04:52:13.319490 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d76e0f38-d062-47d5-a9bf-a5395d6dfa59 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:13.358038 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d76e0f38-d062-47d5-a9bf-a5395d6dfa59 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:13.395397 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d76e0f38-d062-47d5-a9bf-a5395d6dfa59 admin admin] Network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 04:52:13.400083 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-d76e0f38-d062-47d5-a9bf-a5395d6dfa59 admin admin] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:52:13.404134 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d76e0f38-d062-47d5-a9bf-a5395d6dfa59 admin admin] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 04:52:13.406228 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d76e0f38-d062-47d5-a9bf-a5395d6dfa59 admin admin] Pushing event updated for resources: {'Port': ['ID=e64e245e-b691-4205-89b8-11e616ebc33b,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:52:13.652696 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d76e0f38-d062-47d5-a9bf-a5395d6dfa59 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:13.939710 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d76e0f38-d062-47d5-a9bf-a5395d6dfa59 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-545923', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-546060', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2070289'] for router, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:13.942975 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d76e0f38-d062-47d5-a9bf-a5395d6dfa59 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-545958', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-545944', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-545937', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-546053'] for router, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:14.048705 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d76e0f38-d062-47d5-a9bf-a5395d6dfa59 admin admin] Router fc2d1ce4-e326-4181-9a78-d9a384f93bbc has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102476) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 04:52:14.157545 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d76e0f38-d062-47d5-a9bf-a5395d6dfa59 admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 04:52:14.162280 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d76e0f38-d062-47d5-a9bf-a5395d6dfa59 admin admin] Publish callbacks [] for router, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:14.165796 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-d76e0f38-d062-47d5-a9bf-a5395d6dfa59 admin admin] 10.222.0.43 "PUT /v2.0/routers/fc2d1ce4-e326-4181-9a78-d9a384f93bbc HTTP/1.1" status: 200 len: 890 time: 1.6149595 Dec 24 04:52:14.180870 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] Sync routers for ids ['fc2d1ce4-e326-4181-9a78-d9a384f93bbc'] in dv-cinder-816443-2-iscsi {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 04:52:14.193047 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] Routers {'fc2d1ce4-e326-4181-9a78-d9a384f93bbc'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 04:52:14.193614 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T04:51:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['fc2d1ce4-e326-4181-9a78-d9a384f93bbc'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:52:14.413942 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] Set router fc2d1ce4-e326-4181-9a78-d9a384f93bbc gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 04:52:14.877492 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fc2d1ce4-e326-4181-9a78-d9a384f93bbc', 'name': 'router1', 'tenant_id': '036a37ec848b4c9bb369e71b5c2453c7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.220'}], 'enable_snat': True}, 'gw_port_id': 'e64e245e-b691-4205-89b8-11e616ebc33b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:51:53Z', 'updated_at': '2021-12-24T04:52:13Z', 'revision_number': 4, 'project_id': '036a37ec848b4c9bb369e71b5c2453c7', 'gw_port': {'id': 'e64e245e-b691-4205-89b8-11e616ebc33b', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:b4:07', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fc2d1ce4-e326-4181-9a78-d9a384f93bbc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:52:13Z', 'updated_at': '2021-12-24T04:52:13Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': 'cb3dbb13-9998-41c9-b98c-5a89f38a2e57', 'name': '', 'network_id': '51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8', 'tenant_id': '036a37ec848b4c9bb369e71b5c2453c7', 'mac_address': 'fa:16:3e:0e:64:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fc2d1ce4-e326-4181-9a78-d9a384f93bbc', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '03cfca50-3175-40b4-ba43-f0875647d4ab', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:52:02Z', 'updated_at': '2021-12-24T04:52:06Z', 'revision_number': 5, 'project_id': '036a37ec848b4c9bb369e71b5c2453c7', 'subnets': [{'id': '03cfca50-3175-40b4-ba43-f0875647d4ab', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '474562d4-9ec7-42c5-9ba4-c439229b5b91'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:52:14.927319 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] Checking router: fc2d1ce4-e326-4181-9a78-d9a384f93bbc for host: dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 04:52:14.927706 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] Updating router fc2d1ce4-e326-4181-9a78-d9a384f93bbc port e64e245e-b691-4205-89b8-11e616ebc33b binding host dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 24 04:52:14.972662 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:15.278125 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] Publish callbacks [] for port, precommit_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:15.285224 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:15.335068 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5b1543d-28cf-4ce5-b074-cc27ad6893b2 None None] Pushing event updated for resources: {'Port': ['ID=e64e245e-b691-4205-89b8-11e616ebc33b,revision_number=2']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:52:15.337397 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] Attempting to bind port e64e245e-b691-4205-89b8-11e616ebc33b on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 04:52:15.337771 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] Attempting to bind port e64e245e-b691-4205-89b8-11e616ebc33b by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 04:52:15.338147 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] Attempting to bind port e64e245e-b691-4205-89b8-11e616ebc33b on network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 04:52:15.343575 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 4, 51, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 04:52:15.343953 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] Checking segment: {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102478) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:52:15.344355 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:15.344770 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] Bound using segment: {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 04:52:15.345241 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] Bound port: e64e245e-b691-4205-89b8-11e616ebc33b, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 04:52:15.345631 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:15.400324 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] For port e64e245e-b691-4205-89b8-11e616ebc33b, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102478) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 04:52:15.403625 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] For port e64e245e-b691-4205-89b8-11e616ebc33b, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=e64e245e-b691-4205-89b8-11e616ebc33b,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102478) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 04:52:15.409819 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:15.468367 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] Routers {'fc2d1ce4-e326-4181-9a78-d9a384f93bbc'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 04:52:15.469009 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T04:51:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['fc2d1ce4-e326-4181-9a78-d9a384f93bbc'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:52:15.471951 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5b1543d-28cf-4ce5-b074-cc27ad6893b2 None None] Pushing event updated for resources: {'Port': ['ID=e64e245e-b691-4205-89b8-11e616ebc33b,revision_number=3']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:52:15.578895 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] Set router fc2d1ce4-e326-4181-9a78-d9a384f93bbc gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 04:52:15.789325 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fc2d1ce4-e326-4181-9a78-d9a384f93bbc', 'name': 'router1', 'tenant_id': '036a37ec848b4c9bb369e71b5c2453c7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.220'}], 'enable_snat': True}, 'gw_port_id': 'e64e245e-b691-4205-89b8-11e616ebc33b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:51:53Z', 'updated_at': '2021-12-24T04:52:13Z', 'revision_number': 4, 'project_id': '036a37ec848b4c9bb369e71b5c2453c7', 'gw_port': {'id': 'e64e245e-b691-4205-89b8-11e616ebc33b', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:b4:07', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fc2d1ce4-e326-4181-9a78-d9a384f93bbc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:52:13Z', 'updated_at': '2021-12-24T04:52:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': 'cb3dbb13-9998-41c9-b98c-5a89f38a2e57', 'name': '', 'network_id': '51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8', 'tenant_id': '036a37ec848b4c9bb369e71b5c2453c7', 'mac_address': 'fa:16:3e:0e:64:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fc2d1ce4-e326-4181-9a78-d9a384f93bbc', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '03cfca50-3175-40b4-ba43-f0875647d4ab', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:52:02Z', 'updated_at': '2021-12-24T04:52:06Z', 'revision_number': 5, 'project_id': '036a37ec848b4c9bb369e71b5c2453c7', 'subnets': [{'id': '03cfca50-3175-40b4-ba43-f0875647d4ab', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '474562d4-9ec7-42c5-9ba4-c439229b5b91'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:52:15.814308 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b565772-fdf5-46bc-a942-9fc814016282 None None] The sync data for ids ['fc2d1ce4-e326-4181-9a78-d9a384f93bbc'] in dv-cinder-816443-2-iscsi is: [{'id': 'fc2d1ce4-e326-4181-9a78-d9a384f93bbc', 'name': 'router1', 'tenant_id': '036a37ec848b4c9bb369e71b5c2453c7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.220'}], 'enable_snat': True}, 'gw_port_id': 'e64e245e-b691-4205-89b8-11e616ebc33b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:51:53Z', 'updated_at': '2021-12-24T04:52:13Z', 'revision_number': 4, 'project_id': '036a37ec848b4c9bb369e71b5c2453c7', 'gw_port': {'id': 'e64e245e-b691-4205-89b8-11e616ebc33b', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:b4:07', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fc2d1ce4-e326-4181-9a78-d9a384f93bbc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:52:13Z', 'updated_at': '2021-12-24T04:52:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': 'cb3dbb13-9998-41c9-b98c-5a89f38a2e57', 'name': '', 'network_id': '51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8', 'tenant_id': '036a37ec848b4c9bb369e71b5c2453c7', 'mac_address': 'fa:16:3e:0e:64:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fc2d1ce4-e326-4181-9a78-d9a384f93bbc', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '03cfca50-3175-40b4-ba43-f0875647d4ab', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:52:02Z', 'updated_at': '2021-12-24T04:52:06Z', 'revision_number': 5, 'project_id': '036a37ec848b4c9bb369e71b5c2453c7', 'subnets': [{'id': '03cfca50-3175-40b4-ba43-f0875647d4ab', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '474562d4-9ec7-42c5-9ba4-c439229b5b91'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 04:52:16.371967 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device e64e245e-b691-4205-89b8-11e616ebc33b up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 04:52:16.427184 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port e64e245e-b691-4205-89b8-11e616ebc33b triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:52:16.427799 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:16.509752 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:16.531181 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] For port e64e245e-b691-4205-89b8-11e616ebc33b, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=e64e245e-b691-4205-89b8-11e616ebc33b,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 04:52:16.538777 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:16.586081 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Pushing event updated for resources: {'Port': ['ID=e64e245e-b691-4205-89b8-11e616ebc33b,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:52:16.807674 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 49908) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:52:16.934682 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-a89971de-b99a-46f5-886e-d660cda59978 admin admin] 10.222.0.43 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 413 time: 0.1258521 Dec 24 04:52:18.336676 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device e64e245e-b691-4205-89b8-11e616ebc33b up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 04:52:18.388418 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port e64e245e-b691-4205-89b8-11e616ebc33b triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:52:18.388824 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:23.152704 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-37c988ef-dc97-4672-a026-4ecbee3af094 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:25.350312 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-d9190692-56ad-4a72-bfcd-db1b17db118e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:26.395695 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:27.805040 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:28.576498 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:40.402605 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 5 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 04:52:53.146656 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-f83ae788-747e-43f4-9090-3bec88c8c986 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:55.248680 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-fadf387c-8820-4ecc-852e-c6667742df7d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:56.387722 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:57.811697 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:52:58.586125 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:53:17.402229 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 5 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 04:53:23.152300 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-af4dc6bd-8af6-4cce-91da-c3415d2d6424 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:53:25.243193 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-28df9ad2-8929-48e5-a67a-24bfe2ca92e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:53:26.390064 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:53:27.813640 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:53:28.586492 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:53:37.994928 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 50392) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:53:38.088330 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.pecan_wsgi.hooks.translation [None req-3f30af4c-8b36-4088-8482-97e37eddee0d admin admin] GET failed (client error): The resource could not be found. Dec 24 04:53:38.090286 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-3f30af4c-8b36-4088-8482-97e37eddee0d admin admin] 10.222.0.43 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0940633 Dec 24 04:53:38.280180 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b7b91f66-0175-439f-821c-6df237552c60 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:53:38.281588 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-b7b91f66-0175-439f-821c-6df237552c60 admin admin] 10.222.0.43 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1864026 Dec 24 04:53:40.674271 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 50402) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:53:40.769079 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12ca6160-8455-4605-a280-c4bd8990f63c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:53:40.770456 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-12ca6160-8455-4605-a280-c4bd8990f63c admin admin] 10.222.0.43 "GET /v2.0/subnets/03cfca50-3175-40b4-ba43-f0875647d4ab HTTP/1.1" status: 200 len: 849 time: 0.0952029 Dec 24 04:53:40.780667 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-2f0524ab-7c2c-4008-8d32-d4d24a969a7e admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:53:40.863833 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2f0524ab-7c2c-4008-8d32-d4d24a969a7e admin admin] Publish callbacks [] for subnet, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:53:41.023677 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2f0524ab-7c2c-4008-8d32-d4d24a969a7e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8750578065192'] for subnet, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:53:41.051304 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f0524ab-7c2c-4008-8d32-d4d24a969a7e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:53:41.051947 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2f0524ab-7c2c-4008-8d32-d4d24a969a7e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:53:41.053273 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-2f0524ab-7c2c-4008-8d32-d4d24a969a7e admin admin] 10.222.0.43 "PUT /v2.0/subnets/03cfca50-3175-40b4-ba43-f0875647d4ab HTTP/1.1" status: 200 len: 868 time: 0.2762663 Dec 24 04:53:41.072360 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-077b5262-aa40-4707-9457-175989f18aa8 None None] Network 51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 04:53:41.076143 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f0524ab-7c2c-4008-8d32-d4d24a969a7e admin admin] Pushing event updated for resources: {'Subnet': ['ID=03cfca50-3175-40b4-ba43-f0875647d4ab,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:53:41.084040 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0524ab-7c2c-4008-8d32-d4d24a969a7e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:53:41.084775 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0524ab-7c2c-4008-8d32-d4d24a969a7e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:53:41.085103 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0524ab-7c2c-4008-8d32-d4d24a969a7e admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:53:41.085451 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0524ab-7c2c-4008-8d32-d4d24a969a7e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:53:41.085788 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0524ab-7c2c-4008-8d32-d4d24a969a7e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:53:41.086121 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0524ab-7c2c-4008-8d32-d4d24a969a7e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:53:41.086468 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0524ab-7c2c-4008-8d32-d4d24a969a7e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:53:41.086802 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0524ab-7c2c-4008-8d32-d4d24a969a7e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:53:41.087147 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0524ab-7c2c-4008-8d32-d4d24a969a7e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:53:41.087495 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0524ab-7c2c-4008-8d32-d4d24a969a7e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:53:41.087819 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0524ab-7c2c-4008-8d32-d4d24a969a7e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:53:41.088148 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0524ab-7c2c-4008-8d32-d4d24a969a7e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:53:41.088468 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2f0524ab-7c2c-4008-8d32-d4d24a969a7e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:53:41.428788 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-4dbf261e-aed3-4219-939d-5cbac57b3c16 None None] Provisioning complete for port 6c0eddd5-2f62-451c-8dd9-9bcc155b51aa triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:53:41.429125 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-4dbf261e-aed3-4219-939d-5cbac57b3c16 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:53:41.526390 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-4dbf261e-aed3-4219-939d-5cbac57b3c16 None None] Provisioning complete for port cb3dbb13-9998-41c9-b98c-5a89f38a2e57 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:53:41.526656 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-4dbf261e-aed3-4219-939d-5cbac57b3c16 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:53:43.470501 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 50410) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:53:43.677845 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-975523ca-2856-47d1-a523-759ca0953a65 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:53:43.678218 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-975523ca-2856-47d1-a523-759ca0953a65 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:53:43.679755 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-975523ca-2856-47d1-a523-759ca0953a65 admin admin] 10.222.0.43 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2082663 Dec 24 04:53:46.108285 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 50418) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:53:46.373930 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d94c87c-8371-49e0-a37e-7fb3f9c3d821 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:53:46.374428 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d94c87c-8371-49e0-a37e-7fb3f9c3d821 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:53:46.376111 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-0d94c87c-8371-49e0-a37e-7fb3f9c3d821 admin admin] 10.222.0.43 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2668374 Dec 24 04:53:48.751041 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 50428) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:53:48.908216 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c02a01c-4322-4cd7-9978-33e161d85758 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:53:48.909633 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-5c02a01c-4322-4cd7-9978-33e161d85758 admin admin] 10.222.0.43 "GET /v2.0/networks/51e03da0-f7a0-4d85-a74a-9afd9c8ab9d8 HTTP/1.1" status: 200 len: 869 time: 0.1575160 Dec 24 04:53:51.279740 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 50436) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:53:51.409493 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a02d3c6e-b8b2-4a3f-ba45-614e92b70e8f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:53:51.411593 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-a02d3c6e-b8b2-4a3f-ba45-614e92b70e8f admin admin] 10.222.0.43 "GET /v2.0/networks/9b4e4b31-551f-45a9-b26a-cb44ee20a17d HTTP/1.1" status: 200 len: 886 time: 0.1301489 Dec 24 04:53:53.156813 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-2156b565-c3d9-4ba1-b48f-7b5163b175c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:53:53.836569 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 50444) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:53:53.973491 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b731bed1-0849-45d2-a1b0-72a6ec19b720 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:53:53.974170 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b731bed1-0849-45d2-a1b0-72a6ec19b720 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:53:53.975687 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-b731bed1-0849-45d2-a1b0-72a6ec19b720 admin admin] 10.222.0.43 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1381721 Dec 24 04:53:54.401485 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 5 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 04:53:55.239737 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-ada597bf-9325-47ff-8e5d-c71b9392e374 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:53:56.367995 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 50452) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:53:56.395834 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:53:56.465595 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38cd7cbb-4a7d-40b0-ab3a-4057939e3b15 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:53:56.466053 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38cd7cbb-4a7d-40b0-ab3a-4057939e3b15 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:53:56.467581 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-38cd7cbb-4a7d-40b0-ab3a-4057939e3b15 admin admin] 10.222.0.43 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.0986369 Dec 24 04:53:57.818227 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:53:58.584489 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:53:58.870136 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 50460) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:53:59.008048 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0e67c123-7b45-4a60-b2aa-23ad55a0012f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:53:59.009524 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-0e67c123-7b45-4a60-b2aa-23ad55a0012f admin admin] 10.222.0.43 "GET /v2.0/subnets/03cfca50-3175-40b4-ba43-f0875647d4ab HTTP/1.1" status: 200 len: 868 time: 0.1384687 Dec 24 04:54:01.376908 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 50468) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:54:01.469594 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0d262d9-a1a6-416b-b78c-a8d70230a113 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:54:01.470938 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-c0d262d9-a1a6-416b-b78c-a8d70230a113 admin admin] 10.222.0.43 "GET /v2.0/subnets/f277b899-8779-420e-8a8d-bfcd5eb7f012 HTTP/1.1" status: 200 len: 816 time: 0.0930779 Dec 24 04:54:23.161345 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-5569ac1c-4ec1-4190-9954-fedbf46b80f7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:25.233836 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-11303f3e-c8b9-4467-9fce-802e1e2a8adb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:26.335866 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 50522) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:54:26.387246 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [None req-6605c321-0300-4b9e-8c0d-07304ef27b98 admin admin] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102477) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 24 04:54:26.388240 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-6605c321-0300-4b9e-8c0d-07304ef27b98 admin admin] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0514486 Dec 24 04:54:26.398634 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:27.821454 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:28.579609 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:28.888054 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 50530) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:54:28.962238 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.pecan_wsgi.hooks.translation [None req-b0b7ff13-76bf-4984-982d-78559ae8e0a9 admin admin] GET failed (client error): The resource could not be found. Dec 24 04:54:28.963576 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-b0b7ff13-76bf-4984-982d-78559ae8e0a9 admin admin] 10.222.0.43 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0745549 Dec 24 04:54:29.142201 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f017d370-f03c-4a68-90a3-b68cf02340d1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:54:29.143566 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-f017d370-f03c-4a68-90a3-b68cf02340d1 admin admin] 10.222.0.43 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1753612 Dec 24 04:54:31.400803 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 5 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 04:54:31.638167 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 50542) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:54:31.690521 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Request body: {'network': {'shared': True, 'name': 'shared', 'admin_state_up': True, 'project_id': '49af853a7d674e84987f8788493d4239', 'tenant_id': '49af853a7d674e84987f8788493d4239'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:54:31.718174 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Made reservation on behalf of 49af853a7d674e84987f8788493d4239 for: {'network': 1} {{(pid=102477) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:54:31.720956 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for network, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:31.763710 dv-cinder-816443-2-iscsi neutron-server[102477]: WARNING neutron.services.revisions.revision_plugin [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Could not find related network for resource to bump revision. Dec 24 04:54:31.780404 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] vlan segment allocate from pool success with {'vlan_id': 101, 'physical_network': 'physnet1'} {{(pid=102477) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 24 04:54:31.792963 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8750577966933', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:31.793509 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Unsubscribe: segment precommit_create {{(pid=102477) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Dec 24 04:54:31.793982 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.db.segments_db [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Added segment 12eac7f7-f84a-41ca-ba10-cc6036d850a8 of type vlan for network 5e42f823-2f9e-40d8-827b-66cbc7e240b7 Dec 24 04:54:31.850388 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750577486812'] for network, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:31.893794 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for network, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:31.895212 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:54:31.895816 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:31.928801 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.2894583 Dec 24 04:54:31.999768 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Pushing event updated for resources: {'Network': ['ID=5e42f823-2f9e-40d8-827b-66cbc7e240b7,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:54:32.009552 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:32.009930 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:32.010277 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:32.010608 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:32.010935 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:32.011256 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:32.011568 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:32.011918 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:32.012241 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:32.012610 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:32.012918 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:32.013238 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:32.013554 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6ee5e99f-f8e5-4727-9acd-48cf1cfbe185 admin admin] Tracked resource versions report: Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: pushed versions: Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: { 'AddressGroup': {'1.2'}, Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: 'ConntrackHelper': {'1.0'}, Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: 'LocalIPAssociation': {'1.0'}, Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: 'Log': {'1.0'}, Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: 'Network': {'1.1'}, Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: 'Port': {'1.7'}, Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: 'PortForwarding': {'1.2'}, Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: 'QosPolicy': {'1.10'}, Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: 'SecurityGroup': {'1.5'}, Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: 'SecurityGroupRule': {'1.2'}, Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: 'SubPort': {'1.0'}, Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: 'Subnet': {'1.1'}, Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: 'Trunk': {'1.1'}} Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: consumer versions: Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: { DHCP agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: L3 agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: Metadata agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: Metering agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: Open vSwitch agent@dv-cinder-816443-2-iscsi: { 'AddressGroup': '1.2', Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: 'ConntrackHelper': '1.0', Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: 'LocalIPAssociation': '1.0', Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: 'Log': '1.0', Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: 'Network': '1.1', Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: 'Port': '1.7', Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: 'PortForwarding': '1.2', Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: 'QosPolicy': '1.10', Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: 'SecurityGroup': '1.5', Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: 'SecurityGroupRule': '1.2', Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: 'SubPort': '1.0', Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: 'Subnet': '1.1', Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: 'Trunk': '1.1'}} Dec 24 04:54:32.014936 dv-cinder-816443-2-iscsi neutron-server[102477]: {{(pid=102477) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 24 04:54:32.045072 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Network 5e42f823-2f9e-40d8-827b-66cbc7e240b7 details requested by agent ovs-agent-dv-cinder-816443-2-iscsi with host dv-cinder-816443-2-iscsi {{(pid=102478) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 24 04:54:34.366106 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 50556) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:54:34.431633 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.pecan_wsgi.hooks.translation [None req-42415936-56dc-410e-81ca-d4057f419364 admin admin] GET failed (client error): The resource could not be found. Dec 24 04:54:34.432907 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-42415936-56dc-410e-81ca-d4057f419364 admin admin] 10.222.0.43 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0658453 Dec 24 04:54:34.500874 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d62633f8-f646-4616-a717-0d2f32b8a1fc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:54:34.502220 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-d62633f8-f646-4616-a717-0d2f32b8a1fc admin admin] 10.222.0.43 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0646920 Dec 24 04:54:34.512938 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-9ad6838f-37f0-4fc8-a810-90be11134b90 admin admin] Request body: {'subnet': {'cidr': '192.168.233.0/24', 'ip_version': 4, 'network_id': '5e42f823-2f9e-40d8-827b-66cbc7e240b7', 'tenant_id': '49af853a7d674e84987f8788493d4239', 'name': 'shared-subnet', 'description': 'shared-subnet'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:54:34.542248 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9ad6838f-37f0-4fc8-a810-90be11134b90 admin admin] Made reservation on behalf of 49af853a7d674e84987f8788493d4239 for: {'subnet': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:54:34.544499 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9ad6838f-37f0-4fc8-a810-90be11134b90 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:34.810385 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9ad6838f-37f0-4fc8-a810-90be11134b90 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for subnet, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:34.866685 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ad6838f-37f0-4fc8-a810-90be11134b90 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a9a1b303-53dd-4f5e-9ffd-833b6bddf909,revision_number=0']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:54:34.875357 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ad6838f-37f0-4fc8-a810-90be11134b90 admin admin] Checking segment: {'id': '12eac7f7-f84a-41ca-ba10-cc6036d850a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '5e42f823-2f9e-40d8-827b-66cbc7e240b7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:54:34.875704 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ad6838f-37f0-4fc8-a810-90be11134b90 admin admin] Network hostable DHCP agents. Network: 5e42f823-2f9e-40d8-827b-66cbc7e240b7, hostable agents: ['01bc2530-0600-4d1b-b486-2fd9d63a2d51'], hosted agents: [] {{(pid=102476) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 24 04:54:34.895666 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ad6838f-37f0-4fc8-a810-90be11134b90 admin admin] Network 5e42f823-2f9e-40d8-827b-66cbc7e240b7 is scheduled to be hosted by DHCP agent 01bc2530-0600-4d1b-b486-2fd9d63a2d51 with binding_index 1 {{(pid=102476) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 24 04:54:34.906542 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-9ad6838f-37f0-4fc8-a810-90be11134b90 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816443-2-iscsi, 5e42f823-2f9e-40d8-827b-66cbc7e240b7) {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:54:34.911104 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ad6838f-37f0-4fc8-a810-90be11134b90 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:54:34.911706 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9ad6838f-37f0-4fc8-a810-90be11134b90 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:34.915680 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2109be05-a824-443f-8385-46b737a74474 None None] Network 5e42f823-2f9e-40d8-827b-66cbc7e240b7 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 04:54:34.928689 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-9ad6838f-37f0-4fc8-a810-90be11134b90 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.4191139 Dec 24 04:54:35.017108 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpd2866d45-53d6-5577-9724-7d7a303c375f-5e42f823-2f9e-40d8-827b-66cbc7e240b7', 'network_id': '5e42f823-2f9e-40d8-827b-66cbc7e240b7', 'project_id': '49af853a7d674e84987f8788493d4239', 'fixed_ips': [{'subnet_id': 'a9a1b303-53dd-4f5e-9ffd-833b6bddf909'}]}} from dv-cinder-816443-2-iscsi. {{(pid=102478) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 24 04:54:35.018020 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:35.260144 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.db_base_plugin_common [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Allocated IP 192.168.233.2 (5e42f823-2f9e-40d8-827b-66cbc7e240b7/a9a1b303-53dd-4f5e-9ffd-833b6bddf909/da89805b-4509-4168-bc1d-0a5201d40153) {{(pid=102478) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 04:54:35.402928 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Publish callbacks [] for port, precommit_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:35.409944 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001'] for port, after_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:35.447105 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Network 5e42f823-2f9e-40d8-827b-66cbc7e240b7 is already hosted by enough agents. {{(pid=102478) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 04:54:35.449994 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.scheduler.base_scheduler [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Resources bound (agent type, host, resource id): {{(pid=102478) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:54:35.453796 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Received port after_create {{(pid=102478) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 04:54:35.463207 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Pushing event updated for resources: {'Port': ['ID=da89805b-4509-4168-bc1d-0a5201d40153,revision_number=1']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:54:35.489921 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:35.490279 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:35.490640 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:35.490970 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:35.491293 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:35.491619 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:35.491939 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:35.492258 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:35.492598 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:35.492931 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:35.493248 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:35.493556 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:35.493867 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:54:35.525049 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Attempting to bind port da89805b-4509-4168-bc1d-0a5201d40153 on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 04:54:35.525497 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Attempting to bind port da89805b-4509-4168-bc1d-0a5201d40153 by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': '12eac7f7-f84a-41ca-ba10-cc6036d850a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '5e42f823-2f9e-40d8-827b-66cbc7e240b7'}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 04:54:35.525868 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Attempting to bind port da89805b-4509-4168-bc1d-0a5201d40153 on network 5e42f823-2f9e-40d8-827b-66cbc7e240b7 {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 04:54:35.530958 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 4, 54, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 04:54:35.531324 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Checking segment: {'id': '12eac7f7-f84a-41ca-ba10-cc6036d850a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '5e42f823-2f9e-40d8-827b-66cbc7e240b7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102478) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:54:35.531722 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:35.532110 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Bound using segment: {'id': '12eac7f7-f84a-41ca-ba10-cc6036d850a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '5e42f823-2f9e-40d8-827b-66cbc7e240b7'} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 04:54:35.532614 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Bound port: da89805b-4509-4168-bc1d-0a5201d40153, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '12eac7f7-f84a-41ca-ba10-cc6036d850a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '5e42f823-2f9e-40d8-827b-66cbc7e240b7'}}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 04:54:35.533013 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:35.595487 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] For port da89805b-4509-4168-bc1d-0a5201d40153, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102478) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 04:54:35.598850 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] For port da89805b-4509-4168-bc1d-0a5201d40153, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=da89805b-4509-4168-bc1d-0a5201d40153,segment=NetworkSegment(12eac7f7-f84a-41ca-ba10-cc6036d850a8),segment_id=12eac7f7-f84a-41ca-ba10-cc6036d850a8)] {{(pid=102478) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 04:54:35.603902 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:35.665252 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a968b2d1-e4e7-4b47-9dd8-280b324ad525 None None] Pushing event updated for resources: {'Port': ['ID=da89805b-4509-4168-bc1d-0a5201d40153,revision_number=2']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:54:36.484126 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device da89805b-4509-4168-bc1d-0a5201d40153 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 04:54:36.532287 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e8220d1-a3dc-4f3e-800b-7ba5bec8c169 None None] Network 5e42f823-2f9e-40d8-827b-66cbc7e240b7 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 04:54:36.599555 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-20e2fd85-8a33-43eb-9701-0357ed25f4bf None None] Provisioning complete for port da89805b-4509-4168-bc1d-0a5201d40153 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:54:36.599855 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-20e2fd85-8a33-43eb-9701-0357ed25f4bf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:36.629015 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port da89805b-4509-4168-bc1d-0a5201d40153 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:54:36.629616 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:36.785283 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-20e2fd85-8a33-43eb-9701-0357ed25f4bf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:36.800411 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:36.840898 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-20e2fd85-8a33-43eb-9701-0357ed25f4bf None None] For port da89805b-4509-4168-bc1d-0a5201d40153, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=da89805b-4509-4168-bc1d-0a5201d40153,segment=NetworkSegment(12eac7f7-f84a-41ca-ba10-cc6036d850a8),segment_id=12eac7f7-f84a-41ca-ba10-cc6036d850a8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 04:54:36.847310 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-20e2fd85-8a33-43eb-9701-0357ed25f4bf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:36.930901 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.db.api [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102478) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 24 04:54:36.931279 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG oslo_db.api [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 24 04:54:36.934470 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20e2fd85-8a33-43eb-9701-0357ed25f4bf None None] Pushing event updated for resources: {'Port': ['ID=da89805b-4509-4168-bc1d-0a5201d40153,revision_number=3']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:54:37.068911 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-0c42eaa4-7cfb-4d17-a3e8-9d6daf306131 None None] Provisioning complete for port da89805b-4509-4168-bc1d-0a5201d40153 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:54:37.069281 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-0c42eaa4-7cfb-4d17-a3e8-9d6daf306131 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:38.445614 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device da89805b-4509-4168-bc1d-0a5201d40153 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 04:54:38.504270 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port da89805b-4509-4168-bc1d-0a5201d40153 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:54:38.504673 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:53.166806 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-de41bca0-1f39-4485-bd52-f837fb6498cd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:55.239263 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-002be763-cec7-40c9-a31f-258a08a3abbd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:56.400633 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:57.822726 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:54:58.589231 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:55:08.399279 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 5 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 04:55:23.170020 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-7d7e0ea8-22c3-4510-9bac-0135070040fb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:55:25.246642 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b4dd6b18-d737-4509-9c69-f6fc1e4a9f7c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:55:26.410294 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:55:27.826314 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:55:28.584248 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:55:45.399100 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 5 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 04:55:48.277094 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 50600) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:55:48.283142 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [None req-5998f951-3985-4e43-844a-53b135f10939 tempest-verify_tempest_config-710930507 tempest-verify_tempest_config-710930507-project] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102476) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 24 04:55:48.284095 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-5998f951-3985-4e43-844a-53b135f10939 tempest-verify_tempest_config-710930507 tempest-verify_tempest_config-710930507-project] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0060263 Dec 24 04:55:48.591623 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 50618) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:55:48.708332 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-5f26ba57-f88b-4959-8130-86c5bd55d038 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:55:48.792363 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-5f26ba57-f88b-4959-8130-86c5bd55d038 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:55:48.797479 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-5f26ba57-f88b-4959-8130-86c5bd55d038 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:55:48.842690 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-5f26ba57-f88b-4959-8130-86c5bd55d038 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=49be79bb597e49ef9ef9e84a0b33641a&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2500031 Dec 24 04:55:48.843629 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f26ba57-f88b-4959-8130-86c5bd55d038 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=868dd0a5-b6e9-48cb-8294-c74efb3e6b66,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:55:48.845605 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 50622) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:55:48.850936 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f26ba57-f88b-4959-8130-86c5bd55d038 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:48.851288 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f26ba57-f88b-4959-8130-86c5bd55d038 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:48.851636 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f26ba57-f88b-4959-8130-86c5bd55d038 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:48.851967 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f26ba57-f88b-4959-8130-86c5bd55d038 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:48.852297 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f26ba57-f88b-4959-8130-86c5bd55d038 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:48.852635 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f26ba57-f88b-4959-8130-86c5bd55d038 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:48.852964 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f26ba57-f88b-4959-8130-86c5bd55d038 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:48.853288 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f26ba57-f88b-4959-8130-86c5bd55d038 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:48.853601 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f26ba57-f88b-4959-8130-86c5bd55d038 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:48.853945 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f26ba57-f88b-4959-8130-86c5bd55d038 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:48.854257 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f26ba57-f88b-4959-8130-86c5bd55d038 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:48.854577 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f26ba57-f88b-4959-8130-86c5bd55d038 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:48.854893 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5f26ba57-f88b-4959-8130-86c5bd55d038 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:48.922807 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a5e24572-d7e2-4a04-989d-1695630bf8ed admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:55:48.945282 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a5e24572-d7e2-4a04-989d-1695630bf8ed admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:55:49.039199 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a5e24572-d7e2-4a04-989d-1695630bf8ed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:55:49.043329 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a5e24572-d7e2-4a04-989d-1695630bf8ed admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:55:49.045112 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-a5e24572-d7e2-4a04-989d-1695630bf8ed admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/868dd0a5-b6e9-48cb-8294-c74efb3e6b66 HTTP/1.1" status: 204 len: 168 time: 0.1984730 Dec 24 04:55:49.053564 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5e24572-d7e2-4a04-989d-1695630bf8ed admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=868dd0a5-b6e9-48cb-8294-c74efb3e6b66,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:55:49.060266 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5e24572-d7e2-4a04-989d-1695630bf8ed admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:49.060660 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5e24572-d7e2-4a04-989d-1695630bf8ed admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:49.061006 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5e24572-d7e2-4a04-989d-1695630bf8ed admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:49.061343 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5e24572-d7e2-4a04-989d-1695630bf8ed admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:49.061678 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5e24572-d7e2-4a04-989d-1695630bf8ed admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:49.062006 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5e24572-d7e2-4a04-989d-1695630bf8ed admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:49.062349 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5e24572-d7e2-4a04-989d-1695630bf8ed admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:49.062678 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5e24572-d7e2-4a04-989d-1695630bf8ed admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:49.063007 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5e24572-d7e2-4a04-989d-1695630bf8ed admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:49.063350 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5e24572-d7e2-4a04-989d-1695630bf8ed admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:49.063676 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5e24572-d7e2-4a04-989d-1695630bf8ed admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:49.064023 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5e24572-d7e2-4a04-989d-1695630bf8ed admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:49.064398 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5e24572-d7e2-4a04-989d-1695630bf8ed admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:55:53.174090 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-99243579-5137-4893-8477-54b9c7ace656 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:55:55.239546 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-0722906c-73e7-4dd0-bd78-6d744f2e7654 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:55:56.409486 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:55:57.826160 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:55:58.580646 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:56:22.402683 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 5 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 04:56:23.185555 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e762059b-c6bb-42e5-a761-ec18edd1fa8a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:56:25.254321 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-5fb3bf07-7148-4c68-b9c4-1d325d8b14c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:56:26.413518 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:56:27.834918 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:56:28.595902 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:56:53.190819 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-155ee8a9-e40e-42ec-8008-a60c10255342 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:56:55.257796 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-21b104ac-df02-40f1-884c-3a10975b6c4d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:56:56.425270 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:56:57.844198 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:56:58.591150 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:56:59.406890 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 5 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 04:57:19.385099 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-548406'] for agent, after_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:57:23.185357 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-7df131b2-8854-477d-90b2-3a4c59c4d00d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:57:25.256515 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-77d0db7d-0899-4f65-af68-962bf705358b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:57:26.419164 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:57:27.840863 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:57:28.587134 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:57:34.233151 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 50698) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:57:34.348520 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-38e1ec44-8996-4eab-bec7-70f689320089 admin admin] 10.222.0.43 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.1142654 Dec 24 04:57:36.406413 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 04:57:36.755988 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 50708) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:57:36.837015 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-80ad3e0a-0776-4c61-83c6-e353c2e0be50 admin admin] 10.222.0.43 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.0794199 Dec 24 04:57:49.366629 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:57:53.202693 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-09fb3aaa-005e-4a7d-a770-7f80142da4d0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:57:55.253804 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-85e3d062-b480-49d4-b518-18ba85a6aa4f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:57:56.425741 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:57:57.850307 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:57:58.595098 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:58:13.410485 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 04:58:19.364662 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:58:23.187544 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-51fbd40a-a73f-4f81-9d8b-8509f5e705cc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:58:25.246556 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-7a45878c-7960-465c-9f0b-306c1f9df4f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:58:26.432186 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:58:27.854877 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:58:28.580394 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:58:49.366540 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:58:50.410891 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 04:58:53.181965 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-75431d60-e0b0-46d7-9c3d-f99c37a71199 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:58:55.250964 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-0ddf548e-5725-4cf1-bbc8-075e4387a2cb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:58:56.427906 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:58:57.851240 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:58:58.575606 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:05.932032 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 50866) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:06.185811 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-634320677-network', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:06.214863 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Made reservation on behalf of 6c9c47f70b8d4da5827a8ef4349559ab for: {'network': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:59:06.214863 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for network, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:06.223472 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:06.300864 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:06.315765 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:06.327025 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] vlan segment allocate from pool success with {'vlan_id': 149, 'physical_network': 'physnet1'} {{(pid=102476) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 24 04:59:06.362077 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:06.362428 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.segments_db [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Added segment db374990-dadf-47a9-9824-44188ba20dd8 of type vlan for network c908572e-3b6b-470c-8b88-35b51f1472c6 Dec 24 04:59:06.364013 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=71f3a879-ea97-4cf6-9076-0540192042b1,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:06.379008 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:06.379301 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:06.379640 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:06.379966 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:06.380294 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:06.380642 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:06.380998 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:06.381332 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:06.381650 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:06.381983 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:06.382306 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:06.382620 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:06.382932 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Tracked resource versions report: Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: pushed versions: Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: { 'AddressGroup': {'1.2'}, Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: 'ConntrackHelper': {'1.0'}, Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: 'LocalIPAssociation': {'1.0'}, Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: 'Log': {'1.0'}, Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: 'Network': {'1.1'}, Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: 'Port': {'1.7'}, Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: 'PortForwarding': {'1.2'}, Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: 'QosPolicy': {'1.10'}, Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: 'SecurityGroup': {'1.5'}, Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: 'SecurityGroupRule': {'1.2'}, Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: 'SubPort': {'1.0'}, Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: 'Subnet': {'1.1'}, Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: 'Trunk': {'1.1'}} Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: consumer versions: Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: { DHCP agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: HyperV agent@hv-cinder-81644: {}, Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: L3 agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: Metadata agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: Metering agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: Open vSwitch agent@dv-cinder-816443-2-iscsi: { 'AddressGroup': '1.2', Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: 'ConntrackHelper': '1.0', Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: 'LocalIPAssociation': '1.0', Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: 'Log': '1.0', Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: 'Network': '1.1', Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: 'Port': '1.7', Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: 'PortForwarding': '1.2', Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: 'QosPolicy': '1.10', Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: 'SecurityGroup': '1.5', Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: 'SecurityGroupRule': '1.2', Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: 'SubPort': '1.0', Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: 'Subnet': '1.1', Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: 'Trunk': '1.1'}} Dec 24 04:59:06.384043 dv-cinder-816443-2-iscsi neutron-server[102476]: {{(pid=102476) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 24 04:59:06.418813 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750577486812'] for network, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:06.445885 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for network, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:06.446855 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:06.447428 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:06.485376 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.5519180 Dec 24 04:59:06.488183 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 50908) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:06.492959 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-3eec1e6b-c739-4398-ad15-fe3f0b61de27 admin admin] Request body: {'subnet': {'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-634320677-subnet', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:06.529702 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8f78ab3-17fd-4b4c-83f9-7bbac04e305a admin admin] Pushing event updated for resources: {'Network': ['ID=c908572e-3b6b-470c-8b88-35b51f1472c6,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:06.541564 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Network c908572e-3b6b-470c-8b88-35b51f1472c6 details requested by agent ovs-agent-dv-cinder-816443-2-iscsi with host dv-cinder-816443-2-iscsi {{(pid=102478) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 24 04:59:06.548023 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3eec1e6b-c739-4398-ad15-fe3f0b61de27 admin admin] Made reservation on behalf of 6c9c47f70b8d4da5827a8ef4349559ab for: {'subnet': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:59:06.550803 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3eec1e6b-c739-4398-ad15-fe3f0b61de27 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:06.738006 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3eec1e6b-c739-4398-ad15-fe3f0b61de27 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for subnet, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:06.785573 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eec1e6b-c739-4398-ad15-fe3f0b61de27 admin admin] Pushing event updated for resources: {'Subnet': ['ID=699b398d-7f9d-4acb-bc18-ac32f35377c3,revision_number=0']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:06.805268 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3eec1e6b-c739-4398-ad15-fe3f0b61de27 admin admin] Checking segment: {'id': 'db374990-dadf-47a9-9824-44188ba20dd8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:59:06.805624 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3eec1e6b-c739-4398-ad15-fe3f0b61de27 admin admin] Network hostable DHCP agents. Network: c908572e-3b6b-470c-8b88-35b51f1472c6, hostable agents: ['01bc2530-0600-4d1b-b486-2fd9d63a2d51'], hosted agents: [] {{(pid=102476) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 24 04:59:06.812932 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 50922) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:06.832045 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3eec1e6b-c739-4398-ad15-fe3f0b61de27 admin admin] Network c908572e-3b6b-470c-8b88-35b51f1472c6 is scheduled to be hosted by DHCP agent 01bc2530-0600-4d1b-b486-2fd9d63a2d51 with binding_index 1 {{(pid=102476) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 24 04:59:06.842217 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-3eec1e6b-c739-4398-ad15-fe3f0b61de27 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816443-2-iscsi, c908572e-3b6b-470c-8b88-35b51f1472c6) {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:59:06.851699 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3eec1e6b-c739-4398-ad15-fe3f0b61de27 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:06.852491 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-774eda3b-488f-4464-86b1-89e7d3171682 None None] Network c908572e-3b6b-470c-8b88-35b51f1472c6 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 04:59:06.852652 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3eec1e6b-c739-4398-ad15-fe3f0b61de27 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:06.870197 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-3eec1e6b-c739-4398-ad15-fe3f0b61de27 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.3809292 Dec 24 04:59:06.874756 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 50926) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:06.895351 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-9db817c4-e717-468e-9295-735395be413e admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-634320677-router', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:06.927956 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9db817c4-e717-468e-9295-735395be413e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-546186', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2070334'] for router, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:06.929638 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9db817c4-e717-468e-9295-735395be413e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-546302', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-549497', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-553463', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2070311'] for router, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:06.982555 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 50934) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:06.993704 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpd2866d45-53d6-5577-9724-7d7a303c375f-c908572e-3b6b-470c-8b88-35b51f1472c6', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'fixed_ips': [{'subnet_id': '699b398d-7f9d-4acb-bc18-ac32f35377c3'}]}} from dv-cinder-816443-2-iscsi. {{(pid=102478) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 24 04:59:06.995087 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.016197 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 50942) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:07.029468 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9db817c4-e717-468e-9295-735395be413e admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.060305 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 50946) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:07.157803 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.db_base_plugin_common [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Allocated IP 172.20.0.2 (c908572e-3b6b-470c-8b88-35b51f1472c6/699b398d-7f9d-4acb-bc18-ac32f35377c3/94023408-d2c9-43c8-9add-6e9c458c33e2) {{(pid=102478) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 04:59:07.175730 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-2cf3edf2-6696-4bc5-b716-12f186d4d206 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-494910411-network', 'tenant_id': 'e1b7efd121ac4cf9a0965e95479e8da8'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:07.183003 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9db817c4-e717-468e-9295-735395be413e admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.220830 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2cf3edf2-6696-4bc5-b716-12f186d4d206 admin admin] Made reservation on behalf of e1b7efd121ac4cf9a0965e95479e8da8 for: {'network': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:59:07.223764 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2cf3edf2-6696-4bc5-b716-12f186d4d206 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for network, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.239112 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-561074829-network', 'tenant_id': '1b651e55b1a349a0b9582c526d3b5d67'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:07.252800 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2cf3edf2-6696-4bc5-b716-12f186d4d206 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.291618 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Made reservation on behalf of 1b651e55b1a349a0b9582c526d3b5d67 for: {'network': 1} {{(pid=102477) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:59:07.294103 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for network, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.323384 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.344583 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-e4ac6154-e27f-48b2-9911-959ba9456796 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1909782362-network', 'tenant_id': '8f1c3a94f02049e3a76c4fc01fa7a022'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:07.371955 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-700ea6ee-3abd-4e9f-adfc-4da6c2f2d47d admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1554836732-network', 'tenant_id': '14dbe9b1ff9041858e25c4fafebc1a51'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:07.394126 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e4ac6154-e27f-48b2-9911-959ba9456796 admin admin] Made reservation on behalf of 8f1c3a94f02049e3a76c4fc01fa7a022 for: {'network': 1} {{(pid=102477) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:59:07.396729 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e4ac6154-e27f-48b2-9911-959ba9456796 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for network, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.413952 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Publish callbacks [] for port, precommit_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.423729 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001'] for port, after_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.500379 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9db817c4-e717-468e-9295-735395be413e admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.510363 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Network c908572e-3b6b-470c-8b88-35b51f1472c6 is already hosted by enough agents. {{(pid=102478) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 04:59:07.526177 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.scheduler.base_scheduler [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Resources bound (agent type, host, resource id): {{(pid=102478) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:59:07.529702 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Received port after_create {{(pid=102478) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 04:59:07.544211 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.562746 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e4ac6154-e27f-48b2-9911-959ba9456796 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.568792 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.571417 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9db817c4-e717-468e-9295-735395be413e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.586787 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-700ea6ee-3abd-4e9f-adfc-4da6c2f2d47d admin admin] Made reservation on behalf of 14dbe9b1ff9041858e25c4fafebc1a51 for: {'network': 1} {{(pid=102477) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:59:07.590852 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-700ea6ee-3abd-4e9f-adfc-4da6c2f2d47d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for network, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.635146 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Pushing event updated for resources: {'Port': ['ID=94023408-d2c9-43c8-9add-6e9c458c33e2,revision_number=1']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:07.639792 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-700ea6ee-3abd-4e9f-adfc-4da6c2f2d47d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.645662 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fb15db0c-18b7-4431-8838-f84f360e82f2,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:07.671647 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Attempting to bind port 94023408-d2c9-43c8-9add-6e9c458c33e2 on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 04:59:07.672015 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Attempting to bind port 94023408-d2c9-43c8-9add-6e9c458c33e2 by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': 'db374990-dadf-47a9-9824-44188ba20dd8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6'}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 04:59:07.672635 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Attempting to bind port 94023408-d2c9-43c8-9add-6e9c458c33e2 on network c908572e-3b6b-470c-8b88-35b51f1472c6 {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 04:59:07.682555 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.693387 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.695026 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.695990 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.696750 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.697615 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.698356 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.699088 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.699814 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.700589 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.701363 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.702074 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.708831 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2cf3edf2-6696-4bc5-b716-12f186d4d206 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.709500 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Tracked resource versions report: Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: pushed versions: Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: { 'AddressGroup': {'1.2'}, Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: 'ConntrackHelper': {'1.0'}, Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: 'LocalIPAssociation': {'1.0'}, Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: 'Log': {'1.0'}, Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: 'Network': {'1.1'}, Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: 'Port': {'1.7'}, Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: 'PortForwarding': {'1.2'}, Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: 'QosPolicy': {'1.10'}, Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: 'SecurityGroup': {'1.5'}, Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: 'SecurityGroupRule': {'1.2'}, Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: 'SubPort': {'1.0'}, Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: 'Subnet': {'1.1'}, Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: 'Trunk': {'1.1'}} Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: consumer versions: Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: { DHCP agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: HyperV agent@hv-cinder-81644: {}, Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: L3 agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: Metadata agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: Metering agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: Open vSwitch agent@dv-cinder-816443-2-iscsi: { 'AddressGroup': '1.2', Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: 'ConntrackHelper': '1.0', Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: 'LocalIPAssociation': '1.0', Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: 'Log': '1.0', Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: 'Network': '1.1', Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: 'Port': '1.7', Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: 'PortForwarding': '1.2', Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: 'QosPolicy': '1.10', Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: 'SecurityGroup': '1.5', Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: 'SecurityGroupRule': '1.2', Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: 'SubPort': '1.0', Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: 'Subnet': '1.1', Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: 'Trunk': '1.1'}} Dec 24 04:59:07.711159 dv-cinder-816443-2-iscsi neutron-server[102478]: {{(pid=102478) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 24 04:59:07.716727 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 4, 58, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 04:59:07.717437 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Checking segment: {'id': 'db374990-dadf-47a9-9824-44188ba20dd8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102478) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:59:07.718027 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.718601 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Bound using segment: {'id': 'db374990-dadf-47a9-9824-44188ba20dd8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6'} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 04:59:07.719262 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Bound port: 94023408-d2c9-43c8-9add-6e9c458c33e2, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'db374990-dadf-47a9-9824-44188ba20dd8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6'}}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 04:59:07.720282 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.729996 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2cf3edf2-6696-4bc5-b716-12f186d4d206 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.784119 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-700ea6ee-3abd-4e9f-adfc-4da6c2f2d47d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.786523 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.787271 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.787718 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.788258 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.789316 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.789746 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.790148 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.790630 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.791137 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.791675 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.792071 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.792719 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.793352 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:07.795544 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cf3edf2-6696-4bc5-b716-12f186d4d206 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=855f293c-d7d0-4e8b-891d-7183bf47a038,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Tracked resource versions report: Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: pushed versions: Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: { 'AddressGroup': {'1.2'}, Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: 'ConntrackHelper': {'1.0'}, Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: 'LocalIPAssociation': {'1.0'}, Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: 'Log': {'1.0'}, Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: 'Network': {'1.1'}, Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: 'Port': {'1.7'}, Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: 'PortForwarding': {'1.2'}, Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: 'QosPolicy': {'1.10'}, Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: 'SecurityGroup': {'1.5'}, Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: 'SecurityGroupRule': {'1.2'}, Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: 'SubPort': {'1.0'}, Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: 'Subnet': {'1.1'}, Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: 'Trunk': {'1.1'}} Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: consumer versions: Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: { DHCP agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: HyperV agent@hv-cinder-81644: {}, Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: L3 agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: Metadata agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: Metering agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: Open vSwitch agent@dv-cinder-816443-2-iscsi: { 'AddressGroup': '1.2', Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: 'ConntrackHelper': '1.0', Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: 'LocalIPAssociation': '1.0', Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: 'Log': '1.0', Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: 'Network': '1.1', Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: 'Port': '1.7', Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: 'PortForwarding': '1.2', Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: 'QosPolicy': '1.10', Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: 'SecurityGroup': '1.5', Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: 'SecurityGroupRule': '1.2', Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: 'SubPort': '1.0', Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: 'Subnet': '1.1', Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: 'Trunk': '1.1'}} Dec 24 04:59:07.795671 dv-cinder-816443-2-iscsi neutron-server[102477]: {{(pid=102477) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 24 04:59:07.821905 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2cf3edf2-6696-4bc5-b716-12f186d4d206 admin admin] vlan segment allocate from pool success with {'vlan_id': 138, 'physical_network': 'physnet1'} {{(pid=102476) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 24 04:59:07.832041 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-700ea6ee-3abd-4e9f-adfc-4da6c2f2d47d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.855890 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-700ea6ee-3abd-4e9f-adfc-4da6c2f2d47d admin admin] vlan segment allocate from pool success with {'vlan_id': 115, 'physical_network': 'physnet1'} {{(pid=102477) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 24 04:59:07.858565 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] For port 94023408-d2c9-43c8-9add-6e9c458c33e2, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102478) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 04:59:07.864800 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] For port 94023408-d2c9-43c8-9add-6e9c458c33e2, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=94023408-d2c9-43c8-9add-6e9c458c33e2,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102478) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 04:59:07.869196 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-700ea6ee-3abd-4e9f-adfc-4da6c2f2d47d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.869536 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.db.segments_db [None req-700ea6ee-3abd-4e9f-adfc-4da6c2f2d47d admin admin] Added segment 3203d346-5464-46d2-aeaa-9836964b7a28 of type vlan for network 598b6cd9-9673-4e27-b33e-451cd98b5f1c Dec 24 04:59:07.873533 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.905420 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] vlan segment allocate from pool success with {'vlan_id': 133, 'physical_network': 'physnet1'} {{(pid=102477) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 24 04:59:07.909380 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2cf3edf2-6696-4bc5-b716-12f186d4d206 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.909719 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.segments_db [None req-2cf3edf2-6696-4bc5-b716-12f186d4d206 admin admin] Added segment cd1116f8-f0f7-4ee1-ae80-2d8438da195a of type vlan for network 8f425b2b-ba49-498c-b91b-c8557f14aee1 Dec 24 04:59:07.940434 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-700ea6ee-3abd-4e9f-adfc-4da6c2f2d47d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750577486812'] for network, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.971847 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:07.972205 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.db.segments_db [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Added segment d94b0a1e-2098-4b10-9091-c566351ffe74 of type vlan for network 0d368baa-5733-40a7-b836-139a541f4ebb Dec 24 04:59:07.990092 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43798480-f8ff-41fa-834f-ba7e119d54d0 None None] Pushing event updated for resources: {'Port': ['ID=94023408-d2c9-43c8-9add-6e9c458c33e2,revision_number=2']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:08.006022 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2cf3edf2-6696-4bc5-b716-12f186d4d206 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750577486812'] for network, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:08.014577 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-700ea6ee-3abd-4e9f-adfc-4da6c2f2d47d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=08dd9559-4a5c-4df9-a435-24a371a63d3e,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:08.034205 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [None req-9db817c4-e717-468e-9295-735395be413e admin admin] Allocated IP 172.27.1.148 (9b4e4b31-551f-45a9-b26a-cb44ee20a17d/f277b899-8779-420e-8a8d-bfcd5eb7f012/d5be979e-f11f-424a-bd46-164029481a60) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 04:59:08.083726 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-700ea6ee-3abd-4e9f-adfc-4da6c2f2d47d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for network, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:08.085459 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-700ea6ee-3abd-4e9f-adfc-4da6c2f2d47d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:08.086397 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-700ea6ee-3abd-4e9f-adfc-4da6c2f2d47d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:08.091495 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750577486812'] for network, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:08.160339 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-700ea6ee-3abd-4e9f-adfc-4da6c2f2d47d admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.1428828 Dec 24 04:59:08.168134 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 50998) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:08.201645 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-9807e840-2100-4197-a6e4-87e42e7252ea admin admin] Request body: {'subnet': {'network_id': '598b6cd9-9673-4e27-b33e-451cd98b5f1c', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1554836732-subnet', 'tenant_id': '14dbe9b1ff9041858e25c4fafebc1a51', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:08.223362 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-700ea6ee-3abd-4e9f-adfc-4da6c2f2d47d admin admin] Pushing event updated for resources: {'Network': ['ID=598b6cd9-9673-4e27-b33e-451cd98b5f1c,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:08.228248 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e4ac6154-e27f-48b2-9911-959ba9456796 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:08.234522 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Network 598b6cd9-9673-4e27-b33e-451cd98b5f1c details requested by agent ovs-agent-dv-cinder-816443-2-iscsi with host dv-cinder-816443-2-iscsi {{(pid=102478) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 24 04:59:08.254536 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e4ac6154-e27f-48b2-9911-959ba9456796 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:08.258750 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9db817c4-e717-468e-9295-735395be413e admin admin] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:08.267682 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for network, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:08.276402 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:08.277168 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:08.299780 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2cf3edf2-6696-4bc5-b716-12f186d4d206 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for network, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:08.301259 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2cf3edf2-6696-4bc5-b716-12f186d4d206 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:08.302086 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2cf3edf2-6696-4bc5-b716-12f186d4d206 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:08.325717 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9db817c4-e717-468e-9295-735395be413e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:08.367234 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9db817c4-e717-468e-9295-735395be413e admin admin] Network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 04:59:08.452838 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-9db817c4-e717-468e-9295-735395be413e admin admin] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:59:08.452838 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9db817c4-e717-468e-9295-735395be413e admin admin] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 04:59:08.454200 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] Pushing event updated for resources: {'Network': ['ID=0d368baa-5733-40a7-b836-139a541f4ebb,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:08.454425 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Network 0d368baa-5733-40a7-b836-139a541f4ebb details requested by agent ovs-agent-dv-cinder-816443-2-iscsi with host dv-cinder-816443-2-iscsi {{(pid=102478) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 24 04:59:08.492216 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e4ac6154-e27f-48b2-9911-959ba9456796 admin admin] vlan segment allocate from pool success with {'vlan_id': 125, 'physical_network': 'physnet1'} {{(pid=102477) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 24 04:59:08.514981 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9807e840-2100-4197-a6e4-87e42e7252ea admin admin] Made reservation on behalf of 14dbe9b1ff9041858e25c4fafebc1a51 for: {'subnet': 1} {{(pid=102477) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:59:08.527898 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-9807e840-2100-4197-a6e4-87e42e7252ea admin admin] Publish callbacks [] for subnet, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:08.714197 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-e61eccd0-33a6-4e5c-8966-7ffbcd12ce50 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 1.7302175 Dec 24 04:59:08.725129 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 51018) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:08.727567 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e4ac6154-e27f-48b2-9911-959ba9456796 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:08.727914 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.db.segments_db [None req-e4ac6154-e27f-48b2-9911-959ba9456796 admin admin] Added segment 10307c97-e214-473b-b760-bb1b770153ec of type vlan for network b92a87f3-957a-4ccb-9b5b-98ad92aebe6e Dec 24 04:59:08.738781 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-9cbc8aaf-7c3c-464e-b6cb-ef44c72f17e0 admin admin] Request body: {'subnet': {'network_id': '0d368baa-5733-40a7-b836-139a541f4ebb', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-561074829-subnet', 'tenant_id': '1b651e55b1a349a0b9582c526d3b5d67', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:08.755555 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4ac6154-e27f-48b2-9911-959ba9456796 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:08.756153 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-2cf3edf2-6696-4bc5-b716-12f186d4d206 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 1.9419458 Dec 24 04:59:08.766880 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 51020) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:08.790248 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-305dd0c2-605f-4653-80d0-6c13154ac443 admin admin] Request body: {'subnet': {'network_id': '8f425b2b-ba49-498c-b91b-c8557f14aee1', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-494910411-subnet', 'tenant_id': 'e1b7efd121ac4cf9a0965e95479e8da8', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:08.859202 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 94023408-d2c9-43c8-9add-6e9c458c33e2 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 04:59:08.871933 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e4ac6154-e27f-48b2-9911-959ba9456796 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750577486812'] for network, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:08.907146 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9cbc8aaf-7c3c-464e-b6cb-ef44c72f17e0 admin admin] Made reservation on behalf of 1b651e55b1a349a0b9582c526d3b5d67 for: {'subnet': 1} {{(pid=102477) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:59:08.910867 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-9cbc8aaf-7c3c-464e-b6cb-ef44c72f17e0 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:08.961493 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 94023408-d2c9-43c8-9add-6e9c458c33e2 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:59:08.970791 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:08.981147 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-305dd0c2-605f-4653-80d0-6c13154ac443 admin admin] Made reservation on behalf of e1b7efd121ac4cf9a0965e95479e8da8 for: {'subnet': 1} {{(pid=102477) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:59:08.984739 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-305dd0c2-605f-4653-80d0-6c13154ac443 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:09.058599 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cf3edf2-6696-4bc5-b716-12f186d4d206 admin admin] Pushing event updated for resources: {'Network': ['ID=8f425b2b-ba49-498c-b91b-c8557f14aee1,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:09.083180 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Network 8f425b2b-ba49-498c-b91b-c8557f14aee1 details requested by agent ovs-agent-dv-cinder-816443-2-iscsi with host dv-cinder-816443-2-iscsi {{(pid=102478) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 24 04:59:09.128252 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e4ac6154-e27f-48b2-9911-959ba9456796 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for network, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:09.129904 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4ac6154-e27f-48b2-9911-959ba9456796 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:09.130641 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e4ac6154-e27f-48b2-9911-959ba9456796 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:09.133148 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-9807e840-2100-4197-a6e4-87e42e7252ea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for subnet, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:09.182368 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9db817c4-e717-468e-9295-735395be413e admin admin] Pushing event updated for resources: {'Port': ['ID=d5be979e-f11f-424a-bd46-164029481a60,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:09.352930 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9db817c4-e717-468e-9295-735395be413e admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:09.546633 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-9cbc8aaf-7c3c-464e-b6cb-ef44c72f17e0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for subnet, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:09.552693 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4ac6154-e27f-48b2-9911-959ba9456796 admin admin] Pushing event updated for resources: {'Network': ['ID=b92a87f3-957a-4ccb-9b5b-98ad92aebe6e,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:09.559147 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-e4ac6154-e27f-48b2-9911-959ba9456796 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 2.4972577 Dec 24 04:59:09.572710 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Network b92a87f3-957a-4ccb-9b5b-98ad92aebe6e details requested by agent ovs-agent-dv-cinder-816443-2-iscsi with host dv-cinder-816443-2-iscsi {{(pid=102478) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 24 04:59:09.574242 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 51054) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:09.588735 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-cb76dcd2-2717-4f9f-9459-a126ae73b845 admin admin] Request body: {'subnet': {'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1909782362-subnet', 'tenant_id': '8f1c3a94f02049e3a76c4fc01fa7a022', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:09.604505 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:09.640674 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9807e840-2100-4197-a6e4-87e42e7252ea admin admin] Checking segment: {'id': '3203d346-5464-46d2-aeaa-9836964b7a28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '598b6cd9-9673-4e27-b33e-451cd98b5f1c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102477) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:59:09.641239 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9807e840-2100-4197-a6e4-87e42e7252ea admin admin] Network hostable DHCP agents. Network: 598b6cd9-9673-4e27-b33e-451cd98b5f1c, hostable agents: ['01bc2530-0600-4d1b-b486-2fd9d63a2d51'], hosted agents: [] {{(pid=102477) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 24 04:59:09.683601 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-02f5660f-faac-4b63-8cb1-ee1fd06d4273 None None] Network c908572e-3b6b-470c-8b88-35b51f1472c6 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 04:59:09.691142 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cb76dcd2-2717-4f9f-9459-a126ae73b845 admin admin] Made reservation on behalf of 8f1c3a94f02049e3a76c4fc01fa7a022 for: {'subnet': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:59:09.694141 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-cb76dcd2-2717-4f9f-9459-a126ae73b845 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:09.724633 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9807e840-2100-4197-a6e4-87e42e7252ea admin admin] Pushing event updated for resources: {'Subnet': ['ID=32199feb-6f3a-4642-a10b-5d278d90a9e5,revision_number=0']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:09.728464 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9cbc8aaf-7c3c-464e-b6cb-ef44c72f17e0 admin admin] Checking segment: {'id': 'd94b0a1e-2098-4b10-9091-c566351ffe74', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '0d368baa-5733-40a7-b836-139a541f4ebb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102477) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:59:09.728857 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9cbc8aaf-7c3c-464e-b6cb-ef44c72f17e0 admin admin] Network hostable DHCP agents. Network: 0d368baa-5733-40a7-b836-139a541f4ebb, hostable agents: ['01bc2530-0600-4d1b-b486-2fd9d63a2d51'], hosted agents: [] {{(pid=102477) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 24 04:59:09.740964 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9807e840-2100-4197-a6e4-87e42e7252ea admin admin] Network 598b6cd9-9673-4e27-b33e-451cd98b5f1c is scheduled to be hosted by DHCP agent 01bc2530-0600-4d1b-b486-2fd9d63a2d51 with binding_index 1 {{(pid=102477) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 24 04:59:09.771429 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-3582ccb3-cd4d-444e-a511-82174e325dd4 None None] Provisioning complete for port 94023408-d2c9-43c8-9add-6e9c458c33e2 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:59:09.771963 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3582ccb3-cd4d-444e-a511-82174e325dd4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:09.816695 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-9807e840-2100-4197-a6e4-87e42e7252ea admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816443-2-iscsi, 598b6cd9-9673-4e27-b33e-451cd98b5f1c) {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:59:09.830893 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9807e840-2100-4197-a6e4-87e42e7252ea admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:09.831531 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-9807e840-2100-4197-a6e4-87e42e7252ea admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:09.844308 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9cbc8aaf-7c3c-464e-b6cb-ef44c72f17e0 admin admin] Network 0d368baa-5733-40a7-b836-139a541f4ebb is scheduled to be hosted by DHCP agent 01bc2530-0600-4d1b-b486-2fd9d63a2d51 with binding_index 1 {{(pid=102477) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 24 04:59:09.850069 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cbc8aaf-7c3c-464e-b6cb-ef44c72f17e0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=88f274d6-bcf0-47e8-9f0a-783a53214be4,revision_number=0']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:09.878416 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3a58af79-e84e-464c-9518-bc0f0bf33558 None None] Network 598b6cd9-9673-4e27-b33e-451cd98b5f1c requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 04:59:09.885017 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-9cbc8aaf-7c3c-464e-b6cb-ef44c72f17e0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816443-2-iscsi, 0d368baa-5733-40a7-b836-139a541f4ebb) {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:59:09.897508 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9cbc8aaf-7c3c-464e-b6cb-ef44c72f17e0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:09.898077 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-9cbc8aaf-7c3c-464e-b6cb-ef44c72f17e0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:09.906713 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-9807e840-2100-4197-a6e4-87e42e7252ea admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.7090647 Dec 24 04:59:09.917323 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-305dd0c2-605f-4653-80d0-6c13154ac443 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for subnet, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:09.932079 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-627c7c8d-8ab3-4cbe-ac0d-5233bb3ed243 None None] Network 0d368baa-5733-40a7-b836-139a541f4ebb requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 04:59:09.954860 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-9cbc8aaf-7c3c-464e-b6cb-ef44c72f17e0 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 855 time: 1.2286279 Dec 24 04:59:09.962838 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 51068) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:09.972047 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-b7102345-9721-4b08-8250-4753be7b4752 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-561074829-router', 'tenant_id': '1b651e55b1a349a0b9582c526d3b5d67', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:10.009197 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 51074) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:10.014160 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-305dd0c2-605f-4653-80d0-6c13154ac443 admin admin] Pushing event updated for resources: {'Subnet': ['ID=aff17713-11e2-42bd-a296-04f827a91e1d,revision_number=0']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:10.025637 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] For port 94023408-d2c9-43c8-9add-6e9c458c33e2, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=94023408-d2c9-43c8-9add-6e9c458c33e2,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 04:59:10.094389 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:10.103508 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-305dd0c2-605f-4653-80d0-6c13154ac443 admin admin] Checking segment: {'id': 'cd1116f8-f0f7-4ee1-ae80-2d8438da195a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '8f425b2b-ba49-498c-b91b-c8557f14aee1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102477) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:59:10.103859 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-305dd0c2-605f-4653-80d0-6c13154ac443 admin admin] Network hostable DHCP agents. Network: 8f425b2b-ba49-498c-b91b-c8557f14aee1, hostable agents: ['01bc2530-0600-4d1b-b486-2fd9d63a2d51'], hosted agents: [] {{(pid=102477) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 24 04:59:10.108641 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b7102345-9721-4b08-8250-4753be7b4752 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-546186', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2070334'] for router, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:10.109686 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b7102345-9721-4b08-8250-4753be7b4752 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-546302', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-549497', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-553463', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2070311'] for router, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:10.137532 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9db817c4-e717-468e-9295-735395be413e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-546295', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-545958'] for router, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:10.147197 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-305dd0c2-605f-4653-80d0-6c13154ac443 admin admin] Network 8f425b2b-ba49-498c-b91b-c8557f14aee1 is scheduled to be hosted by DHCP agent 01bc2530-0600-4d1b-b486-2fd9d63a2d51 with binding_index 1 {{(pid=102477) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 24 04:59:10.181753 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b7102345-9721-4b08-8250-4753be7b4752 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:10.183597 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-305dd0c2-605f-4653-80d0-6c13154ac443 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816443-2-iscsi, 8f425b2b-ba49-498c-b91b-c8557f14aee1) {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:59:10.188604 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-305dd0c2-605f-4653-80d0-6c13154ac443 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:10.189540 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-305dd0c2-605f-4653-80d0-6c13154ac443 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:10.209144 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-86d35d82-1ff0-49f4-a703-be118a7e78cd None None] Network 8f425b2b-ba49-498c-b91b-c8557f14aee1 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 04:59:10.321669 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-cb76dcd2-2717-4f9f-9459-a126ae73b845 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for subnet, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:10.334881 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-305dd0c2-605f-4653-80d0-6c13154ac443 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 1.5483289 Dec 24 04:59:10.342976 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-66b62d7e-e81a-480d-8f78-d15af022294b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:10.400469 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Pushing event updated for resources: {'Port': ['ID=94023408-d2c9-43c8-9add-6e9c458c33e2,revision_number=3']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:10.481977 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-09d5a567-f8b5-4874-b904-e436c3cd3966 None None] Network 8f425b2b-ba49-498c-b91b-c8557f14aee1 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 04:59:10.482610 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-66b62d7e-e81a-480d-8f78-d15af022294b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:10.484322 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b210dde-890d-4b2c-8576-1ba8fa2bf6d7 None None] Network 0d368baa-5733-40a7-b836-139a541f4ebb requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 04:59:10.516111 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d635e51-5baa-4b53-9059-042506f55f7f None None] Network 598b6cd9-9673-4e27-b33e-451cd98b5f1c requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 04:59:10.518061 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-66b62d7e-e81a-480d-8f78-d15af022294b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:10.547780 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cb76dcd2-2717-4f9f-9459-a126ae73b845 admin admin] Checking segment: {'id': '10307c97-e214-473b-b760-bb1b770153ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:59:10.548287 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb76dcd2-2717-4f9f-9459-a126ae73b845 admin admin] Network hostable DHCP agents. Network: b92a87f3-957a-4ccb-9b5b-98ad92aebe6e, hostable agents: ['01bc2530-0600-4d1b-b486-2fd9d63a2d51'], hosted agents: [] {{(pid=102476) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 24 04:59:10.570060 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb76dcd2-2717-4f9f-9459-a126ae73b845 admin admin] Pushing event updated for resources: {'Subnet': ['ID=9b9ff65f-93c8-4cb1-8a99-961ba0d4beaa,revision_number=0']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:10.597358 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b7102345-9721-4b08-8250-4753be7b4752 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:10.626448 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-66b62d7e-e81a-480d-8f78-d15af022294b admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=a0a31201e2084a198f151b0bfc556fa1&name=default HTTP/1.1" status: 200 len: 2992 time: 0.5957882 Dec 24 04:59:10.631987 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 51100) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:10.642315 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66b62d7e-e81a-480d-8f78-d15af022294b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=12b4e202-ef2d-4ad9-a3ef-bf08a11e5a15,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:10.718163 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 51114) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:10.725222 dv-cinder-816443-2-iscsi neutron-server[102477]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Dec 24 04:59:10.737060 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 94023408-d2c9-43c8-9add-6e9c458c33e2 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 04:59:10.788186 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb76dcd2-2717-4f9f-9459-a126ae73b845 admin admin] Network b92a87f3-957a-4ccb-9b5b-98ad92aebe6e is scheduled to be hosted by DHCP agent 01bc2530-0600-4d1b-b486-2fd9d63a2d51 with binding_index 1 {{(pid=102476) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 24 04:59:10.825046 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-cb76dcd2-2717-4f9f-9459-a126ae73b845 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816443-2-iscsi, b92a87f3-957a-4ccb-9b5b-98ad92aebe6e) {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:59:10.830885 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb76dcd2-2717-4f9f-9459-a126ae73b845 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:10.832227 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-cb76dcd2-2717-4f9f-9459-a126ae73b845 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:10.856598 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-17742518-3bcc-4bb0-8808-7b97243b5dc5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:10.857570 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5bea8f2a-fd63-4789-bb53-5c307a1cc027 None None] Network b92a87f3-957a-4ccb-9b5b-98ad92aebe6e requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 04:59:10.887067 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-17742518-3bcc-4bb0-8808-7b97243b5dc5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:10.963622 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-efc536df-83d2-47fb-a25e-add6ade0b7ad None None] Provisioning complete for port 94023408-d2c9-43c8-9add-6e9c458c33e2 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:59:10.964285 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-efc536df-83d2-47fb-a25e-add6ade0b7ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:10.964405 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-cb76dcd2-2717-4f9f-9459-a126ae73b845 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 1.3856971 Dec 24 04:59:10.978837 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-17742518-3bcc-4bb0-8808-7b97243b5dc5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:10.983730 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-17742518-3bcc-4bb0-8808-7b97243b5dc5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:10.990955 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-17742518-3bcc-4bb0-8808-7b97243b5dc5 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/12b4e202-ef2d-4ad9-a3ef-bf08a11e5a15 HTTP/1.1" status: 204 len: 168 time: 0.3556676 Dec 24 04:59:10.994077 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 94023408-d2c9-43c8-9add-6e9c458c33e2 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:59:10.994433 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:11.002565 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9db817c4-e717-468e-9295-735395be413e admin admin] Router d1392df8-0562-4659-9906-2d085b726626 is scheduled to L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 with binding_index 1 {{(pid=102476) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 24 04:59:11.043328 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17742518-3bcc-4bb0-8808-7b97243b5dc5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=12b4e202-ef2d-4ad9-a3ef-bf08a11e5a15,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:11.055138 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-89cc7a51-cb94-4d81-beb2-d241b1406812 None None] Network b92a87f3-957a-4ccb-9b5b-98ad92aebe6e requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 04:59:11.134509 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-d30fd6d9-18c1-4ef7-aab3-d2bacf0effee tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:11.143997 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-d30fd6d9-18c1-4ef7-aab3-d2bacf0effee tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/networks?id=598b6cd9-9673-4e27-b33e-451cd98b5f1c HTTP/1.1" status: 200 len: 812 time: 0.4199915 Dec 24 04:59:11.189677 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-e0dd77ef-eb6a-4295-8a41-8a90ed7d4cb6 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/quotas/14dbe9b1ff9041858e25c4fafebc1a51 HTTP/1.1" status: 200 len: 375 time: 0.0447655 Dec 24 04:59:11.305855 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9db817c4-e717-468e-9295-735395be413e admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 04:59:11.320772 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] Sync routers for ids ['d1392df8-0562-4659-9906-2d085b726626'] in dv-cinder-816443-2-iscsi {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 04:59:11.335359 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] Routers {'d1392df8-0562-4659-9906-2d085b726626'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 04:59:11.338714 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T04:58:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['d1392df8-0562-4659-9906-2d085b726626'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:59:11.349749 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9db817c4-e717-468e-9295-735395be413e admin admin] Publish callbacks [] for router, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:11.351393 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-9db817c4-e717-468e-9295-735395be413e admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 4.4755344 Dec 24 04:59:11.354496 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 51140) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:11.383110 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-4e3e70e4-7fbd-4a45-9383-6f271784d875 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=14dbe9b1ff9041858e25c4fafebc1a51&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1234787 Dec 24 04:59:11.448080 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b7102345-9721-4b08-8250-4753be7b4752 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:11.495759 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b7102345-9721-4b08-8250-4753be7b4752 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:11.554419 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 51148) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:11.558001 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] Set router d1392df8-0562-4659-9906-2d085b726626 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 04:59:11.568684 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-040578db-6b20-4246-aaa2-57b469965123 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1771882864-network', 'tenant_id': 'e58266cfa29a4eb9bcff4786a5161fac'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:11.695169 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.db_base_plugin_common [None req-b7102345-9721-4b08-8250-4753be7b4752 admin admin] Allocated IP 172.27.1.96 (9b4e4b31-551f-45a9-b26a-cb44ee20a17d/f277b899-8779-420e-8a8d-bfcd5eb7f012/1e3aad5b-d728-4cff-9337-8dd407616d35) {{(pid=102477) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 04:59:11.857138 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 51170) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:11.866383 dv-cinder-816443-2-iscsi neutron-server[102476]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Dec 24 04:59:11.971151 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-040578db-6b20-4246-aaa2-57b469965123 admin admin] Made reservation on behalf of e58266cfa29a4eb9bcff4786a5161fac for: {'network': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:59:11.973521 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-040578db-6b20-4246-aaa2-57b469965123 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for network, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:12.000195 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1392df8-0562-4659-9906-2d085b726626', 'name': 'tempest-AttachVolumeShelveTestJSON-634320677-router', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148'}], 'enable_snat': True}, 'gw_port_id': 'd5be979e-f11f-424a-bd46-164029481a60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:06Z', 'updated_at': '2021-12-24T04:59:09Z', 'revision_number': 3, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'gw_port': {'id': 'd5be979e-f11f-424a-bd46-164029481a60', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:30:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:07Z', 'updated_at': '2021-12-24T04:59:08Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:59:12.030961 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] Checking router: d1392df8-0562-4659-9906-2d085b726626 for host: dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 04:59:12.031314 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] Updating router d1392df8-0562-4659-9906-2d085b726626 port d5be979e-f11f-424a-bd46-164029481a60 binding host dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 24 04:59:12.033579 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b7102345-9721-4b08-8250-4753be7b4752 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:12.046609 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-318befe1-907d-4769-a610-7128e5c7ecda service neutron] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102477) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 24 04:59:12.048088 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-318befe1-907d-4769-a610-7128e5c7ecda service neutron] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1322787 Dec 24 04:59:12.061096 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:12.166476 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-040578db-6b20-4246-aaa2-57b469965123 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:12.235675 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-84965552-1a48-4547-ab0a-77f60200c58f service neutron] 10.222.0.43 "GET /v2.0/networks/598b6cd9-9673-4e27-b33e-451cd98b5f1c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1764867 Dec 24 04:59:12.285034 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b7102345-9721-4b08-8250-4753be7b4752 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001'] for port, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:12.290394 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-7934db01-f8bd-4fbd-b279-36189412e2b1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:12.291949 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-7934db01-f8bd-4fbd-b279-36189412e2b1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/networks?id=b92a87f3-957a-4ccb-9b5b-98ad92aebe6e HTTP/1.1" status: 200 len: 815 time: 0.4306126 Dec 24 04:59:12.336075 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0c77414f-0946-4a8c-92cf-867d9bb461ce admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:12.351919 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-83b2c333-9148-4dfd-a28f-d922e38f1967 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/quotas/8f1c3a94f02049e3a76c4fc01fa7a022 HTTP/1.1" status: 200 len: 375 time: 0.0496600 Dec 24 04:59:12.396947 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7102345-9721-4b08-8250-4753be7b4752 admin admin] Network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d is already hosted by enough agents. {{(pid=102477) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 04:59:12.412942 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-b7102345-9721-4b08-8250-4753be7b4752 admin admin] Resources bound (agent type, host, resource id): {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:59:12.422974 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7102345-9721-4b08-8250-4753be7b4752 admin admin] Received port after_create {{(pid=102477) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 04:59:12.429279 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-796117fd-978d-4d38-92bf-82b57ad2bcd0 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=8f1c3a94f02049e3a76c4fc01fa7a022&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0692501 Dec 24 04:59:12.499640 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-040578db-6b20-4246-aaa2-57b469965123 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:12.505310 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7102345-9721-4b08-8250-4753be7b4752 admin admin] Pushing event updated for resources: {'Port': ['ID=1e3aad5b-d728-4cff-9337-8dd407616d35,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:12.530555 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] Publish callbacks [] for port, precommit_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:12.536198 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-040578db-6b20-4246-aaa2-57b469965123 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:12.541503 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:12.584236 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-040578db-6b20-4246-aaa2-57b469965123 admin admin] vlan segment allocate from pool success with {'vlan_id': 134, 'physical_network': 'physnet1'} {{(pid=102476) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 24 04:59:12.609007 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-040578db-6b20-4246-aaa2-57b469965123 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=333cb746-4522-4307-b1e7-e151d109fffc,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:12.633844 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-040578db-6b20-4246-aaa2-57b469965123 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:12.634806 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.segments_db [None req-040578db-6b20-4246-aaa2-57b469965123 admin admin] Added segment 687a836c-495c-4f34-80ed-10af75e46a33 of type vlan for network f60e9f58-510e-4be7-a2c1-9a2cee474737 Dec 24 04:59:12.641790 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] Attempting to bind port d5be979e-f11f-424a-bd46-164029481a60 on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 04:59:12.642462 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] Attempting to bind port d5be979e-f11f-424a-bd46-164029481a60 by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}] {{(pid=102479) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 04:59:12.643062 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] Attempting to bind port d5be979e-f11f-424a-bd46-164029481a60 on network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 04:59:12.654432 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 4, 58, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 04:59:12.654811 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] Checking segment: {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102479) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:59:12.655504 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:12.655961 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] Bound using segment: {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'} {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 04:59:12.656429 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] Bound port: d5be979e-f11f-424a-bd46-164029481a60, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}}] {{(pid=102479) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 04:59:12.656856 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:12.669266 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-a44f7825-e988-4a30-ac1d-9bc9a17cdc61 service neutron] 10.222.0.43 "GET /v2.0/networks/598b6cd9-9673-4e27-b33e-451cd98b5f1c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4223013 Dec 24 04:59:12.717544 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.db [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] For port d5be979e-f11f-424a-bd46-164029481a60, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102479) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 04:59:12.721820 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.db [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] For port d5be979e-f11f-424a-bd46-164029481a60, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=d5be979e-f11f-424a-bd46-164029481a60,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102479) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 04:59:12.729803 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:12.739983 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-040578db-6b20-4246-aaa2-57b469965123 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750577486812'] for network, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:12.751503 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-1567bb07-9fe4-44fa-914a-d1e33698c6b6 service neutron] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102476) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 24 04:59:12.753518 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-1567bb07-9fe4-44fa-914a-d1e33698c6b6 service neutron] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1560409 Dec 24 04:59:12.780078 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df6d16a9-c38b-446e-b8db-6c8d3db70897 None None] Pushing event updated for resources: {'Port': ['ID=d5be979e-f11f-424a-bd46-164029481a60,revision_number=2']} {{(pid=102479) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:12.800180 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [None req-0c77414f-0946-4a8c-92cf-867d9bb461ce admin admin] Allocated IP 172.20.0.1 (c908572e-3b6b-470c-8b88-35b51f1472c6/699b398d-7f9d-4acb-bc18-ac32f35377c3/3e72624e-ab22-45c6-b262-91a63ca05279) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 04:59:12.804116 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df6d16a9-c38b-446e-b8db-6c8d3db70897 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:12.804623 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df6d16a9-c38b-446e-b8db-6c8d3db70897 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:12.804991 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df6d16a9-c38b-446e-b8db-6c8d3db70897 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:12.805363 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df6d16a9-c38b-446e-b8db-6c8d3db70897 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:12.807686 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df6d16a9-c38b-446e-b8db-6c8d3db70897 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:12.808086 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df6d16a9-c38b-446e-b8db-6c8d3db70897 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:12.808427 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df6d16a9-c38b-446e-b8db-6c8d3db70897 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:12.808791 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df6d16a9-c38b-446e-b8db-6c8d3db70897 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:12.809125 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df6d16a9-c38b-446e-b8db-6c8d3db70897 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:12.809478 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df6d16a9-c38b-446e-b8db-6c8d3db70897 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:12.809804 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df6d16a9-c38b-446e-b8db-6c8d3db70897 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:12.810130 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df6d16a9-c38b-446e-b8db-6c8d3db70897 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:12.810454 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df6d16a9-c38b-446e-b8db-6c8d3db70897 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df6d16a9-c38b-446e-b8db-6c8d3db70897 None None] Tracked resource versions report: Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: pushed versions: Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: { 'AddressGroup': {'1.2'}, Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: 'ConntrackHelper': {'1.0'}, Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: 'LocalIPAssociation': {'1.0'}, Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: 'Log': {'1.0'}, Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: 'Network': {'1.1'}, Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: 'Port': {'1.7'}, Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: 'PortForwarding': {'1.2'}, Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: 'QosPolicy': {'1.10'}, Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: 'SecurityGroup': {'1.5'}, Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: 'SecurityGroupRule': {'1.2'}, Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: 'SubPort': {'1.0'}, Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: 'Subnet': {'1.1'}, Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: 'Trunk': {'1.1'}} Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: consumer versions: Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: { DHCP agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: HyperV agent@hv-cinder-81644: {}, Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: L3 agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: Metadata agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: Metering agent@dv-cinder-816443-2-iscsi: {}, Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: Open vSwitch agent@dv-cinder-816443-2-iscsi: { 'AddressGroup': '1.2', Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: 'ConntrackHelper': '1.0', Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: 'LocalIPAssociation': '1.0', Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: 'Log': '1.0', Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: 'Network': '1.1', Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: 'Port': '1.7', Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: 'PortForwarding': '1.2', Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: 'QosPolicy': '1.10', Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: 'SecurityGroup': '1.5', Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: 'SecurityGroupRule': '1.2', Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: 'SubPort': '1.0', Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: 'Subnet': '1.1', Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: 'Trunk': '1.1'}} Dec 24 04:59:12.811596 dv-cinder-816443-2-iscsi neutron-server[102479]: {{(pid=102479) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 24 04:59:12.871300 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] Routers {'d1392df8-0562-4659-9906-2d085b726626'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 04:59:12.877208 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T04:58:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['d1392df8-0562-4659-9906-2d085b726626'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:59:12.941161 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df6d16a9-c38b-446e-b8db-6c8d3db70897 None None] Pushing event updated for resources: {'Port': ['ID=d5be979e-f11f-424a-bd46-164029481a60,revision_number=3']} {{(pid=102479) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:12.997627 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-040578db-6b20-4246-aaa2-57b469965123 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for network, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:12.998778 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-040578db-6b20-4246-aaa2-57b469965123 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:12.999511 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-040578db-6b20-4246-aaa2-57b469965123 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:13.048287 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-040578db-6b20-4246-aaa2-57b469965123 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 1.4918842 Dec 24 04:59:13.048873 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 51218) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:13.069908 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-dff67055-1ba6-4a53-bfa4-eaf737c3d4a4 admin admin] Request body: {'subnet': {'network_id': 'f60e9f58-510e-4be7-a2c1-9a2cee474737', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1771882864-subnet', 'tenant_id': 'e58266cfa29a4eb9bcff4786a5161fac', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:13.131642 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-6e282e64-459f-4f32-94f6-d86ab93ee4a2 service neutron] 10.222.0.43 "GET /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3565407 Dec 24 04:59:13.135053 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b7102345-9721-4b08-8250-4753be7b4752 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:13.202928 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] Set router d1392df8-0562-4659-9906-2d085b726626 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 04:59:13.222079 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dff67055-1ba6-4a53-bfa4-eaf737c3d4a4 admin admin] Made reservation on behalf of e58266cfa29a4eb9bcff4786a5161fac for: {'subnet': 1} {{(pid=102477) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:59:13.224355 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-dff67055-1ba6-4a53-bfa4-eaf737c3d4a4 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:13.240195 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-040578db-6b20-4246-aaa2-57b469965123 admin admin] Pushing event updated for resources: {'Network': ['ID=f60e9f58-510e-4be7-a2c1-9a2cee474737,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:13.254050 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Network f60e9f58-510e-4be7-a2c1-9a2cee474737 details requested by agent ovs-agent-dv-cinder-816443-2-iscsi with host dv-cinder-816443-2-iscsi {{(pid=102478) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 24 04:59:13.407877 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6429bf9b-47e0-4aeb-8e74-a88f292f28bf req-22388345-dec1-4063-917e-48b3ed3fd7b9 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 210 time: 0.2230778 Dec 24 04:59:13.418302 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0c77414f-0946-4a8c-92cf-867d9bb461ce admin admin] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:13.467769 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-dff67055-1ba6-4a53-bfa4-eaf737c3d4a4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for subnet, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:13.501201 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-e7d67cd6-ac29-4caa-9876-3038be1e6aaf service neutron] 10.222.0.43 "GET /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3051603 Dec 24 04:59:13.555780 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0c77414f-0946-4a8c-92cf-867d9bb461ce admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:13.592146 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1392df8-0562-4659-9906-2d085b726626', 'name': 'tempest-AttachVolumeShelveTestJSON-634320677-router', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148'}], 'enable_snat': True}, 'gw_port_id': 'd5be979e-f11f-424a-bd46-164029481a60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:06Z', 'updated_at': '2021-12-24T04:59:09Z', 'revision_number': 3, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'gw_port': {'id': 'd5be979e-f11f-424a-bd46-164029481a60', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:30:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:07Z', 'updated_at': '2021-12-24T04:59:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:59:13.608069 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c77414f-0946-4a8c-92cf-867d9bb461ce admin admin] Pushing event updated for resources: {'Port': ['ID=3e72624e-ab22-45c6-b262-91a63ca05279,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:13.629418 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dff67055-1ba6-4a53-bfa4-eaf737c3d4a4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6c0175cc-a9d7-49fb-8754-1dd383284ca1,revision_number=0']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:13.632127 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c77414f-0946-4a8c-92cf-867d9bb461ce admin admin] Network c908572e-3b6b-470c-8b88-35b51f1472c6 is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 04:59:13.633850 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-0c77414f-0946-4a8c-92cf-867d9bb461ce admin admin] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:59:13.644977 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dff67055-1ba6-4a53-bfa4-eaf737c3d4a4 admin admin] Checking segment: {'id': '687a836c-495c-4f34-80ed-10af75e46a33', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'f60e9f58-510e-4be7-a2c1-9a2cee474737'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102477) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:59:13.645334 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dff67055-1ba6-4a53-bfa4-eaf737c3d4a4 admin admin] Network hostable DHCP agents. Network: f60e9f58-510e-4be7-a2c1-9a2cee474737, hostable agents: ['01bc2530-0600-4d1b-b486-2fd9d63a2d51'], hosted agents: [] {{(pid=102477) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 24 04:59:13.646006 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c77414f-0946-4a8c-92cf-867d9bb461ce admin admin] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 04:59:13.651229 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0c77414f-0946-4a8c-92cf-867d9bb461ce admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-545913'] for router_interface, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:13.717376 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0459263-1fa3-4435-9c0f-d8b790a52c0d None None] The sync data for ids ['d1392df8-0562-4659-9906-2d085b726626'] in dv-cinder-816443-2-iscsi is: [{'id': 'd1392df8-0562-4659-9906-2d085b726626', 'name': 'tempest-AttachVolumeShelveTestJSON-634320677-router', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148'}], 'enable_snat': True}, 'gw_port_id': 'd5be979e-f11f-424a-bd46-164029481a60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:06Z', 'updated_at': '2021-12-24T04:59:09Z', 'revision_number': 3, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'gw_port': {'id': 'd5be979e-f11f-424a-bd46-164029481a60', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:30:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:07Z', 'updated_at': '2021-12-24T04:59:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}] {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 04:59:13.727691 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dff67055-1ba6-4a53-bfa4-eaf737c3d4a4 admin admin] Network f60e9f58-510e-4be7-a2c1-9a2cee474737 is scheduled to be hosted by DHCP agent 01bc2530-0600-4d1b-b486-2fd9d63a2d51 with binding_index 1 {{(pid=102477) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 24 04:59:13.769363 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b7102345-9721-4b08-8250-4753be7b4752 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-546295', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-545958'] for router, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:13.774459 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-dff67055-1ba6-4a53-bfa4-eaf737c3d4a4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816443-2-iscsi, f60e9f58-510e-4be7-a2c1-9a2cee474737) {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:59:13.794742 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dff67055-1ba6-4a53-bfa4-eaf737c3d4a4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:13.795371 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-dff67055-1ba6-4a53-bfa4-eaf737c3d4a4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:13.815982 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dadae3d9-d4f5-478a-ac05-4649dc41024e None None] Network f60e9f58-510e-4be7-a2c1-9a2cee474737 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 04:59:13.889005 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-dff67055-1ba6-4a53-bfa4-eaf737c3d4a4 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.8390193 Dec 24 04:59:14.147400 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b7102345-9721-4b08-8250-4753be7b4752 admin admin] Router 0dcd2bd7-b267-461d-9321-738fb26edb1d is scheduled to L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 with binding_index 1 {{(pid=102477) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 24 04:59:14.199631 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0c77414f-0946-4a8c-92cf-867d9bb461ce admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:14.358563 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-97a51388-377d-42a8-aa42-193a88f71a64 req-875de4bb-9bd7-408b-9183-d0a7387c5d60 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 210 time: 0.3148382 Dec 24 04:59:14.361958 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 51278) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:14.363348 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-06eb06d7-59ce-4ce7-8102-9c887b425b06 None None] Provisioning complete for port 3e72624e-ab22-45c6-b262-91a63ca05279 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:59:14.363816 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-06eb06d7-59ce-4ce7-8102-9c887b425b06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:14.441630 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_v2 [None req-a3f8a365-7c21-4269-9539-baf45de16cf1 admin admin] Deleting subnet aff17713-11e2-42bd-a296-04f827a91e1d {{(pid=102476) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Dec 24 04:59:14.449633 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a3f8a365-7c21-4269-9539-baf45de16cf1 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:14.461194 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-06eb06d7-59ce-4ce7-8102-9c887b425b06 None None] Port 3e72624e-ab22-45c6-b262-91a63ca05279 cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 04:59:14.536201 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65eac5dd-2561-4479-a24e-aaae53dd12b5 None None] Network f60e9f58-510e-4be7-a2c1-9a2cee474737 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 04:59:14.590628 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a3f8a365-7c21-4269-9539-baf45de16cf1 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:14.638007 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a3f8a365-7c21-4269-9539-baf45de16cf1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3590439'] for subnet, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:14.753527 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b7102345-9721-4b08-8250-4753be7b4752 admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102477) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 04:59:14.763260 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device d5be979e-f11f-424a-bd46-164029481a60 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 04:59:14.767263 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] Sync routers for ids ['0dcd2bd7-b267-461d-9321-738fb26edb1d'] in dv-cinder-816443-2-iscsi {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 04:59:14.807560 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1328bffc-fa77-4b38-8c78-492ff2e66d99 req-14b10c73-088a-4151-ace8-46198e7f3b49 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 210 time: 0.0427494 Dec 24 04:59:14.832307 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] Routers {'0dcd2bd7-b267-461d-9321-738fb26edb1d'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 04:59:14.833310 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T04:58:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['0dcd2bd7-b267-461d-9321-738fb26edb1d'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:59:14.862479 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b7102345-9721-4b08-8250-4753be7b4752 admin admin] Publish callbacks [] for router, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:14.867422 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-b7102345-9721-4b08-8250-4753be7b4752 admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 4.8998272 Dec 24 04:59:14.867422 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 51314) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:14.917142 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a3f8a365-7c21-4269-9539-baf45de16cf1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3590440', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for subnet, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:14.994537 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0c77414f-0946-4a8c-92cf-867d9bb461ce admin admin] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:14.996356 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3f8a365-7c21-4269-9539-baf45de16cf1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=aff17713-11e2-42bd-a296-04f827a91e1d,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:15.002040 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a3f8a365-7c21-4269-9539-baf45de16cf1 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:15.006380 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-a3f8a365-7c21-4269-9539-baf45de16cf1 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/aff17713-11e2-42bd-a296-04f827a91e1d HTTP/1.1" status: 204 len: 168 time: 0.6431053 Dec 24 04:59:15.010433 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0c77414f-0946-4a8c-92cf-867d9bb461ce admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:15.014773 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0c77414f-0946-4a8c-92cf-867d9bb461ce admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-627486', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-548585'] for router_interface, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:15.017409 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 51326) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:15.133645 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port d5be979e-f11f-424a-bd46-164029481a60 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:59:15.134246 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:15.247815 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] Set router 0dcd2bd7-b267-461d-9321-738fb26edb1d gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 04:59:15.303076 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3741433'] for network, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:15.319858 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c77414f-0946-4a8c-92cf-867d9bb461ce admin admin] Pushing event updated for resources: {'Port': ['ID=3e72624e-ab22-45c6-b262-91a63ca05279,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:15.547932 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:15.548621 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3595960', 'neutron.services.segments.db._delete_segments_for_network-8750577966942'] for network, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:15.600099 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] For port d5be979e-f11f-424a-bd46-164029481a60, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=d5be979e-f11f-424a-bd46-164029481a60,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 04:59:15.612693 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:15.658120 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-872302a7-9524-48ae-92ae-4ba41b208ed7 req-73010258-06d5-4b14-99f3-f1dd50587ec3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 210 time: 0.0452731 Dec 24 04:59:15.705527 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0dcd2bd7-b267-461d-9321-738fb26edb1d', 'name': 'tempest-ServerRescueNegativeTestJSON-561074829-router', 'tenant_id': '1b651e55b1a349a0b9582c526d3b5d67', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.96'}], 'enable_snat': True}, 'gw_port_id': '1e3aad5b-d728-4cff-9337-8dd407616d35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:10Z', 'updated_at': '2021-12-24T04:59:12Z', 'revision_number': 3, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'gw_port': {'id': '1e3aad5b-d728-4cff-9337-8dd407616d35', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:3e:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0dcd2bd7-b267-461d-9321-738fb26edb1d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:11Z', 'updated_at': '2021-12-24T04:59:11Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:59:15.740104 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Pushing event updated for resources: {'Port': ['ID=d5be979e-f11f-424a-bd46-164029481a60,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:15.742824 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] Checking router: 0dcd2bd7-b267-461d-9321-738fb26edb1d for host: dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 04:59:15.743175 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] Updating router 0dcd2bd7-b267-461d-9321-738fb26edb1d port 1e3aad5b-d728-4cff-9337-8dd407616d35 binding host dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 24 04:59:15.751090 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c77414f-0946-4a8c-92cf-867d9bb461ce admin admin] Network c908572e-3b6b-470c-8b88-35b51f1472c6 is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 04:59:15.752814 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-0c77414f-0946-4a8c-92cf-867d9bb461ce admin admin] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:59:15.762334 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=102476) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:59:15.762771 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=102476) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:59:15.763570 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102476) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:59:15.764003 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] Subscribe: > port after_create 55550000 {{(pid=102476) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:59:15.764510 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] Subscribe: > port after_delete 55550000 {{(pid=102476) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:59:15.764810 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] Subscribe: > port after_update 55550000 {{(pid=102476) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:59:15.765191 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=102476) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:59:15.765575 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102476) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:59:15.765952 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102476) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:59:15.766379 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=102476) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:59:15.786013 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:15.793088 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 51352) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:15.829841 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2049ccb2-6ca0-4ad5-92e7-8056e274b6c8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:15.992732 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b96be2a0-b555-4a06-8ead-c65cdf4afd50 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.150955 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] Publish callbacks [] for port, precommit_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.155150 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-a2b0627c-c2b8-423d-af68-ae315416765c None None] Provisioning complete for port 3e72624e-ab22-45c6-b262-91a63ca05279 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:59:16.155513 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-a2b0627c-c2b8-423d-af68-ae315416765c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.161046 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.167018 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102476) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:59:16.167404 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102476) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:59:16.167740 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=102476) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:59:16.168068 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=102476) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 04:59:16.168463 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8f425b2b-ba49-498c-b91b-c8557f14aee1']}} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:59:16.168620 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.db_base_plugin_common [None req-2049ccb2-6ca0-4ad5-92e7-8056e274b6c8 admin admin] Allocated IP 172.20.0.1 (0d368baa-5733-40a7-b836-139a541f4ebb/88f274d6-bcf0-47e8-9f0a-783a53214be4/e2f138ca-5e6c-4ae5-883d-02357c2bbbd2) {{(pid=102477) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 04:59:16.203872 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cd1116f8-f0f7-4ee1-ae80-2d8438da195a') {'for_net_delete': True} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:59:16.204444 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cd1116f8-f0f7-4ee1-ae80-2d8438da195a') {} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:59:16.221212 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b96be2a0-b555-4a06-8ead-c65cdf4afd50 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.232832 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b96be2a0-b555-4a06-8ead-c65cdf4afd50 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.268486 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-745cbba2-75f8-4d93-af52-82582123af3d req-54a8feca-b201-4b5a-a80c-9b90e0e928cc tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 210 time: 0.0928483 Dec 24 04:59:16.279819 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750577970535', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-32509733'] for segment, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.284723 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-a2b0627c-c2b8-423d-af68-ae315416765c None None] Port 3e72624e-ab22-45c6-b262-91a63ca05279 cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 04:59:16.293475 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] Attempting to bind port 1e3aad5b-d728-4cff-9337-8dd407616d35 on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 04:59:16.294068 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] Attempting to bind port 1e3aad5b-d728-4cff-9337-8dd407616d35 by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 04:59:16.294468 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] Attempting to bind port 1e3aad5b-d728-4cff-9337-8dd407616d35 on network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 04:59:16.297838 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f416524-0c20-480b-8b17-c0142cd619bd None None] Pushing event updated for resources: {'Port': ['ID=1e3aad5b-d728-4cff-9337-8dd407616d35,revision_number=2']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:16.304336 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 4, 58, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 04:59:16.305426 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] Checking segment: {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102478) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:59:16.306020 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.306603 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] Bound using segment: {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 04:59:16.307263 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] Bound port: 1e3aad5b-d728-4cff-9337-8dd407616d35, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 04:59:16.307858 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.319610 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b96be2a0-b555-4a06-8ead-c65cdf4afd50 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=779927b8-02f7-414b-a196-b05a6600342e,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:16.326563 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.339576 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-b96be2a0-b555-4a06-8ead-c65cdf4afd50 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=ce275b31fb3c485b97d01509c24c3c58&name=default HTTP/1.1" status: 200 len: 2992 time: 0.5453410 Dec 24 04:59:16.342543 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 51364) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:16.373222 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] Releasing vlan 138 on physical network physnet1 to pool {{(pid=102476) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 24 04:59:16.373520 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-32528320'] for segment, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: from cryptography.utils import int_from_bytes Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: from cryptography.utils import int_from_bytes Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: Traceback (most recent call last): Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: timer() Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: cb(*args, **kw) Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: return func(*args, **kwargs) Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: self._notify() Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: self.callback(batched_events) Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: event.method(event) Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: aggregate_uuid = self.p_client.list_aggregates( Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: return f(self, *a, **k) Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: return self._get(url).json() Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: return self.request(url, 'GET', **kwargs) Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: base_url = self.get_endpoint(auth, allow=allow, Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 24 04:59:16.378264 dv-cinder-816443-2-iscsi neutron-server[102476]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 24 04:59:16.382784 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] For port 1e3aad5b-d728-4cff-9337-8dd407616d35, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102478) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 04:59:16.386322 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] For port 1e3aad5b-d728-4cff-9337-8dd407616d35, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=1e3aad5b-d728-4cff-9337-8dd407616d35,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102478) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 04:59:16.390730 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.401319 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2049ccb2-6ca0-4ad5-92e7-8056e274b6c8 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.425911 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-18b1fe24-cb97-4878-b31c-b867c2ae6978 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.448883 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-18b1fe24-cb97-4878-b31c-b867c2ae6978 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.455722 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3595937', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-546046'] for network, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.456164 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] Routers {'0dcd2bd7-b267-461d-9321-738fb26edb1d'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 04:59:16.456990 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T04:58:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['0dcd2bd7-b267-461d-9321-738fb26edb1d'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:59:16.465806 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.469983 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] 10.222.0.43 "DELETE /v2.0/networks/8f425b2b-ba49-498c-b91b-c8557f14aee1 HTTP/1.1" status: 204 len: 168 time: 1.4465330 Dec 24 04:59:16.473858 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0c77414f-0946-4a8c-92cf-867d9bb461ce admin admin] Router d1392df8-0562-4659-9906-2d085b726626 has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102476) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 04:59:16.476478 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 51366) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:16.495345 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f416524-0c20-480b-8b17-c0142cd619bd None None] Pushing event updated for resources: {'Port': ['ID=1e3aad5b-d728-4cff-9337-8dd407616d35,revision_number=3']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:16.518091 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2049ccb2-6ca0-4ad5-92e7-8056e274b6c8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001'] for port, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.519279 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5a3ea3e-5756-4e24-8ceb-c8eba961ad34 admin admin] Pushing event deleted for resources: {'Network': ['ID=8f425b2b-ba49-498c-b91b-c8557f14aee1,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:16.572432 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2049ccb2-6ca0-4ad5-92e7-8056e274b6c8 admin admin] Network 0d368baa-5733-40a7-b836-139a541f4ebb is already hosted by enough agents. {{(pid=102477) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 04:59:16.572836 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] Set router 0dcd2bd7-b267-461d-9321-738fb26edb1d gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 04:59:16.575724 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-18b1fe24-cb97-4878-b31c-b867c2ae6978 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.578366 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-18b1fe24-cb97-4878-b31c-b867c2ae6978 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.579855 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-18b1fe24-cb97-4878-b31c-b867c2ae6978 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/779927b8-02f7-414b-a196-b05a6600342e HTTP/1.1" status: 204 len: 168 time: 0.2362423 Dec 24 04:59:16.585229 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_v2 [None req-a0d6e02d-7218-4df7-a8e1-fc91edde64e9 admin admin] Deleting subnet 6c0175cc-a9d7-49fb-8754-1dd383284ca1 {{(pid=102476) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Dec 24 04:59:16.590935 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a0d6e02d-7218-4df7-a8e1-fc91edde64e9 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.597536 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-2049ccb2-6ca0-4ad5-92e7-8056e274b6c8 admin admin] Resources bound (agent type, host, resource id): {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:59:16.617227 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18b1fe24-cb97-4878-b31c-b867c2ae6978 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=779927b8-02f7-414b-a196-b05a6600342e,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:16.623845 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2049ccb2-6ca0-4ad5-92e7-8056e274b6c8 admin admin] Pushing event updated for resources: {'Port': ['ID=e2f138ca-5e6c-4ae5-883d-02357c2bbbd2,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:16.628373 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2049ccb2-6ca0-4ad5-92e7-8056e274b6c8 admin admin] Received port after_create {{(pid=102477) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 04:59:16.629533 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2049ccb2-6ca0-4ad5-92e7-8056e274b6c8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-545913'] for router_interface, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.678322 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a0d6e02d-7218-4df7-a8e1-fc91edde64e9 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-32509714'] for subnet, precommit_delete_associations {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.688491 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device d5be979e-f11f-424a-bd46-164029481a60 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 04:59:16.771585 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0c77414f-0946-4a8c-92cf-867d9bb461ce admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 04:59:16.785537 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d972251-bc31-440a-be64-7d157bca876b None None] Sync routers for ids ['d1392df8-0562-4659-9906-2d085b726626'] in dv-cinder-816443-2-iscsi {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 04:59:16.802765 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a0d6e02d-7218-4df7-a8e1-fc91edde64e9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3590439'] for subnet, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.804762 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d972251-bc31-440a-be64-7d157bca876b None None] Routers {'d1392df8-0562-4659-9906-2d085b726626'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 04:59:16.808151 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-1d972251-bc31-440a-be64-7d157bca876b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T04:58:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['d1392df8-0562-4659-9906-2d085b726626'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:59:16.844146 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f9cd10e3-f2b9-4205-aef7-303d4135ff05 req-21348634-f0e9-4785-b8f2-8f4ae209bcd1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 210 time: 0.0512147 Dec 24 04:59:16.876057 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-0c77414f-0946-4a8c-92cf-867d9bb461ce admin admin] 10.222.0.43 "PUT /v2.0/routers/d1392df8-0562-4659-9906-2d085b726626/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.5199842 Dec 24 04:59:16.888873 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a0d6e02d-7218-4df7-a8e1-fc91edde64e9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3590440', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-32528482', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-32970397'] for subnet, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.920655 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0d6e02d-7218-4df7-a8e1-fc91edde64e9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6c0175cc-a9d7-49fb-8754-1dd383284ca1,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:16.930271 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a0d6e02d-7218-4df7-a8e1-fc91edde64e9 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:16.937532 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-a0d6e02d-7218-4df7-a8e1-fc91edde64e9 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/6c0175cc-a9d7-49fb-8754-1dd383284ca1 HTTP/1.1" status: 204 len: 168 time: 0.4591970 Dec 24 04:59:16.940350 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 51380) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:17.009180 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port d5be979e-f11f-424a-bd46-164029481a60 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:59:17.009547 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:17.052359 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7596c9f6-e709-49c4-8d48-fc261086eaf5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3741433'] for network, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:17.086964 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2049ccb2-6ca0-4ad5-92e7-8056e274b6c8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:17.102085 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-1d972251-bc31-440a-be64-7d157bca876b None None] Set router d1392df8-0562-4659-9906-2d085b726626 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 04:59:17.127357 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0dcd2bd7-b267-461d-9321-738fb26edb1d', 'name': 'tempest-ServerRescueNegativeTestJSON-561074829-router', 'tenant_id': '1b651e55b1a349a0b9582c526d3b5d67', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.96'}], 'enable_snat': True}, 'gw_port_id': '1e3aad5b-d728-4cff-9337-8dd407616d35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:10Z', 'updated_at': '2021-12-24T04:59:12Z', 'revision_number': 3, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'gw_port': {'id': '1e3aad5b-d728-4cff-9337-8dd407616d35', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:3e:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0dcd2bd7-b267-461d-9321-738fb26edb1d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:11Z', 'updated_at': '2021-12-24T04:59:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:59:17.156614 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0398612-6123-4494-8df2-0fc4c77727a1 None None] The sync data for ids ['0dcd2bd7-b267-461d-9321-738fb26edb1d'] in dv-cinder-816443-2-iscsi is: [{'id': '0dcd2bd7-b267-461d-9321-738fb26edb1d', 'name': 'tempest-ServerRescueNegativeTestJSON-561074829-router', 'tenant_id': '1b651e55b1a349a0b9582c526d3b5d67', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.96'}], 'enable_snat': True}, 'gw_port_id': '1e3aad5b-d728-4cff-9337-8dd407616d35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:10Z', 'updated_at': '2021-12-24T04:59:12Z', 'revision_number': 3, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'gw_port': {'id': '1e3aad5b-d728-4cff-9337-8dd407616d35', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:3e:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0dcd2bd7-b267-461d-9321-738fb26edb1d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:11Z', 'updated_at': '2021-12-24T04:59:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}] {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 04:59:17.168845 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 51386) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:17.177252 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7596c9f6-e709-49c4-8d48-fc261086eaf5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3595960', 'neutron.services.segments.db._delete_segments_for_network-8750577966942'] for network, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:17.193667 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ef4d0013-2449-4627-a73e-639be9c31420 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:17.295413 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ef4d0013-2449-4627-a73e-639be9c31420 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:17.300021 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-7596c9f6-e709-49c4-8d48-fc261086eaf5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f60e9f58-510e-4be7-a2c1-9a2cee474737']}} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:59:17.324115 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-7596c9f6-e709-49c4-8d48-fc261086eaf5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '687a836c-495c-4f34-80ed-10af75e46a33') {'for_net_delete': True} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:59:17.324271 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-7596c9f6-e709-49c4-8d48-fc261086eaf5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '687a836c-495c-4f34-80ed-10af75e46a33') {} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:59:17.344849 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7596c9f6-e709-49c4-8d48-fc261086eaf5 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750577970535', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-32509733'] for segment, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:17.360332 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7596c9f6-e709-49c4-8d48-fc261086eaf5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:17.367221 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7596c9f6-e709-49c4-8d48-fc261086eaf5 admin admin] Releasing vlan 134 on physical network physnet1 to pool {{(pid=102476) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 24 04:59:17.367639 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7596c9f6-e709-49c4-8d48-fc261086eaf5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-32528320'] for segment, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:17.401354 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ef4d0013-2449-4627-a73e-639be9c31420 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: Traceback (most recent call last): Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: timer() Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: cb(*args, **kw) Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: return func(*args, **kwargs) Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: self._notify() Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: self.callback(batched_events) Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: event.method(event) Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: aggregate_uuid = self.p_client.list_aggregates( Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: return f(self, *a, **k) Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: return self._get(url).json() Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: return self.request(url, 'GET', **kwargs) Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: base_url = self.get_endpoint(auth, allow=allow, Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 24 04:59:17.404891 dv-cinder-816443-2-iscsi neutron-server[102476]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 24 04:59:17.448470 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-1d972251-bc31-440a-be64-7d157bca876b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1392df8-0562-4659-9906-2d085b726626', 'name': 'tempest-AttachVolumeShelveTestJSON-634320677-router', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148'}], 'enable_snat': True}, 'gw_port_id': 'd5be979e-f11f-424a-bd46-164029481a60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:06Z', 'updated_at': '2021-12-24T04:59:13Z', 'revision_number': 4, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'gw_port': {'id': 'd5be979e-f11f-424a-bd46-164029481a60', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:30:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:07Z', 'updated_at': '2021-12-24T04:59:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '3e72624e-ab22-45c6-b262-91a63ca05279', 'name': '', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'mac_address': 'fa:16:3e:38:ea:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:12Z', 'updated_at': '2021-12-24T04:59:14Z', 'revision_number': 2, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'subnets': [{'id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:59:17.477574 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d972251-bc31-440a-be64-7d157bca876b None None] Checking router: d1392df8-0562-4659-9906-2d085b726626 for host: dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 04:59:17.477947 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d972251-bc31-440a-be64-7d157bca876b None None] Updating router d1392df8-0562-4659-9906-2d085b726626 port 3e72624e-ab22-45c6-b262-91a63ca05279 binding host dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 24 04:59:17.483585 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef4d0013-2449-4627-a73e-639be9c31420 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=54da22fd-e096-4ceb-ace2-938c15506b15,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:17.514055 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-1d972251-bc31-440a-be64-7d157bca876b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:17.544828 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-ef4d0013-2449-4627-a73e-639be9c31420 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=ae09310e88544d5595573c7cd859b803&name=default HTTP/1.1" status: 200 len: 2993 time: 0.3742354 Dec 24 04:59:17.549661 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 51398) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:17.553805 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-58c1de7b-18cd-4d47-aef1-33511df6f132 req-1bf9d6ff-5d92-4a84-a864-6dd1b87c9c15 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 210 time: 0.0670142 Dec 24 04:59:17.567414 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7596c9f6-e709-49c4-8d48-fc261086eaf5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3595937', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-546046'] for network, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:17.573485 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7596c9f6-e709-49c4-8d48-fc261086eaf5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:17.576593 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-7596c9f6-e709-49c4-8d48-fc261086eaf5 admin admin] 10.222.0.43 "DELETE /v2.0/networks/f60e9f58-510e-4be7-a2c1-9a2cee474737 HTTP/1.1" status: 204 len: 168 time: 0.6347167 Dec 24 04:59:17.615213 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7596c9f6-e709-49c4-8d48-fc261086eaf5 admin admin] Pushing event deleted for resources: {'Network': ['ID=f60e9f58-510e-4be7-a2c1-9a2cee474737,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:17.689910 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-884227b3-6dac-4509-ab02-8327a0b28a1d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:17.731640 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-884227b3-6dac-4509-ab02-8327a0b28a1d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:17.832293 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-884227b3-6dac-4509-ab02-8327a0b28a1d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:17.863679 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-884227b3-6dac-4509-ab02-8327a0b28a1d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:17.863679 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-884227b3-6dac-4509-ab02-8327a0b28a1d admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/54da22fd-e096-4ceb-ace2-938c15506b15 HTTP/1.1" status: 204 len: 168 time: 0.2894177 Dec 24 04:59:17.866298 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-884227b3-6dac-4509-ab02-8327a0b28a1d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=54da22fd-e096-4ceb-ace2-938c15506b15,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:17.914522 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 51406) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:17.935664 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2049ccb2-6ca0-4ad5-92e7-8056e274b6c8 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:17.943349 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2049ccb2-6ca0-4ad5-92e7-8056e274b6c8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:17.945060 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2049ccb2-6ca0-4ad5-92e7-8056e274b6c8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-627486', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-548585'] for router_interface, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:18.027071 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-6f5ecb21-39fe-4f4e-96da-c4187ae8f15c admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=e1b7efd121ac4cf9a0965e95479e8da8&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1086092 Dec 24 04:59:18.027660 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 51408) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:18.073012 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2049ccb2-6ca0-4ad5-92e7-8056e274b6c8 admin admin] Pushing event updated for resources: {'Port': ['ID=e2f138ca-5e6c-4ae5-883d-02357c2bbbd2,revision_number=2']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:18.175745 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7a9c29da-3fdf-48fd-a812-e9bb62767913 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:18.214293 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-014512ec-e276-4974-9ad7-8679aa7d5c92 req-e3da557e-31f9-43a7-9581-c5c6c1b701b0 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 210 time: 0.1456966 Dec 24 04:59:18.271435 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-1d972251-bc31-440a-be64-7d157bca876b None None] Publish callbacks [] for port, precommit_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:18.278712 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7a9c29da-3fdf-48fd-a812-e9bb62767913 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:18.290778 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-1d972251-bc31-440a-be64-7d157bca876b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:18.395209 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7a9c29da-3fdf-48fd-a812-e9bb62767913 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:18.398240 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7a9c29da-3fdf-48fd-a812-e9bb62767913 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:18.402723 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-7a9c29da-3fdf-48fd-a812-e9bb62767913 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/855f293c-d7d0-4e8b-891d-7183bf47a038 HTTP/1.1" status: 204 len: 168 time: 0.3741643 Dec 24 04:59:18.424818 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a9c29da-3fdf-48fd-a812-e9bb62767913 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=855f293c-d7d0-4e8b-891d-7183bf47a038,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:18.426990 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2049ccb2-6ca0-4ad5-92e7-8056e274b6c8 admin admin] Network 0d368baa-5733-40a7-b836-139a541f4ebb is already hosted by enough agents. {{(pid=102477) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 04:59:18.442140 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df9f384f-3e8a-44bf-961d-41248324150a None None] Pushing event updated for resources: {'Port': ['ID=3e72624e-ab22-45c6-b262-91a63ca05279,revision_number=3']} {{(pid=102479) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:18.450175 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-2049ccb2-6ca0-4ad5-92e7-8056e274b6c8 admin admin] Resources bound (agent type, host, resource id): {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:59:18.690168 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-1d972251-bc31-440a-be64-7d157bca876b None None] Attempting to bind port 3e72624e-ab22-45c6-b262-91a63ca05279 on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 04:59:18.691393 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-1d972251-bc31-440a-be64-7d157bca876b None None] Attempting to bind port 3e72624e-ab22-45c6-b262-91a63ca05279 by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': 'db374990-dadf-47a9-9824-44188ba20dd8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6'}] {{(pid=102479) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 04:59:18.692244 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d972251-bc31-440a-be64-7d157bca876b None None] Attempting to bind port 3e72624e-ab22-45c6-b262-91a63ca05279 on network c908572e-3b6b-470c-8b88-35b51f1472c6 {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 04:59:18.707823 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d972251-bc31-440a-be64-7d157bca876b None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 4, 58, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 04:59:18.708664 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d972251-bc31-440a-be64-7d157bca876b None None] Checking segment: {'id': 'db374990-dadf-47a9-9824-44188ba20dd8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102479) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:59:18.711172 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-1d972251-bc31-440a-be64-7d157bca876b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:18.712675 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1d972251-bc31-440a-be64-7d157bca876b None None] Bound using segment: {'id': 'db374990-dadf-47a9-9824-44188ba20dd8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6'} {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 04:59:18.714067 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-1d972251-bc31-440a-be64-7d157bca876b None None] Bound port: 3e72624e-ab22-45c6-b262-91a63ca05279, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'db374990-dadf-47a9-9824-44188ba20dd8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6'}}] {{(pid=102479) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 04:59:18.715133 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-1d972251-bc31-440a-be64-7d157bca876b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:18.792699 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2049ccb2-6ca0-4ad5-92e7-8056e274b6c8 admin admin] Router 0dcd2bd7-b267-461d-9321-738fb26edb1d has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102477) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 04:59:18.830762 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 1e3aad5b-d728-4cff-9337-8dd407616d35 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 04:59:18.948194 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.db [None req-1d972251-bc31-440a-be64-7d157bca876b None None] For port 3e72624e-ab22-45c6-b262-91a63ca05279, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102479) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 04:59:18.953054 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.db [None req-1d972251-bc31-440a-be64-7d157bca876b None None] For port 3e72624e-ab22-45c6-b262-91a63ca05279, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=3e72624e-ab22-45c6-b262-91a63ca05279,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102479) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 04:59:18.964571 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-1d972251-bc31-440a-be64-7d157bca876b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:18.974057 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 51434) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:18.974656 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 1e3aad5b-d728-4cff-9337-8dd407616d35 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:59:18.974941 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:18.978777 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-39c0bb12-04ce-4a73-be9d-3e9ffd1e311a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Request body: {'security_group': {'name': 'tempest-securitygroup--238748369', 'description': 'tempest-description--754673890'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:19.107963 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-39c0bb12-04ce-4a73-be9d-3e9ffd1e311a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:19.153194 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b886128b-cd26-46f5-83df-4fb29bc8e606 req-1dff50ad-2070-4824-8658-8f5eeb5338a2 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 210 time: 0.0877790 Dec 24 04:59:19.170850 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d972251-bc31-440a-be64-7d157bca876b None None] Routers {'d1392df8-0562-4659-9906-2d085b726626'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 04:59:19.171788 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-1d972251-bc31-440a-be64-7d157bca876b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T04:58:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['d1392df8-0562-4659-9906-2d085b726626'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:59:19.236564 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-83e545a1-5b90-425e-81b1-8e515fc3d804 None None] Provisioning complete for port 3e72624e-ab22-45c6-b262-91a63ca05279 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:59:19.236949 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-83e545a1-5b90-425e-81b1-8e515fc3d804 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:19.238098 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2049ccb2-6ca0-4ad5-92e7-8056e274b6c8 admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102477) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 04:59:19.263127 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-2049ccb2-6ca0-4ad5-92e7-8056e274b6c8 admin admin] 10.222.0.43 "PUT /v2.0/routers/0dcd2bd7-b267-461d-9321-738fb26edb1d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.3943262 Dec 24 04:59:19.386198 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-39c0bb12-04ce-4a73-be9d-3e9ffd1e311a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:19.393984 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-39c0bb12-04ce-4a73-be9d-3e9ffd1e311a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:19.400991 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.46', 62330) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:19.444587 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:19.455671 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 51452) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:19.493535 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-39c0bb12-04ce-4a73-be9d-3e9ffd1e311a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:19.498701 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-39c0bb12-04ce-4a73-be9d-3e9ffd1e311a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1795 time: 0.5248206 Dec 24 04:59:19.507275 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-1d972251-bc31-440a-be64-7d157bca876b None None] Set router d1392df8-0562-4659-9906-2d085b726626 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 04:59:19.508411 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 51458) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:19.515204 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] For port 1e3aad5b-d728-4cff-9337-8dd407616d35, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=1e3aad5b-d728-4cff-9337-8dd407616d35,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 04:59:19.533451 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-3bc947e0-d49f-4c9f-99a4-26140c42de7e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Request body: {'security_group_rule': {'security_group_id': '2b32cddf-29a8-4d82-a930-1f27033cc61f', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:19.551892 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:19.712492 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-48b2a25b-2268-4faf-8900-eb8ef35d553b admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=e58266cfa29a4eb9bcff4786a5161fac&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2414834 Dec 24 04:59:19.721922 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 51466) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:19.722972 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:19.758798 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c7f00023-8ff6-4aa6-b38a-95122b55c290 req-96864060-cb5f-4a6f-b104-c98409c0aafa tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 210 time: 0.3053277 Dec 24 04:59:19.780318 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39c0bb12-04ce-4a73-be9d-3e9ffd1e311a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2b32cddf-29a8-4d82-a930-1f27033cc61f,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:19.819108 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 51472) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:19.839720 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-83e545a1-5b90-425e-81b1-8e515fc3d804 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:19.857442 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df9f384f-3e8a-44bf-961d-41248324150a None None] Pushing event updated for resources: {'Port': ['ID=3e72624e-ab22-45c6-b262-91a63ca05279,revision_number=4']} {{(pid=102479) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:19.857701 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Pushing event updated for resources: {'Port': ['ID=1e3aad5b-d728-4cff-9337-8dd407616d35,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:19.889358 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2fdaed14-ca68-4a50-8640-680092782bee admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:19.921103 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-83e545a1-5b90-425e-81b1-8e515fc3d804 None None] For port 3e72624e-ab22-45c6-b262-91a63ca05279, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=3e72624e-ab22-45c6-b262-91a63ca05279,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 04:59:19.926020 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-3bc947e0-d49f-4c9f-99a4-26140c42de7e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:19.928835 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-83e545a1-5b90-425e-81b1-8e515fc3d804 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:20.002192 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-3bc947e0-d49f-4c9f-99a4-26140c42de7e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:20.009075 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-3bc947e0-d49f-4c9f-99a4-26140c42de7e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:20.024425 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-6b4a20c6-6f27-4aad-81a9-1a4461565812 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:20.025976 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-6b4a20c6-6f27-4aad-81a9-1a4461565812 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.46 "GET /v2.0/networks?id=598b6cd9-9673-4e27-b33e-451cd98b5f1c HTTP/1.1" status: 200 len: 812 time: 0.6237106 Dec 24 04:59:20.047643 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2fdaed14-ca68-4a50-8640-680092782bee admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:20.071380 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bc947e0-d49f-4c9f-99a4-26140c42de7e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bc20813c-d04c-4091-bd4b-c1fe21cb2baf,revision_number=0']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:20.075296 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-1d972251-bc31-440a-be64-7d157bca876b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1392df8-0562-4659-9906-2d085b726626', 'name': 'tempest-AttachVolumeShelveTestJSON-634320677-router', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148'}], 'enable_snat': True}, 'gw_port_id': 'd5be979e-f11f-424a-bd46-164029481a60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:06Z', 'updated_at': '2021-12-24T04:59:13Z', 'revision_number': 4, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'gw_port': {'id': 'd5be979e-f11f-424a-bd46-164029481a60', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:30:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:07Z', 'updated_at': '2021-12-24T04:59:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '3e72624e-ab22-45c6-b262-91a63ca05279', 'name': '', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'mac_address': 'fa:16:3e:38:ea:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:12Z', 'updated_at': '2021-12-24T04:59:18Z', 'revision_number': 4, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'subnets': [{'id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:59:20.094699 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-dffc3081-6478-4a91-8891-31be28ef6377 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:20.104670 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-3bc947e0-d49f-4c9f-99a4-26140c42de7e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:20.106956 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-3bc947e0-d49f-4c9f-99a4-26140c42de7e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5971875 Dec 24 04:59:20.119705 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 51496) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:20.128452 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-4d3e32b3-f828-4a8b-9015-19f5ce98fdc0 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Request body: {'port': {'device_id': 'de66f13f-d7ee-49ab-b071-e5b7acd3b2fe', 'network_id': '598b6cd9-9673-4e27-b33e-451cd98b5f1c', 'admin_state_up': True, 'tenant_id': '14dbe9b1ff9041858e25c4fafebc1a51'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:20.189174 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83e545a1-5b90-425e-81b1-8e515fc3d804 None None] Pushing event updated for resources: {'Port': ['ID=3e72624e-ab22-45c6-b262-91a63ca05279,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:20.194885 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-e672d743-44bf-410a-9372-4457d118e729 None None] Provisioning complete for port 3e72624e-ab22-45c6-b262-91a63ca05279 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:59:20.197288 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e672d743-44bf-410a-9372-4457d118e729 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:20.226224 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d972251-bc31-440a-be64-7d157bca876b None None] The sync data for ids ['d1392df8-0562-4659-9906-2d085b726626'] in dv-cinder-816443-2-iscsi is: [{'id': 'd1392df8-0562-4659-9906-2d085b726626', 'name': 'tempest-AttachVolumeShelveTestJSON-634320677-router', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148'}], 'enable_snat': True}, 'gw_port_id': 'd5be979e-f11f-424a-bd46-164029481a60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:06Z', 'updated_at': '2021-12-24T04:59:13Z', 'revision_number': 4, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'gw_port': {'id': 'd5be979e-f11f-424a-bd46-164029481a60', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:30:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:07Z', 'updated_at': '2021-12-24T04:59:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '3e72624e-ab22-45c6-b262-91a63ca05279', 'name': '', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'mac_address': 'fa:16:3e:38:ea:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:12Z', 'updated_at': '2021-12-24T04:59:18Z', 'revision_number': 4, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'subnets': [{'id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 04:59:20.351099 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-dffc3081-6478-4a91-8891-31be28ef6377 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:20.383618 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-dffc3081-6478-4a91-8891-31be28ef6377 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:20.472168 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-1c0e7d2d-f95c-45a8-99f8-abdb62616399 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Request body: {'security_group_rule': {'security_group_id': '2b32cddf-29a8-4d82-a930-1f27033cc61f', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:20.512795 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2ebe87b4-107f-4c21-9fec-53ce2cfd028f req-f83643ea-52fd-4b3d-9b80-5c413b138a7a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 210 time: 0.1290305 Dec 24 04:59:20.615395 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-dffc3081-6478-4a91-8891-31be28ef6377 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=1d8144fae2194b5e96dc3900a7f5a276&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7923510 Dec 24 04:59:20.617760 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dffc3081-6478-4a91-8891-31be28ef6377 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4532890c-94b4-48f1-b9ec-bfb39bef2d8e,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:20.620484 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 51532) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:20.745757 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e5c5ea85-cd14-478b-a5b5-e245f852a15e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:20.775010 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.46', 62336) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:20.869323 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e5c5ea85-cd14-478b-a5b5-e245f852a15e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:20.892040 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] Sync routers for ids ['0dcd2bd7-b267-461d-9321-738fb26edb1d'] in dv-cinder-816443-2-iscsi {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 04:59:20.940111 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] Routers {'0dcd2bd7-b267-461d-9321-738fb26edb1d'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 04:59:20.944516 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T04:58:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['0dcd2bd7-b267-461d-9321-738fb26edb1d'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:59:20.945460 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1c0e7d2d-f95c-45a8-99f8-abdb62616399 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:21.037972 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-4d3e32b3-f828-4a8b-9015-19f5ce98fdc0 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Made reservation on behalf of 14dbe9b1ff9041858e25c4fafebc1a51 for: {'port': 1} {{(pid=102477) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:59:21.042370 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-4d3e32b3-f828-4a8b-9015-19f5ce98fdc0 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:21.044489 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2fdaed14-ca68-4a50-8640-680092782bee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:21.047858 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2fdaed14-ca68-4a50-8640-680092782bee admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:21.049648 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-2fdaed14-ca68-4a50-8640-680092782bee admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/333cb746-4522-4307-b1e7-e151d109fffc HTTP/1.1" status: 204 len: 168 time: 1.3231330 Dec 24 04:59:21.087689 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-796e17c3-2b13-4c71-be29-5a20c9ee6a72 req-664253e9-f439-40b6-99bf-2f0fff8d7f33 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 210 time: 0.0839255 Dec 24 04:59:21.093261 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 1e3aad5b-d728-4cff-9337-8dd407616d35 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 04:59:21.141736 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-2b6f69c2-fc60-448a-bb5a-1504998dcad7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:21.144589 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-2b6f69c2-fc60-448a-bb5a-1504998dcad7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.46 "GET /v2.0/networks?id=b92a87f3-957a-4ccb-9b5b-98ad92aebe6e HTTP/1.1" status: 200 len: 815 time: 0.3676116 Dec 24 04:59:21.153654 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e5c5ea85-cd14-478b-a5b5-e245f852a15e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:21.160810 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e5c5ea85-cd14-478b-a5b5-e245f852a15e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:21.162863 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-e5c5ea85-cd14-478b-a5b5-e245f852a15e admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/4532890c-94b4-48f1-b9ec-bfb39bef2d8e HTTP/1.1" status: 204 len: 168 time: 0.5406010 Dec 24 04:59:21.171622 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-5234715b-e752-48a5-8872-42ca271076c1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Request body: {'port': {'device_id': '7c07c04e-36eb-4aa0-8a33-1c1424a2db2e', 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e', 'admin_state_up': True, 'tenant_id': '8f1c3a94f02049e3a76c4fc01fa7a022'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:21.185713 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e06507d6-4b16-4a58-b571-46613445ae79 req-199c1ea6-6b4a-4208-aaa0-a2c26d8d3813 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:21.187505 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e06507d6-4b16-4a58-b571-46613445ae79 req-199c1ea6-6b4a-4208-aaa0-a2c26d8d3813 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/networks?id=0d368baa-5733-40a7-b836-139a541f4ebb HTTP/1.1" status: 200 len: 818 time: 0.6262622 Dec 24 04:59:21.189648 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fdaed14-ca68-4a50-8640-680092782bee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=333cb746-4522-4307-b1e7-e151d109fffc,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:21.325160 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e06507d6-4b16-4a58-b571-46613445ae79 req-80b2c767-1fc8-4fcf-a2d6-279fd48f3467 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/quotas/1b651e55b1a349a0b9582c526d3b5d67 HTTP/1.1" status: 200 len: 375 time: 0.0941184 Dec 24 04:59:21.556952 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1c0e7d2d-f95c-45a8-99f8-abdb62616399 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:21.601096 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 1e3aad5b-d728-4cff-9337-8dd407616d35 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:59:21.609139 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:21.614602 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] Set router 0dcd2bd7-b267-461d-9321-738fb26edb1d gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 04:59:21.755835 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1c0e7d2d-f95c-45a8-99f8-abdb62616399 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:21.843710 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c0e7d2d-f95c-45a8-99f8-abdb62616399 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=17ce643e-7fbf-4d89-b96a-bb11e0a401ef,revision_number=0']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:21.921975 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5c5ea85-cd14-478b-a5b5-e245f852a15e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4532890c-94b4-48f1-b9ec-bfb39bef2d8e,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:21.998959 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-17fd7b2a-a48a-4b41-9b0e-871d574f5272 req-a8de2bc2-e6c5-4252-a194-946bb98024c6 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 210 time: 0.1367481 Dec 24 04:59:22.296903 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 3e72624e-ab22-45c6-b262-91a63ca05279 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 04:59:22.336838 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e06507d6-4b16-4a58-b571-46613445ae79 req-484f0328-1351-4326-a6b0-2d99c03fe10d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=1b651e55b1a349a0b9582c526d3b5d67&fields=id HTTP/1.1" status: 200 len: 255 time: 1.0047317 Dec 24 04:59:22.346326 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1c0e7d2d-f95c-45a8-99f8-abdb62616399 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:22.347084 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-76614315-6ece-48d4-a255-0b896749b97b req-83b6827f-85be-48e9-9324-84674238e950 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 210 time: 0.1131945 Dec 24 04:59:22.349145 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-1c0e7d2d-f95c-45a8-99f8-abdb62616399 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.8862748 Dec 24 04:59:22.354631 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 51588) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:22.389658 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-5234715b-e752-48a5-8872-42ca271076c1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Made reservation on behalf of 8f1c3a94f02049e3a76c4fc01fa7a022 for: {'port': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:59:22.398613 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-5234715b-e752-48a5-8872-42ca271076c1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:22.417398 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-426efa06-cbdc-44e5-8693-c3bf45d190d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Request body: {'floatingip': {'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:22.475984 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 3e72624e-ab22-45c6-b262-91a63ca05279 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:59:22.476558 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:22.606275 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0dcd2bd7-b267-461d-9321-738fb26edb1d', 'name': 'tempest-ServerRescueNegativeTestJSON-561074829-router', 'tenant_id': '1b651e55b1a349a0b9582c526d3b5d67', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.96'}], 'enable_snat': True}, 'gw_port_id': '1e3aad5b-d728-4cff-9337-8dd407616d35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:10Z', 'updated_at': '2021-12-24T04:59:16Z', 'revision_number': 4, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'gw_port': {'id': '1e3aad5b-d728-4cff-9337-8dd407616d35', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:3e:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0dcd2bd7-b267-461d-9321-738fb26edb1d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:11Z', 'updated_at': '2021-12-24T04:59:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': 'e2f138ca-5e6c-4ae5-883d-02357c2bbbd2', 'name': '', 'network_id': '0d368baa-5733-40a7-b836-139a541f4ebb', 'tenant_id': '1b651e55b1a349a0b9582c526d3b5d67', 'mac_address': 'fa:16:3e:ac:04:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0dcd2bd7-b267-461d-9321-738fb26edb1d', 'device_owner': 'network:router_interface', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '88f274d6-bcf0-47e8-9f0a-783a53214be4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:15Z', 'updated_at': '2021-12-24T04:59:17Z', 'revision_number': 2, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'subnets': [{'id': '88f274d6-bcf0-47e8-9f0a-783a53214be4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:59:22.681868 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] Checking router: 0dcd2bd7-b267-461d-9321-738fb26edb1d for host: dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 04:59:22.682399 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] Updating router 0dcd2bd7-b267-461d-9321-738fb26edb1d port e2f138ca-5e6c-4ae5-883d-02357c2bbbd2 binding host dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 24 04:59:22.726182 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:23.057032 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-5234715b-e752-48a5-8872-42ca271076c1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Allocated IP 172.20.0.11 (b92a87f3-957a-4ccb-9b5b-98ad92aebe6e/9b9ff65f-93c8-4cb1-8a99-961ba0d4beaa/50d50f46-e761-4fb1-9761-fa48778aa8aa) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 04:59:23.172513 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.db_base_plugin_common [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-4d3e32b3-f828-4a8b-9015-19f5ce98fdc0 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Allocated IP 172.20.0.5 (598b6cd9-9673-4e27-b33e-451cd98b5f1c/32199feb-6f3a-4642-a10b-5d278d90a9e5/c20bf82b-830b-4f29-b2bf-97f490cf78c9) {{(pid=102477) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 04:59:23.175925 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-426efa06-cbdc-44e5-8693-c3bf45d190d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for floatingip, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:23.220905 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e06507d6-4b16-4a58-b571-46613445ae79 req-9628d009-fef4-42e0-806c-da7efa9a5ea2 service neutron] 10.222.0.43 "GET /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7918816 Dec 24 04:59:23.232081 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5095b1d8-8b8d-4333-af30-7607583b5706 req-cda67593-407a-4315-a55c-ba93d07e1911 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 210 time: 0.1208632 Dec 24 04:59:23.265269 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-2dd4f9ed-3b23-4d60-a3f0-6a33910cb09c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:23.331817 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e06507d6-4b16-4a58-b571-46613445ae79 req-ed6e7820-3350-4140-a57b-24b2e8cf60fd service neutron] 10.222.0.43 "GET /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1095920 Dec 24 04:59:23.529273 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] Publish callbacks [] for port, precommit_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:23.543956 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:23.674883 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ea217fe3-04be-4d5a-bdf6-dd8c22005461 req-b512a9db-93a0-47e0-a2a7-96b680d577d2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 210 time: 0.1124616 Dec 24 04:59:23.701419 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-5234715b-e752-48a5-8872-42ca271076c1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:23.790742 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-5234715b-e752-48a5-8872-42ca271076c1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:23.835396 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-05790bee-616f-48f3-8da7-0582c20bf5cb req-65bd33be-e84d-4c68-8843-6de3eb55dbdf tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 210 time: 0.0840626 Dec 24 04:59:23.929523 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41af327a-579a-44d6-af59-f909d0d034ac None None] Pushing event updated for resources: {'Port': ['ID=e2f138ca-5e6c-4ae5-883d-02357c2bbbd2,revision_number=3']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:23.935918 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] Attempting to bind port e2f138ca-5e6c-4ae5-883d-02357c2bbbd2 on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 04:59:23.936312 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] Attempting to bind port e2f138ca-5e6c-4ae5-883d-02357c2bbbd2 by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': 'd94b0a1e-2098-4b10-9091-c566351ffe74', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '0d368baa-5733-40a7-b836-139a541f4ebb'}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 04:59:23.936705 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] Attempting to bind port e2f138ca-5e6c-4ae5-883d-02357c2bbbd2 on network 0d368baa-5733-40a7-b836-139a541f4ebb {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 04:59:23.942828 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 4, 58, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 04:59:23.943123 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] Checking segment: {'id': 'd94b0a1e-2098-4b10-9091-c566351ffe74', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '0d368baa-5733-40a7-b836-139a541f4ebb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102478) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:59:23.943529 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:23.943919 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] Bound using segment: {'id': 'd94b0a1e-2098-4b10-9091-c566351ffe74', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '0d368baa-5733-40a7-b836-139a541f4ebb'} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 04:59:23.944390 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] Bound port: e2f138ca-5e6c-4ae5-883d-02357c2bbbd2, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd94b0a1e-2098-4b10-9091-c566351ffe74', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '0d368baa-5733-40a7-b836-139a541f4ebb'}}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 04:59:23.944862 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:24.013584 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-4d3e32b3-f828-4a8b-9015-19f5ce98fdc0 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Publish callbacks [] for port, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:24.025841 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 51660) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:24.056438 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] For port e2f138ca-5e6c-4ae5-883d-02357c2bbbd2, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102478) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 04:59:24.062558 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] For port e2f138ca-5e6c-4ae5-883d-02357c2bbbd2, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=e2f138ca-5e6c-4ae5-883d-02357c2bbbd2,segment=NetworkSegment(d94b0a1e-2098-4b10-9091-c566351ffe74),segment_id=d94b0a1e-2098-4b10-9091-c566351ffe74)] {{(pid=102478) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 04:59:24.074730 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:24.078039 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-426efa06-cbdc-44e5-8693-c3bf45d190d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:24.158098 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-5234715b-e752-48a5-8872-42ca271076c1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Network b92a87f3-957a-4ccb-9b5b-98ad92aebe6e is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 04:59:24.173729 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-5234715b-e752-48a5-8872-42ca271076c1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:59:24.216035 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-5234715b-e752-48a5-8872-42ca271076c1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 04:59:24.288317 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] Routers {'0dcd2bd7-b267-461d-9321-738fb26edb1d'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 04:59:24.300394 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T04:58:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['0dcd2bd7-b267-461d-9321-738fb26edb1d'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:59:24.424714 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.db_base_plugin_common [None req-426efa06-cbdc-44e5-8693-c3bf45d190d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Allocated IP 172.27.1.63 (9b4e4b31-551f-45a9-b26a-cb44ee20a17d/f277b899-8779-420e-8a8d-bfcd5eb7f012/7c65a0bf-d44e-48c6-9c51-737e24aa3c52) {{(pid=102477) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 04:59:24.477232 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41af327a-579a-44d6-af59-f909d0d034ac None None] Pushing event updated for resources: {'Port': ['ID=e2f138ca-5e6c-4ae5-883d-02357c2bbbd2,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:24.534870 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5234715b-e752-48a5-8872-42ca271076c1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Pushing event updated for resources: {'Port': ['ID=50d50f46-e761-4fb1-9761-fa48778aa8aa,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:24.554921 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-426efa06-cbdc-44e5-8693-c3bf45d190d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for port, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:24.616676 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-426efa06-cbdc-44e5-8693-c3bf45d190d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001'] for port, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:24.651293 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7789d859-c4eb-4cc3-964f-83a21df7deca req-ea422136-58a7-454e-aa03-3493fe83889a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 210 time: 0.0580373 Dec 24 04:59:24.698580 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-426efa06-cbdc-44e5-8693-c3bf45d190d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d is already hosted by enough agents. {{(pid=102477) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 04:59:24.702969 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-426efa06-cbdc-44e5-8693-c3bf45d190d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Resources bound (agent type, host, resource id): {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:59:24.706281 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.l3_dvrscheduler_db [None req-426efa06-cbdc-44e5-8693-c3bf45d190d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Received port after_create {{(pid=102477) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 04:59:24.752390 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-5234715b-e752-48a5-8872-42ca271076c1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:24.761391 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-5234715b-e752-48a5-8872-42ca271076c1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:24.828842 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-426efa06-cbdc-44e5-8693-c3bf45d190d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:24.853783 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-4d3e32b3-f828-4a8b-9015-19f5ce98fdc0 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001'] for port, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:24.890861 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] Set router 0dcd2bd7-b267-461d-9321-738fb26edb1d gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 04:59:24.905090 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-426efa06-cbdc-44e5-8693-c3bf45d190d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Pushing event updated for resources: {'Port': ['ID=7c65a0bf-d44e-48c6-9c51-737e24aa3c52,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:25.061459 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-63a5560c-7377-4f56-90c8-feebc3a8ea90 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:25.063264 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-63a5560c-7377-4f56-90c8-feebc3a8ea90 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/networks?id=0d368baa-5733-40a7-b836-139a541f4ebb HTTP/1.1" status: 200 len: 818 time: 0.6316020 Dec 24 04:59:25.128565 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-b69c729d-c619-4320-b479-a14606717ef2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/quotas/1b651e55b1a349a0b9582c526d3b5d67 HTTP/1.1" status: 200 len: 375 time: 0.0536127 Dec 24 04:59:25.161044 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-5234715b-e752-48a5-8872-42ca271076c1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.46 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.9966650 Dec 24 04:59:25.205558 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1011ccf3-7efb-4d85-b9a5-ecf9d26fc632 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:25.278693 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-733df2c7-b728-4ae7-bb20-075081747dbf tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=1b651e55b1a349a0b9582c526d3b5d67&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1479342 Dec 24 04:59:25.377663 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-426efa06-cbdc-44e5-8693-c3bf45d190d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:25.518903 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-cd3674ff-0bb4-4976-9172-d55c0a840b00 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102476) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 24 04:59:25.520723 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-cd3674ff-0bb4-4976-9172-d55c0a840b00 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.46 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0184891 Dec 24 04:59:25.534626 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-7e71f258-96b1-401e-9df5-2f6c48b5e6bc service neutron] 10.222.0.43 "GET /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2543316 Dec 24 04:59:25.548835 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-5beca62a-4a8b-4974-8547-4766925c7f62 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:25.592482 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-4d3e32b3-f828-4a8b-9015-19f5ce98fdc0 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Network 598b6cd9-9673-4e27-b33e-451cd98b5f1c is already hosted by enough agents. {{(pid=102477) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 04:59:25.659260 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-4d3e32b3-f828-4a8b-9015-19f5ce98fdc0 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Resources bound (agent type, host, resource id): {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:59:25.669925 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.l3_dvrscheduler_db [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-4d3e32b3-f828-4a8b-9015-19f5ce98fdc0 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Received port after_create {{(pid=102477) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 04:59:25.677343 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-4d3e32b3-f828-4a8b-9015-19f5ce98fdc0 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:25.678301 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-4d3e32b3-f828-4a8b-9015-19f5ce98fdc0 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for port, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:25.682239 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d3e32b3-f828-4a8b-9015-19f5ce98fdc0 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Pushing event updated for resources: {'Port': ['ID=c20bf82b-830b-4f29-b2bf-97f490cf78c9,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:25.713210 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 51722) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:25.763160 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-4d3e32b3-f828-4a8b-9015-19f5ce98fdc0 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.46 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 5.6443548 Dec 24 04:59:25.799135 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0679074e-44c6-44da-a836-80fb01d00ae5 req-e644b7af-71d1-418a-bf2f-d63b5355929c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:25.801052 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0679074e-44c6-44da-a836-80fb01d00ae5 req-e644b7af-71d1-418a-bf2f-d63b5355929c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 932 time: 0.8039939 Dec 24 04:59:25.806715 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0dcd2bd7-b267-461d-9321-738fb26edb1d', 'name': 'tempest-ServerRescueNegativeTestJSON-561074829-router', 'tenant_id': '1b651e55b1a349a0b9582c526d3b5d67', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.96'}], 'enable_snat': True}, 'gw_port_id': '1e3aad5b-d728-4cff-9337-8dd407616d35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:10Z', 'updated_at': '2021-12-24T04:59:16Z', 'revision_number': 4, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'gw_port': {'id': '1e3aad5b-d728-4cff-9337-8dd407616d35', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:3e:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0dcd2bd7-b267-461d-9321-738fb26edb1d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:11Z', 'updated_at': '2021-12-24T04:59:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': 'e2f138ca-5e6c-4ae5-883d-02357c2bbbd2', 'name': '', 'network_id': '0d368baa-5733-40a7-b836-139a541f4ebb', 'tenant_id': '1b651e55b1a349a0b9582c526d3b5d67', 'mac_address': 'fa:16:3e:ac:04:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0dcd2bd7-b267-461d-9321-738fb26edb1d', 'device_owner': 'network:router_interface', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '88f274d6-bcf0-47e8-9f0a-783a53214be4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:15Z', 'updated_at': '2021-12-24T04:59:24Z', 'revision_number': 4, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'subnets': [{'id': '88f274d6-bcf0-47e8-9f0a-783a53214be4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 04:59:25.809156 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-3cc814fa-7577-4dd8-9efe-35be519ba355 service neutron] 10.222.0.43 "GET /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2690008 Dec 24 04:59:25.885058 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-426efa06-cbdc-44e5-8693-c3bf45d190d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for port, precommit_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:25.911029 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-426efa06-cbdc-44e5-8693-c3bf45d190d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:25.988886 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87ff4701-6767-4cc4-839b-d2f99ca7b5c4 None None] The sync data for ids ['0dcd2bd7-b267-461d-9321-738fb26edb1d'] in dv-cinder-816443-2-iscsi is: [{'id': '0dcd2bd7-b267-461d-9321-738fb26edb1d', 'name': 'tempest-ServerRescueNegativeTestJSON-561074829-router', 'tenant_id': '1b651e55b1a349a0b9582c526d3b5d67', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.96'}], 'enable_snat': True}, 'gw_port_id': '1e3aad5b-d728-4cff-9337-8dd407616d35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:10Z', 'updated_at': '2021-12-24T04:59:16Z', 'revision_number': 4, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'gw_port': {'id': '1e3aad5b-d728-4cff-9337-8dd407616d35', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:3e:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0dcd2bd7-b267-461d-9321-738fb26edb1d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:11Z', 'updated_at': '2021-12-24T04:59:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': 'e2f138ca-5e6c-4ae5-883d-02357c2bbbd2', 'name': '', 'network_id': '0d368baa-5733-40a7-b836-139a541f4ebb', 'tenant_id': '1b651e55b1a349a0b9582c526d3b5d67', 'mac_address': 'fa:16:3e:ac:04:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0dcd2bd7-b267-461d-9321-738fb26edb1d', 'device_owner': 'network:router_interface', 'standard_attr_id': 90, 'fixed_ips': [{'subnet_id': '88f274d6-bcf0-47e8-9f0a-783a53214be4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:15Z', 'updated_at': '2021-12-24T04:59:24Z', 'revision_number': 4, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'subnets': [{'id': '88f274d6-bcf0-47e8-9f0a-783a53214be4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 04:59:26.169741 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-55313505-039a-4c27-bbd7-df114ac16f93 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:26.198468 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-426efa06-cbdc-44e5-8693-c3bf45d190d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-545804'] for floatingip, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:26.302228 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce87ccd4-cb65-44fb-8c0a-d00ec00bcdf7 req-52fe93e5-e43b-4791-a4f3-1c972f98da6d tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:26.313269 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ce87ccd4-cb65-44fb-8c0a-d00ec00bcdf7 req-52fe93e5-e43b-4791-a4f3-1c972f98da6d tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 931 time: 0.1638179 Dec 24 04:59:26.338935 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1011ccf3-7efb-4d85-b9a5-ecf9d26fc632 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:26.424990 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-426efa06-cbdc-44e5-8693-c3bf45d190d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for floatingip, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:26.439426 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-426efa06-cbdc-44e5-8693-c3bf45d190d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 4.0272155 Dec 24 04:59:26.439426 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1011ccf3-7efb-4d85-b9a5-ecf9d26fc632 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:26.439898 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:26.451251 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0679074e-44c6-44da-a836-80fb01d00ae5 req-8b6a04f9-739a-43ea-92a0-502a6013720a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6340775 Dec 24 04:59:26.465337 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-426efa06-cbdc-44e5-8693-c3bf45d190d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Pushing event updated for resources: {'Port': ['ID=7c65a0bf-d44e-48c6-9c51-737e24aa3c52,revision_number=2']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:26.547810 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-7ed715cb-ee77-4b5c-8235-7d450b3188d8 service neutron] Request body: {'port': {'device_id': 'de66f13f-d7ee-49ab-b071-e5b7acd3b2fe', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81644'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:26.678891 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0b3e6f43-7316-4241-9426-fe50608706e3 req-ade02f9e-7fcf-4ee9-9c34-b99a56fc9466 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 210 time: 0.1130040 Dec 24 04:59:26.689759 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-180b0652-b0d2-45ac-a896-7301a3d38c38 service neutron] Request body: {'port': {'device_id': '7c07c04e-36eb-4aa0-8a33-1c1424a2db2e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81644'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:26.693536 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ce87ccd4-cb65-44fb-8c0a-d00ec00bcdf7 req-7b7ca70b-95bd-4fa3-87fc-282500c5f42f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3785920 Dec 24 04:59:26.708341 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-1011ccf3-7efb-4d85-b9a5-ecf9d26fc632 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=bb4c0810c1124ffa823c4a28f0f4887d&name=default HTTP/1.1" status: 200 len: 2996 time: 2.6773620 Dec 24 04:59:26.759246 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 51746) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:26.760348 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-7ed715cb-ee77-4b5c-8235-7d450b3188d8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:26.841666 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.46', 62344) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:26.842382 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1011ccf3-7efb-4d85-b9a5-ecf9d26fc632 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=45bb296b-fcf0-46c2-adaf-0051b5b49f82,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:27.049007 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-55313505-039a-4c27-bbd7-df114ac16f93 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:27.055984 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-180b0652-b0d2-45ac-a896-7301a3d38c38 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:27.075823 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-55313505-039a-4c27-bbd7-df114ac16f93 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:27.173835 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55313505-039a-4c27-bbd7-df114ac16f93 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7c688c0a-b067-4f96-9d97-9a0a0f3b911b,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:27.188255 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-55313505-039a-4c27-bbd7-df114ac16f93 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=2a8f3c66c30b4707b2f64b05adaad276&name=default HTTP/1.1" status: 200 len: 2996 time: 1.4677649 Dec 24 04:59:27.194088 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 51770) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:27.233334 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e06507d6-4b16-4a58-b571-46613445ae79 req-3c9e92d8-c381-4e1e-9549-39373f0c72ce tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:27.234869 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e06507d6-4b16-4a58-b571-46613445ae79 req-3c9e92d8-c381-4e1e-9549-39373f0c72ce tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.46 "GET /v2.0/networks?id=0d368baa-5733-40a7-b836-139a541f4ebb HTTP/1.1" status: 200 len: 818 time: 0.3989952 Dec 24 04:59:27.330898 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-aeff2e7e-98f3-4c10-bceb-b381e7c58e1b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:27.386294 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-aeff2e7e-98f3-4c10-bceb-b381e7c58e1b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:27.411477 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 04:59:27.456888 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device e2f138ca-5e6c-4ae5-883d-02357c2bbbd2 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 04:59:27.550896 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-a9ace7ce-0870-413a-9e76-0a40d869cf49 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-securitygroup--238748369&fields=id&tenant_id=6c9c47f70b8d4da5827a8ef4349559ab HTTP/1.1" status: 200 len: 267 time: 0.3860509 Dec 24 04:59:27.624070 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port e2f138ca-5e6c-4ae5-883d-02357c2bbbd2 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:59:27.624445 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:27.666832 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f3f5f901-f4d6-4ead-a80b-6f46a1d97e92 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:27.859045 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:28.011082 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f3f5f901-f4d6-4ead-a80b-6f46a1d97e92 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:28.064775 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:28.078137 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] For port e2f138ca-5e6c-4ae5-883d-02357c2bbbd2, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=e2f138ca-5e6c-4ae5-883d-02357c2bbbd2,segment=NetworkSegment(d94b0a1e-2098-4b10-9091-c566351ffe74),segment_id=d94b0a1e-2098-4b10-9091-c566351ffe74)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 04:59:28.086951 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:28.158638 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da54313f-cd34-43a2-b6a1-4ab35ce6d5f2 req-535b8fef-e899-47ff-b304-946381c2a217 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:28.159791 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Pushing event updated for resources: {'Port': ['ID=e2f138ca-5e6c-4ae5-883d-02357c2bbbd2,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:28.169660 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-da54313f-cd34-43a2-b6a1-4ab35ce6d5f2 req-535b8fef-e899-47ff-b304-946381c2a217 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 932 time: 0.5647924 Dec 24 04:59:28.353068 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-da54313f-cd34-43a2-b6a1-4ab35ce6d5f2 req-80eeae22-1228-4dfe-9253-dbc8712930c0 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1610987 Dec 24 04:59:28.359103 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.notifiers.nova [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-180b0652-b0d2-45ac-a896-7301a3d38c38 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 50d50f46-e761-4fb1-9761-fa48778aa8aa {{(pid=102477) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 04:59:28.368426 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-180b0652-b0d2-45ac-a896-7301a3d38c38 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:28.383271 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-e06507d6-4b16-4a58-b571-46613445ae79 req-8af6d11f-1a7a-4239-991b-11b9cd19b02e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Request body: {'port': {'device_id': '27408900-d9e8-47e1-be4d-aac80e3f6fae', 'network_id': '0d368baa-5733-40a7-b836-139a541f4ebb', 'admin_state_up': True, 'tenant_id': '1b651e55b1a349a0b9582c526d3b5d67'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:28.389049 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-aeff2e7e-98f3-4c10-bceb-b381e7c58e1b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:28.396013 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f3f5f901-f4d6-4ead-a80b-6f46a1d97e92 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:28.397065 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-aeff2e7e-98f3-4c10-bceb-b381e7c58e1b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:28.400812 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-aeff2e7e-98f3-4c10-bceb-b381e7c58e1b admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/45bb296b-fcf0-46c2-adaf-0051b5b49f82 HTTP/1.1" status: 204 len: 168 time: 1.6357005 Dec 24 04:59:28.400959 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f3f5f901-f4d6-4ead-a80b-6f46a1d97e92 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:28.403052 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-f3f5f901-f4d6-4ead-a80b-6f46a1d97e92 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/7c688c0a-b067-4f96-9d97-9a0a0f3b911b HTTP/1.1" status: 204 len: 168 time: 1.2036819 Dec 24 04:59:28.422097 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.provisioning_blocks [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-180b0652-b0d2-45ac-a896-7301a3d38c38 service neutron] Transition to ACTIVE for port object 50d50f46-e761-4fb1-9761-fa48778aa8aa will not be triggered until provisioned by entity L2. {{(pid=102477) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 24 04:59:28.425944 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3f5f901-f4d6-4ead-a80b-6f46a1d97e92 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7c688c0a-b067-4f96-9d97-9a0a0f3b911b,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:28.436971 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-180b0652-b0d2-45ac-a896-7301a3d38c38 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:28.637603 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:28.650290 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-180b0652-b0d2-45ac-a896-7301a3d38c38 service neutron] Pushing event updated for resources: {'Port': ['ID=50d50f46-e761-4fb1-9761-fa48778aa8aa,revision_number=2']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:28.793674 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.managers [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-180b0652-b0d2-45ac-a896-7301a3d38c38 service neutron] Attempting to bind port 50d50f46-e761-4fb1-9761-fa48778aa8aa on host hv-cinder-81644 for vnic_type normal with profile {{(pid=102477) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 04:59:28.794030 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.managers [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-180b0652-b0d2-45ac-a896-7301a3d38c38 service neutron] Attempting to bind port 50d50f46-e761-4fb1-9761-fa48778aa8aa by drivers openvswitch,hyperv on host hv-cinder-81644 at level 0 using segments [{'id': '10307c97-e214-473b-b760-bb1b770153ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e'}] {{(pid=102477) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 04:59:28.794372 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-180b0652-b0d2-45ac-a896-7301a3d38c38 service neutron] Attempting to bind port 50d50f46-e761-4fb1-9761-fa48778aa8aa on network b92a87f3-957a-4ccb-9b5b-98ad92aebe6e {{(pid=102477) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 04:59:28.807691 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeff2e7e-98f3-4c10-bceb-b381e7c58e1b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=45bb296b-fcf0-46c2-adaf-0051b5b49f82,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:28.813622 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e06507d6-4b16-4a58-b571-46613445ae79 req-8af6d11f-1a7a-4239-991b-11b9cd19b02e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Made reservation on behalf of 1b651e55b1a349a0b9582c526d3b5d67 for: {'port': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:59:28.824272 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-e06507d6-4b16-4a58-b571-46613445ae79 req-8af6d11f-1a7a-4239-991b-11b9cd19b02e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:28.851105 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a052663-6a89-4421-90e0-4b60db0b4e2f req-594cd049-e7c3-4a5c-9a7d-c1b5a86a733a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:28.853974 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7a052663-6a89-4421-90e0-4b60db0b4e2f req-594cd049-e7c3-4a5c-9a7d-c1b5a86a733a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 931 time: 0.3341038 Dec 24 04:59:28.855217 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-180b0652-b0d2-45ac-a896-7301a3d38c38 service neutron] Port 50d50f46-e761-4fb1-9761-fa48778aa8aa on network b92a87f3-957a-4ccb-9b5b-98ad92aebe6e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81644 {{(pid=102477) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 24 04:59:28.855538 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-180b0652-b0d2-45ac-a896-7301a3d38c38 service neutron] Attempting to bind port 50d50f46-e761-4fb1-9761-fa48778aa8aa on network b92a87f3-957a-4ccb-9b5b-98ad92aebe6e {{(pid=102477) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 04:59:28.864189 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-180b0652-b0d2-45ac-a896-7301a3d38c38 service neutron] Checking agent: {'id': '7a2ffd19-371f-4f7b-a239-eea3b5cfd55b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81644', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'started_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 4, 59, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102477) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 04:59:28.865472 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-180b0652-b0d2-45ac-a896-7301a3d38c38 service neutron] Checking segment: {'id': '10307c97-e214-473b-b760-bb1b770153ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102477) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:59:28.866213 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-180b0652-b0d2-45ac-a896-7301a3d38c38 service neutron] Bound using segment: {'id': '10307c97-e214-473b-b760-bb1b770153ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e'} {{(pid=102477) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 04:59:28.866822 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.managers [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-180b0652-b0d2-45ac-a896-7301a3d38c38 service neutron] Bound port: 50d50f46-e761-4fb1-9761-fa48778aa8aa, host: hv-cinder-81644, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '10307c97-e214-473b-b760-bb1b770153ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e'}}] {{(pid=102477) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 04:59:28.867330 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-180b0652-b0d2-45ac-a896-7301a3d38c38 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:28.891978 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-7bab5b08-fdb9-406f-a42e-de9249648110 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:28.893866 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-7bab5b08-fdb9-406f-a42e-de9249648110 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/networks?id=c908572e-3b6b-470c-8b88-35b51f1472c6 HTTP/1.1" status: 200 len: 816 time: 1.3421268 Dec 24 04:59:29.020055 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-030566b5-d51f-4f38-a7b1-9c464753f644 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/quotas/6c9c47f70b8d4da5827a8ef4349559ab HTTP/1.1" status: 200 len: 375 time: 0.0642815 Dec 24 04:59:29.119191 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7a052663-6a89-4421-90e0-4b60db0b4e2f req-a80ac03e-a12e-4996-a37e-c9b38441237c tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1907849 Dec 24 04:59:29.125611 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.db [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-180b0652-b0d2-45ac-a896-7301a3d38c38 service neutron] For port 50d50f46-e761-4fb1-9761-fa48778aa8aa, host hv-cinder-81644, cleared binding levels {{(pid=102477) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 04:59:29.134303 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.db [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-180b0652-b0d2-45ac-a896-7301a3d38c38 service neutron] For port 50d50f46-e761-4fb1-9761-fa48778aa8aa, host hv-cinder-81644, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=50d50f46-e761-4fb1-9761-fa48778aa8aa,segment=NetworkSegment(10307c97-e214-473b-b760-bb1b770153ec),segment_id=10307c97-e214-473b-b760-bb1b770153ec)] {{(pid=102477) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 04:59:29.143445 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-180b0652-b0d2-45ac-a896-7301a3d38c38 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:29.246659 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device e2f138ca-5e6c-4ae5-883d-02357c2bbbd2 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 04:59:29.269432 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-180b0652-b0d2-45ac-a896-7301a3d38c38 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:29.270031 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-180b0652-b0d2-45ac-a896-7301a3d38c38 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for port, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:29.271499 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-180b0652-b0d2-45ac-a896-7301a3d38c38 service neutron] 10.222.0.46 "PUT /v2.0/ports/50d50f46-e761-4fb1-9761-fa48778aa8aa HTTP/1.1" status: 200 len: 1094 time: 3.0414286 Dec 24 04:59:29.273966 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7c07c04e-36eb-4aa0-8a33-1c1424a2db2e', 'tag': '50d50f46-e761-4fb1-9761-fa48778aa8aa'}] {{(pid=102477) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 04:59:29.321747 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 51804) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:29.347482 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port e2f138ca-5e6c-4ae5-883d-02357c2bbbd2 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:59:29.348013 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:29.419247 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 51808) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:29.464083 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-b3724ddc-7ae9-4aa0-9018-0608d062bcc6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=6c9c47f70b8d4da5827a8ef4349559ab&fields=id HTTP/1.1" status: 200 len: 302 time: 0.4330525 Dec 24 04:59:29.476747 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-78036759-3192-4818-8600-5bd461cdac1a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:29.521271 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b3d8d394-e01b-418d-8678-580064e969cd req-2c73fa60-4454-40e1-9e0a-80bdf7f9d4aa tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 210 time: 0.0814741 Dec 24 04:59:29.524703 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6e1782e4-76e4-44c7-84fe-161a66dcc5c0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:29.532590 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-180b0652-b0d2-45ac-a896-7301a3d38c38 service neutron] Pushing event updated for resources: {'Port': ['ID=50d50f46-e761-4fb1-9761-fa48778aa8aa,revision_number=3']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:29.595865 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d3e3d7a262849d185e72ba84ca6adca9bb1fee52649b04b101352e7e29a99ca8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-beba0bd9-2294-4e9e-b31f-9d7551530791" -d '{"events": [{"name": "network-changed", "server_uuid": "7c07c04e-36eb-4aa0-8a33-1c1424a2db2e", "tag": "50d50f46-e761-4fb1-9761-fa48778aa8aa"}]}' {{(pid=102477) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 04:59:29.654679 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-b7eff986-192f-4cdc-a3bd-e280540ae2fc service neutron] 10.222.0.43 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1565340 Dec 24 04:59:29.751080 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [req-e06507d6-4b16-4a58-b571-46613445ae79 req-8af6d11f-1a7a-4239-991b-11b9cd19b02e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Allocated IP 172.20.0.5 (0d368baa-5733-40a7-b836-139a541f4ebb/88f274d6-bcf0-47e8-9f0a-783a53214be4/ea61b5c0-ffb7-42bf-9289-095515c125a2) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 04:59:29.777982 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-7ed715cb-ee77-4b5c-8235-7d450b3188d8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c20bf82b-830b-4f29-b2bf-97f490cf78c9 {{(pid=102476) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 04:59:29.807833 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-7ed715cb-ee77-4b5c-8235-7d450b3188d8 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:29.824886 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-79cf0457-4894-4b9b-9417-27c64ebba429 service neutron] 10.222.0.43 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1684072 Dec 24 04:59:29.873512 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-471e799d-1cad-46d7-878d-c6d660c269d8 req-5fa067a4-414c-43cd-ab03-6d3f8fa83d57 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:29.878871 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-471e799d-1cad-46d7-878d-c6d660c269d8 req-5fa067a4-414c-43cd-ab03-6d3f8fa83d57 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 944 time: 0.1398907 Dec 24 04:59:29.901659 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.provisioning_blocks [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-7ed715cb-ee77-4b5c-8235-7d450b3188d8 service neutron] Transition to ACTIVE for port object c20bf82b-830b-4f29-b2bf-97f490cf78c9 will not be triggered until provisioned by entity L2. {{(pid=102476) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 24 04:59:29.962531 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-7ed715cb-ee77-4b5c-8235-7d450b3188d8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:30.130645 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-2019285e-5ba7-48c9-8ba2-25552fbddcc8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:30.138298 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-2019285e-5ba7-48c9-8ba2-25552fbddcc8 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=8f1c3a94f02049e3a76c4fc01fa7a022&device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 1097 time: 0.2399139 Dec 24 04:59:30.159983 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-471e799d-1cad-46d7-878d-c6d660c269d8 req-a0fe7087-e45f-47cb-b5b2-78924c4c8278 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2636735 Dec 24 04:59:30.451355 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6e1782e4-76e4-44c7-84fe-161a66dcc5c0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:30.455617 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-6c7ef472-eff9-425d-a643-451b93556046 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=50d50f46-e761-4fb1-9761-fa48778aa8aa HTTP/1.1" status: 200 len: 217 time: 0.2732427 Dec 24 04:59:30.461741 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-78036759-3192-4818-8600-5bd461cdac1a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:30.468406 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ed715cb-ee77-4b5c-8235-7d450b3188d8 service neutron] Pushing event updated for resources: {'Port': ['ID=c20bf82b-830b-4f29-b2bf-97f490cf78c9,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:30.472660 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6e1782e4-76e4-44c7-84fe-161a66dcc5c0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:30.494207 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6f99aeef-e04a-4ac7-a532-528a338df791 req-8ffd4688-b489-41f6-827b-b9e199b54420 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 210 time: 0.1906519 Dec 24 04:59:30.510001 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 04:59:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4e450259-ad5f-4d55-b9cc-e814528401fd x-openstack-request-id: req-4e450259-ad5f-4d55-b9cc-e814528401fd {{(pid=102477) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 04:59:30.510287 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7c07c04e-36eb-4aa0-8a33-1c1424a2db2e", "tag": "50d50f46-e761-4fb1-9761-fa48778aa8aa", "status": "completed", "code": 200}]} {{(pid=102477) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 04:59:30.510536 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-4e450259-ad5f-4d55-b9cc-e814528401fd {{(pid=102477) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 04:59:30.511002 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7c07c04e-36eb-4aa0-8a33-1c1424a2db2e', 'tag': '50d50f46-e761-4fb1-9761-fa48778aa8aa', 'status': 'completed', 'code': 200} Dec 24 04:59:30.574827 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e1782e4-76e4-44c7-84fe-161a66dcc5c0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0be9c82b-64fd-4c04-9555-c50f43409fe1,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:30.579100 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-78036759-3192-4818-8600-5bd461cdac1a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:30.682012 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-16271348-f1d4-4cf5-83dd-0b581d44ae5a req-56e987b3-d7d4-45f3-9feb-1bc8933ce20b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 210 time: 0.0349407 Dec 24 04:59:30.705790 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-78036759-3192-4818-8600-5bd461cdac1a admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=8091752497d14ce0935026b6e200c825&name=default HTTP/1.1" status: 200 len: 2996 time: 1.3804970 Dec 24 04:59:30.708688 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 51854) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:30.778234 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-06cbe163-b31b-4c92-b56d-5467abd44cbb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:30.810051 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-06cbe163-b31b-4c92-b56d-5467abd44cbb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:30.887659 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-e06507d6-4b16-4a58-b571-46613445ae79 req-8af6d11f-1a7a-4239-991b-11b9cd19b02e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:30.892190 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-06cbe163-b31b-4c92-b56d-5467abd44cbb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:30.897852 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-06cbe163-b31b-4c92-b56d-5467abd44cbb admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:30.901650 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-06cbe163-b31b-4c92-b56d-5467abd44cbb admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/b389a4b6-5103-4079-af05-8cb9f260a787 HTTP/1.1" status: 204 len: 168 time: 0.1896665 Dec 24 04:59:30.910725 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06cbe163-b31b-4c92-b56d-5467abd44cbb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b389a4b6-5103-4079-af05-8cb9f260a787,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:30.939414 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-6e1782e4-76e4-44c7-84fe-161a66dcc5c0 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=53de305faadf4e7da3152a0a568436be&name=default HTTP/1.1" status: 200 len: 2996 time: 1.5083604 Dec 24 04:59:30.943041 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 51860) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:30.984382 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40a71fdf-8ad8-4a0e-bb7a-787cd3f5e02a req-cce96162-fd0a-4a47-8a3d-8b43bd1ac1e7 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:30.999268 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-40a71fdf-8ad8-4a0e-bb7a-787cd3f5e02a req-cce96162-fd0a-4a47-8a3d-8b43bd1ac1e7 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 943 time: 0.2655187 Dec 24 04:59:31.024097 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d984d19f-9168-4b55-8830-dcd3709690d6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:31.039553 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78036759-3192-4818-8600-5bd461cdac1a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b389a4b6-5103-4079-af05-8cb9f260a787,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:31.068840 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d984d19f-9168-4b55-8830-dcd3709690d6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:31.088062 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-7ed715cb-ee77-4b5c-8235-7d450b3188d8 service neutron] Attempting to bind port c20bf82b-830b-4f29-b2bf-97f490cf78c9 on host hv-cinder-81644 for vnic_type normal with profile {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 04:59:31.088411 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-7ed715cb-ee77-4b5c-8235-7d450b3188d8 service neutron] Attempting to bind port c20bf82b-830b-4f29-b2bf-97f490cf78c9 by drivers openvswitch,hyperv on host hv-cinder-81644 at level 0 using segments [{'id': '3203d346-5464-46d2-aeaa-9836964b7a28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '598b6cd9-9673-4e27-b33e-451cd98b5f1c'}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 04:59:31.088988 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-7ed715cb-ee77-4b5c-8235-7d450b3188d8 service neutron] Attempting to bind port c20bf82b-830b-4f29-b2bf-97f490cf78c9 on network 598b6cd9-9673-4e27-b33e-451cd98b5f1c {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 04:59:31.110595 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-7ed715cb-ee77-4b5c-8235-7d450b3188d8 service neutron] Port c20bf82b-830b-4f29-b2bf-97f490cf78c9 on network 598b6cd9-9673-4e27-b33e-451cd98b5f1c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81644 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 24 04:59:31.110918 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-7ed715cb-ee77-4b5c-8235-7d450b3188d8 service neutron] Attempting to bind port c20bf82b-830b-4f29-b2bf-97f490cf78c9 on network 598b6cd9-9673-4e27-b33e-451cd98b5f1c {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 04:59:31.135396 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d984d19f-9168-4b55-8830-dcd3709690d6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:31.137968 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d984d19f-9168-4b55-8830-dcd3709690d6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:31.140579 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-7ed715cb-ee77-4b5c-8235-7d450b3188d8 service neutron] Checking agent: {'id': '7a2ffd19-371f-4f7b-a239-eea3b5cfd55b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81644', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'started_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 4, 59, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 04:59:31.142967 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-d984d19f-9168-4b55-8830-dcd3709690d6 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/0be9c82b-64fd-4c04-9555-c50f43409fe1 HTTP/1.1" status: 204 len: 168 time: 0.1986482 Dec 24 04:59:31.152491 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d984d19f-9168-4b55-8830-dcd3709690d6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0be9c82b-64fd-4c04-9555-c50f43409fe1,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:31.154583 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-7ed715cb-ee77-4b5c-8235-7d450b3188d8 service neutron] Checking segment: {'id': '3203d346-5464-46d2-aeaa-9836964b7a28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '598b6cd9-9673-4e27-b33e-451cd98b5f1c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:59:31.155242 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-7ed715cb-ee77-4b5c-8235-7d450b3188d8 service neutron] Bound using segment: {'id': '3203d346-5464-46d2-aeaa-9836964b7a28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '598b6cd9-9673-4e27-b33e-451cd98b5f1c'} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 04:59:31.155779 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-7ed715cb-ee77-4b5c-8235-7d450b3188d8 service neutron] Bound port: c20bf82b-830b-4f29-b2bf-97f490cf78c9, host: hv-cinder-81644, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3203d346-5464-46d2-aeaa-9836964b7a28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '598b6cd9-9673-4e27-b33e-451cd98b5f1c'}}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 04:59:31.156151 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-7ed715cb-ee77-4b5c-8235-7d450b3188d8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:31.176332 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-40a71fdf-8ad8-4a0e-bb7a-787cd3f5e02a req-63826bcf-c488-4e7e-a9d7-ad1c7e80a59b tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1760817 Dec 24 04:59:31.193518 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-e06507d6-4b16-4a58-b571-46613445ae79 req-8af6d11f-1a7a-4239-991b-11b9cd19b02e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:31.291014 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e06507d6-4b16-4a58-b571-46613445ae79 req-8af6d11f-1a7a-4239-991b-11b9cd19b02e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Network 0d368baa-5733-40a7-b836-139a541f4ebb is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 04:59:31.300740 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [req-e06507d6-4b16-4a58-b571-46613445ae79 req-8af6d11f-1a7a-4239-991b-11b9cd19b02e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:59:31.328210 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-e06507d6-4b16-4a58-b571-46613445ae79 req-8af6d11f-1a7a-4239-991b-11b9cd19b02e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 04:59:31.366291 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8af6d11f-1a7a-4239-991b-11b9cd19b02e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Pushing event updated for resources: {'Port': ['ID=ea61b5c0-ffb7-42bf-9289-095515c125a2,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:31.410185 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-7ed715cb-ee77-4b5c-8235-7d450b3188d8 service neutron] For port c20bf82b-830b-4f29-b2bf-97f490cf78c9, host hv-cinder-81644, cleared binding levels {{(pid=102476) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 04:59:31.410915 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bde3eb8f-3cdc-4e84-b9ea-f3d6c28c4185 req-00143d1e-ad7d-49ad-be98-763935205778 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:31.415091 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-7ed715cb-ee77-4b5c-8235-7d450b3188d8 service neutron] For port c20bf82b-830b-4f29-b2bf-97f490cf78c9, host hv-cinder-81644, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=c20bf82b-830b-4f29-b2bf-97f490cf78c9,segment=NetworkSegment(3203d346-5464-46d2-aeaa-9836964b7a28),segment_id=3203d346-5464-46d2-aeaa-9836964b7a28)] {{(pid=102476) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 04:59:31.422420 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-bde3eb8f-3cdc-4e84-b9ea-f3d6c28c4185 req-00143d1e-ad7d-49ad-be98-763935205778 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 944 time: 0.1355574 Dec 24 04:59:31.424952 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e06507d6-4b16-4a58-b571-46613445ae79 req-8af6d11f-1a7a-4239-991b-11b9cd19b02e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:31.425769 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-e06507d6-4b16-4a58-b571-46613445ae79 req-8af6d11f-1a7a-4239-991b-11b9cd19b02e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:31.430528 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-7ed715cb-ee77-4b5c-8235-7d450b3188d8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:31.486828 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e06507d6-4b16-4a58-b571-46613445ae79 req-8af6d11f-1a7a-4239-991b-11b9cd19b02e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.46 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.1162865 Dec 24 04:59:31.496729 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-7ed715cb-ee77-4b5c-8235-7d450b3188d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:31.498989 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-7ed715cb-ee77-4b5c-8235-7d450b3188d8 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:31.505000 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-bde3eb8f-3cdc-4e84-b9ea-f3d6c28c4185 req-1d02cd24-9ad8-4f1b-bda3-0249b5dd5fad tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0799553 Dec 24 04:59:31.525802 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-7ed715cb-ee77-4b5c-8235-7d450b3188d8 service neutron] 10.222.0.46 "PUT /v2.0/ports/c20bf82b-830b-4f29-b2bf-97f490cf78c9 HTTP/1.1" status: 200 len: 1093 time: 5.3934569 Dec 24 04:59:31.526499 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'de66f13f-d7ee-49ab-b071-e5b7acd3b2fe', 'tag': 'c20bf82b-830b-4f29-b2bf-97f490cf78c9'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 04:59:31.567811 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ed715cb-ee77-4b5c-8235-7d450b3188d8 service neutron] Pushing event updated for resources: {'Port': ['ID=c20bf82b-830b-4f29-b2bf-97f490cf78c9,revision_number=3']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:31.695350 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a2afeb52-afe8-4a70-bb55-1a7549c82afe req-b5a3fe05-86ac-46db-846a-6f7928996d7d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 210 time: 0.0573566 Dec 24 04:59:31.778010 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1a921928-f103-4e6c-8ca1-4bb8f937c141" -d '{"events": [{"name": "network-changed", "server_uuid": "de66f13f-d7ee-49ab-b071-e5b7acd3b2fe", "tag": "c20bf82b-830b-4f29-b2bf-97f490cf78c9"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 04:59:31.807661 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6f2e07ed-653e-4c4d-b13c-6ac03492640d req-67fdc6c5-6688-4339-a182-67ce6632ab8d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 210 time: 0.0530121 Dec 24 04:59:31.968184 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 04:59:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-063a1482-57f7-4957-8112-55c460a3e821 x-openstack-request-id: req-063a1482-57f7-4957-8112-55c460a3e821 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 04:59:31.968476 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "de66f13f-d7ee-49ab-b071-e5b7acd3b2fe", "tag": "c20bf82b-830b-4f29-b2bf-97f490cf78c9", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 04:59:31.968767 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-063a1482-57f7-4957-8112-55c460a3e821 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 04:59:31.969336 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'de66f13f-d7ee-49ab-b071-e5b7acd3b2fe', 'tag': 'c20bf82b-830b-4f29-b2bf-97f490cf78c9', 'status': 'completed', 'code': 200} Dec 24 04:59:32.356988 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5e793cc-6d1c-49c2-b069-0f6c6058cbb7 req-52ff8775-9266-4d8c-a596-9d9bd757ef9d tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:32.362599 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c5e793cc-6d1c-49c2-b069-0f6c6058cbb7 req-52ff8775-9266-4d8c-a596-9d9bd757ef9d tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 943 time: 0.0650067 Dec 24 04:59:32.437312 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c5e793cc-6d1c-49c2-b069-0f6c6058cbb7 req-760133c1-ca6c-4ea8-8b54-30dc96e238b2 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0694473 Dec 24 04:59:32.651676 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60b03bd9-3b46-4819-80fb-6f6a14a364fc req-ac097bad-ae19-4458-a921-f6ec598373ae tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:32.667018 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-60b03bd9-3b46-4819-80fb-6f6a14a364fc req-ac097bad-ae19-4458-a921-f6ec598373ae tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 944 time: 0.0860910 Dec 24 04:59:32.735360 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-60b03bd9-3b46-4819-80fb-6f6a14a364fc req-c307aa53-db06-463c-88ba-f83c4eb96e44 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0636864 Dec 24 04:59:32.879987 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7d796953-a20f-4f49-bd7b-064262876baa req-257e4049-062c-4ee0-95aa-cdbba974cd38 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 210 time: 0.0531807 Dec 24 04:59:33.045222 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-cac20b5a-5e7b-42c0-a912-afefae7d8b30 req-bc0a2e56-9d1f-431f-82f5-ac67402e1da7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 210 time: 0.0728879 Dec 24 04:59:33.233903 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 51966) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:33.563807 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04307fa8-1b1a-47ba-bad0-5853cf950dbf req-9ea9b487-89dd-49c8-91e1-d87f78711f5a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:33.565324 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-04307fa8-1b1a-47ba-bad0-5853cf950dbf req-9ea9b487-89dd-49c8-91e1-d87f78711f5a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 943 time: 0.0631649 Dec 24 04:59:33.612424 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-6680cf8e-f658-4ea2-837b-26c9e810c358 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:33.663665 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-04307fa8-1b1a-47ba-bad0-5853cf950dbf req-da3c5f93-181e-4427-8683-4d62bc12fd96 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0769298 Dec 24 04:59:33.728327 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-6680cf8e-f658-4ea2-837b-26c9e810c358 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:33.733662 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-6680cf8e-f658-4ea2-837b-26c9e810c358 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:33.777883 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-6680cf8e-f658-4ea2-837b-26c9e810c358 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=e000c1da87114220b94ae4e923090064&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5426562 Dec 24 04:59:33.780400 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 51986) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:33.782174 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6680cf8e-f658-4ea2-837b-26c9e810c358 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8a362e41-c7dd-40b1-99db-f3286d209e75,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:33.867201 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1cd4dd0d-74db-4998-be5c-7aea031f89b1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:33.889032 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0e8acac-6553-4ede-a4be-f29b9a9a2d59 req-47c3599e-34a5-4a86-a4b5-4014c90b8bb2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:33.890526 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d0e8acac-6553-4ede-a4be-f29b9a9a2d59 req-47c3599e-34a5-4a86-a4b5-4014c90b8bb2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 944 time: 0.0834205 Dec 24 04:59:33.904514 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1cd4dd0d-74db-4998-be5c-7aea031f89b1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:33.978863 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d0e8acac-6553-4ede-a4be-f29b9a9a2d59 req-7dcda716-aa57-4f07-b018-1bdc837599c2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0766878 Dec 24 04:59:33.990437 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5174eefb-8853-4b0b-b8e4-7a1ae7afc4b9 req-1108d9ab-bfa7-4a44-8143-0b2cb208f8d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 210 time: 0.0354877 Dec 24 04:59:34.011612 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1cd4dd0d-74db-4998-be5c-7aea031f89b1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:34.015661 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1cd4dd0d-74db-4998-be5c-7aea031f89b1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:34.017691 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-1cd4dd0d-74db-4998-be5c-7aea031f89b1 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/8a362e41-c7dd-40b1-99db-f3286d209e75 HTTP/1.1" status: 204 len: 168 time: 0.2361140 Dec 24 04:59:34.029696 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cd4dd0d-74db-4998-be5c-7aea031f89b1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8a362e41-c7dd-40b1-99db-f3286d209e75,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:34.148320 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bce32f31-a052-4e9a-867c-ef0717b5b2c7 req-57254c3c-6728-456f-93d3-7f4884dec3eb tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 210 time: 0.0267050 Dec 24 04:59:34.780690 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a90c3427-1c24-4e09-8d25-df19e19f644f req-29b71055-9e27-4efa-903e-b2b1a7f27e79 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:34.782326 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a90c3427-1c24-4e09-8d25-df19e19f644f req-29b71055-9e27-4efa-903e-b2b1a7f27e79 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 943 time: 0.0507097 Dec 24 04:59:34.833201 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a90c3427-1c24-4e09-8d25-df19e19f644f req-d85c1e66-a670-4bea-bf75-fe7ce64ba5fe tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445812 Dec 24 04:59:35.119025 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-48ba4f02-bc1f-47bb-b7d6-4b93400f3eb6 req-6749f57d-3e69-4354-bbc3-65a789dc5093 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 210 time: 0.0300517 Dec 24 04:59:35.256575 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-458fccde-4d9b-4ffd-96ac-b2de021c26ab req-959a1199-2b2f-4e30-94b4-46bfce5b5c50 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 210 time: 0.0273736 Dec 24 04:59:35.293796 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd687940-07af-4802-b510-2790c5a906d9 req-8670a6f6-0cc0-48db-8975-92803fb35009 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:35.295338 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-cd687940-07af-4802-b510-2790c5a906d9 req-8670a6f6-0cc0-48db-8975-92803fb35009 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 944 time: 0.2428288 Dec 24 04:59:35.346025 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-cd687940-07af-4802-b510-2790c5a906d9 req-41db2d6a-9184-47b4-91c7-aa2d5c4fcb98 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440145 Dec 24 04:59:35.966301 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efed455a-3cd7-44f6-ad1e-de54d93a035a req-50efa1a9-5b97-480d-b565-7993db712527 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:35.967675 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-efed455a-3cd7-44f6-ad1e-de54d93a035a req-50efa1a9-5b97-480d-b565-7993db712527 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 943 time: 0.0608230 Dec 24 04:59:36.021139 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-efed455a-3cd7-44f6-ad1e-de54d93a035a req-da0f0c5d-000b-492d-91c8-231c630bb436 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464509 Dec 24 04:59:36.226343 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-86c1e1ba-1a50-4e51-a67d-cff8db449498 req-2364db86-6d61-4449-a655-1af4c2507ab0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 210 time: 0.0265176 Dec 24 04:59:36.359484 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ced46162-60e9-4b35-9788-f356affe1f5f req-546373ac-85e5-4b3a-b313-5e15bf0f0047 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 210 time: 0.0290992 Dec 24 04:59:36.461760 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1ba2e31-60a7-4c7d-83d8-a4abaee8b699 req-b5dcebfa-f396-4b17-8fcd-86b39c1c7f1f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:36.463183 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c1ba2e31-60a7-4c7d-83d8-a4abaee8b699 req-b5dcebfa-f396-4b17-8fcd-86b39c1c7f1f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 944 time: 0.0520430 Dec 24 04:59:36.512126 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c1ba2e31-60a7-4c7d-83d8-a4abaee8b699 req-df4f8b0d-e4ba-48c5-acec-2173f2070007 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428796 Dec 24 04:59:37.077268 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-2b01bc3b-717b-46d9-9cd0-645da8a2fe8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:37.078938 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-2b01bc3b-717b-46d9-9cd0-645da8a2fe8e service neutron] 10.222.0.46 "GET /v2.0/subnets?id=9b9ff65f-93c8-4cb1-8a99-961ba0d4beaa HTTP/1.1" status: 200 len: 855 time: 0.0654488 Dec 24 04:59:37.140083 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bfd6ced-4fe9-48d0-8ee4-9447359919c1 req-daf99f78-d744-4f4f-9065-3cb01a2a772a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:37.141781 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3bfd6ced-4fe9-48d0-8ee4-9447359919c1 req-daf99f78-d744-4f4f-9065-3cb01a2a772a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 943 time: 0.0488532 Dec 24 04:59:37.188167 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3bfd6ced-4fe9-48d0-8ee4-9447359919c1 req-d4bf5e95-a698-49ee-98a6-d3c6ae26c6a8 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404851 Dec 24 04:59:37.331364 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8794692c-2755-4c4a-accd-f49f2c3a5e39 req-33078076-88c7-4e15-9ecb-bf2aab67d0e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 210 time: 0.0312767 Dec 24 04:59:37.451901 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-2194e1b0-343a-4a01-a48c-83453d89ef26 req-2cbdfcfc-67d4-459b-b7ab-4f4ab9d1abf8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 210 time: 0.0256119 Dec 24 04:59:37.626371 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b92d05c8-e51a-44f7-8e86-51ae4063c6e7 req-d6600115-1042-4eac-9907-7d52a98da281 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:37.627780 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b92d05c8-e51a-44f7-8e86-51ae4063c6e7 req-d6600115-1042-4eac-9907-7d52a98da281 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 944 time: 0.0489464 Dec 24 04:59:37.673795 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b92d05c8-e51a-44f7-8e86-51ae4063c6e7 req-634f749f-255b-4016-851c-6942d4b15a4f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400205 Dec 24 04:59:38.320717 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b021145-128f-493d-887b-c54e3cb8b6b1 req-55d7d014-1d25-43f2-b92d-7e78de3d16cd tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:38.322223 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0b021145-128f-493d-887b-c54e3cb8b6b1 req-55d7d014-1d25-43f2-b92d-7e78de3d16cd tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 943 time: 0.0568118 Dec 24 04:59:38.371799 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0b021145-128f-493d-887b-c54e3cb8b6b1 req-00008ab6-fa5b-4258-97f1-7863f52f2090 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429790 Dec 24 04:59:38.427737 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-dab9971a-5cbf-4c59-a7fb-7d2f5eab82ed req-2f626dc8-9e54-4ddc-90de-ccb9f46dc832 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 210 time: 0.0259573 Dec 24 04:59:38.543532 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3f8bf168-60b4-4a86-b2fa-9bbcedc1ac4b req-35f7bd1e-1c69-4605-809f-58f4a17464fa tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 210 time: 0.0253477 Dec 24 04:59:38.797856 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b7b169e-0c9e-48bd-b23e-4d523b57b906 req-c57c0268-0db7-46e1-99b5-1882e40fdddd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:38.799216 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9b7b169e-0c9e-48bd-b23e-4d523b57b906 req-c57c0268-0db7-46e1-99b5-1882e40fdddd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 944 time: 0.0495977 Dec 24 04:59:38.838686 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-e06507d6-4b16-4a58-b571-46613445ae79 req-c847138a-eb61-49af-a7be-f39f765c90e5 service neutron] Request body: {'port': {'device_id': '27408900-d9e8-47e1-be4d-aac80e3f6fae', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81644'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:38.868513 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.46', 62358) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:38.875467 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9b7b169e-0c9e-48bd-b23e-4d523b57b906 req-c825a703-c7ed-426c-b82b-86dc12479680 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0700212 Dec 24 04:59:38.902792 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-2f00443f-9b4e-457b-9aea-72fc0e6a4910 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=b92a87f3-957a-4ccb-9b5b-98ad92aebe6e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0692506 Dec 24 04:59:39.010339 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-2c2db5ba-6def-4f5b-9287-0d3b2c7b4f91 service neutron] 10.222.0.46 "GET /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0963850 Dec 24 04:59:39.027435 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-e06507d6-4b16-4a58-b571-46613445ae79 req-c847138a-eb61-49af-a7be-f39f765c90e5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:39.112555 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a921928-f103-4e6c-8ca1-4bb8f937c141 req-47e426bb-afae-4e4d-8f26-ed22b7080b11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:39.113688 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-091448e8-cf3a-40c8-90df-a8a764d79f38 req-32223f6f-18c5-4bb4-9993-e4632f10e0ba service neutron] 10.222.0.46 "GET /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0956202 Dec 24 04:59:39.114045 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1a921928-f103-4e6c-8ca1-4bb8f937c141 req-47e426bb-afae-4e4d-8f26-ed22b7080b11 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=14dbe9b1ff9041858e25c4fafebc1a51&device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 1096 time: 0.1922066 Dec 24 04:59:39.127874 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-9ef4421e-a02a-41d7-ba10-e2fc9556432a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:39.129078 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-9ef4421e-a02a-41d7-ba10-e2fc9556432a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.46 "GET /v2.0/networks?id=0d368baa-5733-40a7-b836-139a541f4ebb HTTP/1.1" status: 200 len: 818 time: 0.2415221 Dec 24 04:59:39.197380 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-7fbbe14b-2c8f-4097-9d85-ccafa87c0ead tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Request body: {'port': {'device_id': '580344bb-42e6-4fd7-967d-04e85d821fd2', 'network_id': '0d368baa-5733-40a7-b836-139a541f4ebb', 'admin_state_up': True, 'tenant_id': '1b651e55b1a349a0b9582c526d3b5d67'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:39.259766 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beba0bd9-2294-4e9e-b31f-9d7551530791 req-a8db7c3e-1d45-4df8-993c-b24703e2b321 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:39.261300 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-beba0bd9-2294-4e9e-b31f-9d7551530791 req-a8db7c3e-1d45-4df8-993c-b24703e2b321 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=8f1c3a94f02049e3a76c4fc01fa7a022&device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 1097 time: 0.0421932 Dec 24 04:59:39.463620 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beba0bd9-2294-4e9e-b31f-9d7551530791 req-8e2ab419-e608-45c2-9bb5-0c8f6cd45f15 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:39.465101 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-beba0bd9-2294-4e9e-b31f-9d7551530791 req-8e2ab419-e608-45c2-9bb5-0c8f6cd45f15 service neutron] 10.222.0.46 "GET /v2.0/networks?id=b92a87f3-957a-4ccb-9b5b-98ad92aebe6e HTTP/1.1" status: 200 len: 916 time: 0.1754830 Dec 24 04:59:39.573175 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0a92ff27-0655-4476-86f8-d8c2dd4d51cb req-c9f05404-e618-4e17-a136-db7a0beff4fd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 210 time: 0.0631757 Dec 24 04:59:39.580879 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a921928-f103-4e6c-8ca1-4bb8f937c141 req-e84e5d0e-561b-4628-a9ea-3fa944b49bee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:39.582445 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1a921928-f103-4e6c-8ca1-4bb8f937c141 req-e84e5d0e-561b-4628-a9ea-3fa944b49bee service neutron] 10.222.0.46 "GET /v2.0/networks?tenant_id=14dbe9b1ff9041858e25c4fafebc1a51&shared=False HTTP/1.1" status: 200 len: 913 time: 0.3937614 Dec 24 04:59:39.618998 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-7fbbe14b-2c8f-4097-9d85-ccafa87c0ead tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Made reservation on behalf of 1b651e55b1a349a0b9582c526d3b5d67 for: {'port': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:59:39.623516 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-7fbbe14b-2c8f-4097-9d85-ccafa87c0ead tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:39.764087 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-beba0bd9-2294-4e9e-b31f-9d7551530791 req-5371c5ce-22a5-40cc-9550-727bc51597c2 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=50d50f46-e761-4fb1-9761-fa48778aa8aa HTTP/1.1" status: 200 len: 217 time: 0.2775977 Dec 24 04:59:39.765813 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c887df51-7943-4976-a850-6bed68779169 req-718ee809-8b7b-4478-8da7-7de45763ff27 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 210 time: 0.1032610 Dec 24 04:59:39.785017 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57397d9b-d0f5-4c61-9ec1-71111c3d94fe req-26b832d8-c0d3-4ad6-80da-641252f4d759 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:39.787393 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-57397d9b-d0f5-4c61-9ec1-71111c3d94fe req-26b832d8-c0d3-4ad6-80da-641252f4d759 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 943 time: 0.3359940 Dec 24 04:59:39.796339 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [req-e06507d6-4b16-4a58-b571-46613445ae79 req-c847138a-eb61-49af-a7be-f39f765c90e5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ea61b5c0-ffb7-42bf-9289-095515c125a2 {{(pid=102476) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 04:59:39.818611 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-e06507d6-4b16-4a58-b571-46613445ae79 req-c847138a-eb61-49af-a7be-f39f765c90e5 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:39.854936 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-57397d9b-d0f5-4c61-9ec1-71111c3d94fe req-88d0436c-241b-4235-ba0d-3ed92257b441 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0592902 Dec 24 04:59:39.886180 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.provisioning_blocks [req-e06507d6-4b16-4a58-b571-46613445ae79 req-c847138a-eb61-49af-a7be-f39f765c90e5 service neutron] Transition to ACTIVE for port object ea61b5c0-ffb7-42bf-9289-095515c125a2 will not be triggered until provisioned by entity L2. {{(pid=102476) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 24 04:59:39.886814 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.46', 62362) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:39.919248 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beba0bd9-2294-4e9e-b31f-9d7551530791 req-9dad266b-13b0-4a61-8480-fa0fa40d277b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:39.921076 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-beba0bd9-2294-4e9e-b31f-9d7551530791 req-9dad266b-13b0-4a61-8480-fa0fa40d277b service neutron] 10.222.0.46 "GET /v2.0/subnets?id=9b9ff65f-93c8-4cb1-8a99-961ba0d4beaa HTTP/1.1" status: 200 len: 855 time: 0.0651507 Dec 24 04:59:39.958987 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-e06507d6-4b16-4a58-b571-46613445ae79 req-c847138a-eb61-49af-a7be-f39f765c90e5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:39.965620 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-beba0bd9-2294-4e9e-b31f-9d7551530791 req-2d6648b4-c6fa-4e74-b6e1-42abeaf9df05 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=b92a87f3-957a-4ccb-9b5b-98ad92aebe6e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0355339 Dec 24 04:59:40.123226 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-beba0bd9-2294-4e9e-b31f-9d7551530791 req-eebb8131-e7c7-4bf3-a437-9c3d38337428 service neutron] 10.222.0.46 "GET /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1488993 Dec 24 04:59:40.147318 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c847138a-eb61-49af-a7be-f39f765c90e5 service neutron] Pushing event updated for resources: {'Port': ['ID=ea61b5c0-ffb7-42bf-9289-095515c125a2,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:40.326311 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-beba0bd9-2294-4e9e-b31f-9d7551530791 req-9a1b46fb-7652-4f2d-a2b3-64690a1dda5a service neutron] 10.222.0.46 "GET /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1215479 Dec 24 04:59:40.523427 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-7fbbe14b-2c8f-4097-9d85-ccafa87c0ead tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Allocated IP 172.20.0.12 (0d368baa-5733-40a7-b836-139a541f4ebb/88f274d6-bcf0-47e8-9f0a-783a53214be4/24d08627-8243-4361-b6b4-8461a18d110f) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 04:59:40.611760 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a921928-f103-4e6c-8ca1-4bb8f937c141 req-b17e02b7-fc7d-4a27-9eea-960f8b138055 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:40.613279 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1a921928-f103-4e6c-8ca1-4bb8f937c141 req-b17e02b7-fc7d-4a27-9eea-960f8b138055 service neutron] 10.222.0.46 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.7780006 Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:40.629049 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:40.631454 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:40.631454 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:40.631454 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:40.631454 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:40.631454 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:40.631454 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:40.631454 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:40.631454 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:40.631454 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:40.631454 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:40.631454 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:40.631454 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:40.631454 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee7350d7-faab-4b66-90a4-eb7fba7b7874 req-780f574e-176f-47b9-b05b-384600735adf tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:40.632747 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ee7350d7-faab-4b66-90a4-eb7fba7b7874 req-780f574e-176f-47b9-b05b-384600735adf tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 944 time: 0.5171559 Dec 24 04:59:40.648314 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-b8ba3eb4-7b46-46b3-8e05-5692e58ac7ff tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:40.649821 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-b8ba3eb4-7b46-46b3-8e05-5692e58ac7ff tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.46 "GET /v2.0/networks?id=c908572e-3b6b-470c-8b88-35b51f1472c6 HTTP/1.1" status: 200 len: 816 time: 0.7620461 Dec 24 04:59:40.754869 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b76212f9-f691-4c99-a2f3-85a3bad5bdfc req-2cd0f713-6cbf-49e6-8622-f115ebe84850 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 210 time: 0.0260541 Dec 24 04:59:40.775076 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-e06507d6-4b16-4a58-b571-46613445ae79 req-c847138a-eb61-49af-a7be-f39f765c90e5 service neutron] Attempting to bind port ea61b5c0-ffb7-42bf-9289-095515c125a2 on host hv-cinder-81644 for vnic_type normal with profile {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 04:59:40.775383 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-e06507d6-4b16-4a58-b571-46613445ae79 req-c847138a-eb61-49af-a7be-f39f765c90e5 service neutron] Attempting to bind port ea61b5c0-ffb7-42bf-9289-095515c125a2 by drivers openvswitch,hyperv on host hv-cinder-81644 at level 0 using segments [{'id': 'd94b0a1e-2098-4b10-9091-c566351ffe74', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '0d368baa-5733-40a7-b836-139a541f4ebb'}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 04:59:40.775917 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e06507d6-4b16-4a58-b571-46613445ae79 req-c847138a-eb61-49af-a7be-f39f765c90e5 service neutron] Attempting to bind port ea61b5c0-ffb7-42bf-9289-095515c125a2 on network 0d368baa-5733-40a7-b836-139a541f4ebb {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 04:59:40.830266 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e06507d6-4b16-4a58-b571-46613445ae79 req-c847138a-eb61-49af-a7be-f39f765c90e5 service neutron] Port ea61b5c0-ffb7-42bf-9289-095515c125a2 on network 0d368baa-5733-40a7-b836-139a541f4ebb not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81644 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 24 04:59:40.830967 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e06507d6-4b16-4a58-b571-46613445ae79 req-c847138a-eb61-49af-a7be-f39f765c90e5 service neutron] Attempting to bind port ea61b5c0-ffb7-42bf-9289-095515c125a2 on network 0d368baa-5733-40a7-b836-139a541f4ebb {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 04:59:40.863372 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ee7350d7-faab-4b66-90a4-eb7fba7b7874 req-17d9f2e1-7f7f-4e69-b852-15d61b1bf5ab tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2082958 Dec 24 04:59:40.883077 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e06507d6-4b16-4a58-b571-46613445ae79 req-c847138a-eb61-49af-a7be-f39f765c90e5 service neutron] Checking agent: {'id': '7a2ffd19-371f-4f7b-a239-eea3b5cfd55b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81644', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'started_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 4, 59, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 04:59:40.884865 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e06507d6-4b16-4a58-b571-46613445ae79 req-c847138a-eb61-49af-a7be-f39f765c90e5 service neutron] Checking segment: {'id': 'd94b0a1e-2098-4b10-9091-c566351ffe74', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '0d368baa-5733-40a7-b836-139a541f4ebb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:59:40.885248 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e06507d6-4b16-4a58-b571-46613445ae79 req-c847138a-eb61-49af-a7be-f39f765c90e5 service neutron] Bound using segment: {'id': 'd94b0a1e-2098-4b10-9091-c566351ffe74', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '0d368baa-5733-40a7-b836-139a541f4ebb'} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 04:59:40.885694 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-e06507d6-4b16-4a58-b571-46613445ae79 req-c847138a-eb61-49af-a7be-f39f765c90e5 service neutron] Bound port: ea61b5c0-ffb7-42bf-9289-095515c125a2, host: hv-cinder-81644, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd94b0a1e-2098-4b10-9091-c566351ffe74', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '0d368baa-5733-40a7-b836-139a541f4ebb'}}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 04:59:40.886050 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-e06507d6-4b16-4a58-b571-46613445ae79 req-c847138a-eb61-49af-a7be-f39f765c90e5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:40.895958 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-a4d66fae-4734-4fb0-93d9-7196dbb1ab0a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:40.897487 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-a4d66fae-4734-4fb0-93d9-7196dbb1ab0a service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=14dbe9b1ff9041858e25c4fafebc1a51&device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 1096 time: 0.2010541 Dec 24 04:59:40.940482 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-37d4bcf5-714b-4e71-bb72-836e6350e079 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.46 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6c9c47f70b8d4da5827a8ef4349559ab HTTP/1.1" status: 200 len: 379 time: 0.2489314 Dec 24 04:59:40.947769 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e7c64b83-0006-4152-8e34-77f39b1bbb07 req-75cc8404-41ce-4056-afa1-d6fcf2687026 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 210 time: 0.0360754 Dec 24 04:59:41.038756 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-c43134b6-4d1d-4056-b351-f288222c5629 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Request body: {'port': {'device_id': '6485c286-d5e3-42e7-bf58-c4685f8c3066', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'admin_state_up': True, 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'security_groups': ['2b32cddf-29a8-4d82-a930-1f27033cc61f']}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:41.048248 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-1c33c1fa-ec68-48d1-91db-cd8f88d613cd service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c20bf82b-830b-4f29-b2bf-97f490cf78c9 HTTP/1.1" status: 200 len: 217 time: 0.1208832 Dec 24 04:59:41.051150 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-7fbbe14b-2c8f-4097-9d85-ccafa87c0ead tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:41.235802 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-87526488-9504-4563-8398-b5c9f10f9841 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:41.237284 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-87526488-9504-4563-8398-b5c9f10f9841 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=32199feb-6f3a-4642-a10b-5d278d90a9e5 HTTP/1.1" status: 200 len: 852 time: 0.1726084 Dec 24 04:59:41.242914 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-e06507d6-4b16-4a58-b571-46613445ae79 req-c847138a-eb61-49af-a7be-f39f765c90e5 service neutron] For port ea61b5c0-ffb7-42bf-9289-095515c125a2, host hv-cinder-81644, cleared binding levels {{(pid=102476) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 04:59:41.263365 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d31362ce-5b77-4c94-ba01-1880df3d987e req-56f943b0-75b3-4f58-8a7f-471bee00b8de tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:41.264738 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d31362ce-5b77-4c94-ba01-1880df3d987e req-56f943b0-75b3-4f58-8a7f-471bee00b8de tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 943 time: 0.2890456 Dec 24 04:59:41.320633 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-e06507d6-4b16-4a58-b571-46613445ae79 req-c847138a-eb61-49af-a7be-f39f765c90e5 service neutron] For port ea61b5c0-ffb7-42bf-9289-095515c125a2, host hv-cinder-81644, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=ea61b5c0-ffb7-42bf-9289-095515c125a2,segment=NetworkSegment(d94b0a1e-2098-4b10-9091-c566351ffe74),segment_id=d94b0a1e-2098-4b10-9091-c566351ffe74)] {{(pid=102476) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 04:59:41.327626 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-41524979-bc92-4a07-aa6c-53123b56d762 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=598b6cd9-9673-4e27-b33e-451cd98b5f1c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0780652 Dec 24 04:59:41.339628 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-e06507d6-4b16-4a58-b571-46613445ae79 req-c847138a-eb61-49af-a7be-f39f765c90e5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:41.341677 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-7fbbe14b-2c8f-4097-9d85-ccafa87c0ead tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:41.434710 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e06507d6-4b16-4a58-b571-46613445ae79 req-c847138a-eb61-49af-a7be-f39f765c90e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:41.435346 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-e06507d6-4b16-4a58-b571-46613445ae79 req-c847138a-eb61-49af-a7be-f39f765c90e5 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:41.436705 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e06507d6-4b16-4a58-b571-46613445ae79 req-c847138a-eb61-49af-a7be-f39f765c90e5 service neutron] 10.222.0.46 "PUT /v2.0/ports/ea61b5c0-ffb7-42bf-9289-095515c125a2 HTTP/1.1" status: 200 len: 1093 time: 2.6023200 Dec 24 04:59:41.444723 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '27408900-d9e8-47e1-be4d-aac80e3f6fae', 'tag': 'ea61b5c0-ffb7-42bf-9289-095515c125a2'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 04:59:41.447059 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-94443b49-3099-4f74-9e6f-c20c97783531" -d '{"events": [{"name": "network-changed", "server_uuid": "27408900-d9e8-47e1-be4d-aac80e3f6fae", "tag": "ea61b5c0-ffb7-42bf-9289-095515c125a2"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 04:59:41.467354 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-7fbbe14b-2c8f-4097-9d85-ccafa87c0ead tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Network 0d368baa-5733-40a7-b836-139a541f4ebb is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 04:59:41.509218 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-7fbbe14b-2c8f-4097-9d85-ccafa87c0ead tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:59:41.522455 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d31362ce-5b77-4c94-ba01-1880df3d987e req-a56a921a-79c9-48b5-8ae5-767b3de28370 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2226779 Dec 24 04:59:41.523763 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-7fbbe14b-2c8f-4097-9d85-ccafa87c0ead tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 04:59:41.536852 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-c43134b6-4d1d-4056-b351-f288222c5629 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Made reservation on behalf of 6c9c47f70b8d4da5827a8ef4349559ab for: {'port': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:59:41.540183 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-c43134b6-4d1d-4056-b351-f288222c5629 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:41.607030 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c847138a-eb61-49af-a7be-f39f765c90e5 service neutron] Pushing event updated for resources: {'Port': ['ID=ea61b5c0-ffb7-42bf-9289-095515c125a2,revision_number=3']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:41.618600 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 04:59:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-50555602-d064-4f56-b687-aefa24a4d582 x-openstack-request-id: req-50555602-d064-4f56-b687-aefa24a4d582 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 04:59:41.619411 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "27408900-d9e8-47e1-be4d-aac80e3f6fae", "tag": "ea61b5c0-ffb7-42bf-9289-095515c125a2", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 04:59:41.619411 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-50555602-d064-4f56-b687-aefa24a4d582 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 04:59:41.619691 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '27408900-d9e8-47e1-be4d-aac80e3f6fae', 'tag': 'ea61b5c0-ffb7-42bf-9289-095515c125a2', 'status': 'completed', 'code': 200} Dec 24 04:59:41.668710 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-45f020c8-647f-4e87-bf24-2bfb392f78c8 service neutron] 10.222.0.46 "GET /v2.0/networks/598b6cd9-9673-4e27-b33e-451cd98b5f1c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3240325 Dec 24 04:59:41.745374 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-7fbbe14b-2c8f-4097-9d85-ccafa87c0ead tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:41.745985 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-7fbbe14b-2c8f-4097-9d85-ccafa87c0ead tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:41.765584 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e06507d6-4b16-4a58-b571-46613445ae79 req-413518c0-f362-415a-8b45-4103b56add4d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:41.767321 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e06507d6-4b16-4a58-b571-46613445ae79 req-413518c0-f362-415a-8b45-4103b56add4d service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=1b651e55b1a349a0b9582c526d3b5d67&device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 1096 time: 0.2503667 Dec 24 04:59:41.779437 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fbbe14b-2c8f-4097-9d85-ccafa87c0ead tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Pushing event updated for resources: {'Port': ['ID=24d08627-8243-4361-b6b4-8461a18d110f,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:41.828085 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-7fbbe14b-2c8f-4097-9d85-ccafa87c0ead tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.46 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.6372764 Dec 24 04:59:41.867802 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-8847ada2-17cd-478e-af7f-fea22b0b56e4 service neutron] Request body: {'port': {'device_id': '580344bb-42e6-4fd7-967d-04e85d821fd2', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81644'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:41.881743 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e06507d6-4b16-4a58-b571-46613445ae79 req-729e6ef9-b4d0-4bca-8e9a-4b64c227fe16 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ea61b5c0-ffb7-42bf-9289-095515c125a2 HTTP/1.1" status: 200 len: 217 time: 0.0954981 Dec 24 04:59:41.952206 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-97ca6bf4-3760-46bb-9261-ab28a4c61fa2 req-3050cf82-6515-45fd-b62c-8dc08b3286ca tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 210 time: 0.0910327 Dec 24 04:59:42.011390 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-510fa22f-7250-402a-aa5f-300e3a904f77 req-1aa243d0-24d4-4716-8355-f7aa38cc0309 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:42.013672 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-510fa22f-7250-402a-aa5f-300e3a904f77 req-1aa243d0-24d4-4716-8355-f7aa38cc0309 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 944 time: 0.0654933 Dec 24 04:59:42.035095 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-6b83bff8-e941-4bb9-b4f4-fd229e70fb6a service neutron] 10.222.0.46 "GET /v2.0/networks/598b6cd9-9673-4e27-b33e-451cd98b5f1c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3574140 Dec 24 04:59:42.048812 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e06507d6-4b16-4a58-b571-46613445ae79 req-0aa005de-37c9-4246-81c8-fb8aa5fc178c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:42.050280 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e06507d6-4b16-4a58-b571-46613445ae79 req-0aa005de-37c9-4246-81c8-fb8aa5fc178c service neutron] 10.222.0.46 "GET /v2.0/subnets?id=88f274d6-bcf0-47e8-9f0a-783a53214be4 HTTP/1.1" status: 200 len: 858 time: 0.1413541 Dec 24 04:59:42.053216 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-c43134b6-4d1d-4056-b351-f288222c5629 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Allocated IP 172.20.0.7 (c908572e-3b6b-470c-8b88-35b51f1472c6/699b398d-7f9d-4acb-bc18-ac32f35377c3/61ec3441-5b75-4c07-b8ad-4174450d6a55) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 04:59:42.055722 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-8847ada2-17cd-478e-af7f-fea22b0b56e4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:42.089489 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-510fa22f-7250-402a-aa5f-300e3a904f77 req-f1807bed-12be-4ed5-9169-5f25fd3b9713 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0663254 Dec 24 04:59:42.101477 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e06507d6-4b16-4a58-b571-46613445ae79 req-1e59ee53-0322-48a0-8961-8806a7b0da92 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=0d368baa-5733-40a7-b836-139a541f4ebb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0412130 Dec 24 04:59:42.517375 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 52264) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:42.600085 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2d0c618-42b5-49d7-ac28-6f4f294b21c5 req-6c34642e-6873-4018-b5db-a552363b37fb tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:42.601639 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b2d0c618-42b5-49d7-ac28-6f4f294b21c5 req-6c34642e-6873-4018-b5db-a552363b37fb tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 932 time: 0.4726865 Dec 24 04:59:42.648237 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-17f1e627-059b-4a93-b8ae-de4daee3f4f1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:42.652642 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e06507d6-4b16-4a58-b571-46613445ae79 req-56426d3b-75c6-4863-bf1d-3f3c01202c89 service neutron] 10.222.0.46 "GET /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5169537 Dec 24 04:59:42.682107 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e606968-f83d-4ad8-96e3-fbd5953ad889 req-cde19bc7-4833-471b-ae64-9cca1def59e8 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:42.683614 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6e606968-f83d-4ad8-96e3-fbd5953ad889 req-cde19bc7-4833-471b-ae64-9cca1def59e8 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 943 time: 0.0785296 Dec 24 04:59:42.743226 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-c43134b6-4d1d-4056-b351-f288222c5629 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:42.770898 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6e606968-f83d-4ad8-96e3-fbd5953ad889 req-ec871609-d205-4e93-aba1-02fabe4cecc9 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0772223 Dec 24 04:59:42.800239 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-17f1e627-059b-4a93-b8ae-de4daee3f4f1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:42.805946 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-17f1e627-059b-4a93-b8ae-de4daee3f4f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:42.810985 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b2d0c618-42b5-49d7-ac28-6f4f294b21c5 req-3c827a2c-bd85-4f0a-a22b-4aab74867da7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1956246 Dec 24 04:59:42.849255 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-17f1e627-059b-4a93-b8ae-de4daee3f4f1 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=02dd5afff89945a8ae8c718fcbbb18e5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3307264 Dec 24 04:59:42.851191 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17f1e627-059b-4a93-b8ae-de4daee3f4f1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2035e121-2f57-4a24-9be1-bf55c015088a,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:42.854701 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 52276) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:42.878247 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e06507d6-4b16-4a58-b571-46613445ae79 req-468fa568-d930-4609-8e4f-20edd877285c service neutron] 10.222.0.46 "GET /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2127309 Dec 24 04:59:42.901034 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-c43134b6-4d1d-4056-b351-f288222c5629 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:42.924451 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1514d6d8-9f87-401a-85bf-69e06bc06d3f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:42.947251 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1514d6d8-9f87-401a-85bf-69e06bc06d3f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:42.981405 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-c43134b6-4d1d-4056-b351-f288222c5629 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Network c908572e-3b6b-470c-8b88-35b51f1472c6 is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 04:59:42.983036 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-c43134b6-4d1d-4056-b351-f288222c5629 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:59:42.986248 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-c43134b6-4d1d-4056-b351-f288222c5629 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 04:59:43.010792 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-8847ada2-17cd-478e-af7f-fea22b0b56e4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 24d08627-8243-4361-b6b4-8461a18d110f {{(pid=102476) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 04:59:43.027840 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1514d6d8-9f87-401a-85bf-69e06bc06d3f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:43.032484 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1514d6d8-9f87-401a-85bf-69e06bc06d3f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:43.035145 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-1514d6d8-9f87-401a-85bf-69e06bc06d3f admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/2035e121-2f57-4a24-9be1-bf55c015088a HTTP/1.1" status: 204 len: 168 time: 0.1794958 Dec 24 04:59:43.042039 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-8847ada2-17cd-478e-af7f-fea22b0b56e4 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:43.046694 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1514d6d8-9f87-401a-85bf-69e06bc06d3f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2035e121-2f57-4a24-9be1-bf55c015088a,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:43.063658 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c43134b6-4d1d-4056-b351-f288222c5629 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Pushing event updated for resources: {'Port': ['ID=61ec3441-5b75-4c07-b8ad-4174450d6a55,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:43.101361 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.provisioning_blocks [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-8847ada2-17cd-478e-af7f-fea22b0b56e4 service neutron] Transition to ACTIVE for port object 24d08627-8243-4361-b6b4-8461a18d110f will not be triggered until provisioned by entity L2. {{(pid=102476) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 24 04:59:43.147826 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-c43134b6-4d1d-4056-b351-f288222c5629 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:43.152705 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-c43134b6-4d1d-4056-b351-f288222c5629 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:43.163850 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-8847ada2-17cd-478e-af7f-fea22b0b56e4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:43.201587 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8f29ec8-9a8c-4875-b357-603f6e6c2244 req-8d7d2a46-a36f-4b22-95b7-b1cbf6b27115 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:43.211404 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f8f29ec8-9a8c-4875-b357-603f6e6c2244 req-8d7d2a46-a36f-4b22-95b7-b1cbf6b27115 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 931 time: 0.0924809 Dec 24 04:59:43.227501 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8847ada2-17cd-478e-af7f-fea22b0b56e4 service neutron] Pushing event updated for resources: {'Port': ['ID=24d08627-8243-4361-b6b4-8461a18d110f,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:43.287767 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-c43134b6-4d1d-4056-b351-f288222c5629 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.46 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.2781794 Dec 24 04:59:43.298397 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94443b49-3099-4f74-9e6f-c20c97783531 req-3026b0d2-fee6-4427-ab7b-5cd236b5f205 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:43.301048 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-94443b49-3099-4f74-9e6f-c20c97783531 req-3026b0d2-fee6-4427-ab7b-5cd236b5f205 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=1b651e55b1a349a0b9582c526d3b5d67&device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 1096 time: 0.2819004 Dec 24 04:59:43.301349 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f8f29ec8-9a8c-4875-b357-603f6e6c2244 req-e06b8f2a-b284-4fbd-bc30-7342436cb894 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0887799 Dec 24 04:59:43.314278 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-9ee996d5-4dc7-424b-bcf5-ad9ec73129e9 service neutron] Request body: {'port': {'device_id': '6485c286-d5e3-42e7-bf58-c4685f8c3066', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81644'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:43.386764 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-9c89c8c8-898c-44a2-9221-100eb7e46045 None None] Provisioning complete for port 61ec3441-5b75-4c07-b8ad-4174450d6a55 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:59:43.388630 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-9c89c8c8-898c-44a2-9221-100eb7e46045 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:43.425753 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-9c89c8c8-898c-44a2-9221-100eb7e46045 None None] Port 61ec3441-5b75-4c07-b8ad-4174450d6a55 cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 04:59:43.476760 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 52304) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:43.489835 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-dfbcb8cc-5fde-42c8-8c73-76edbc768bb1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:43.498886 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a047885-ef73-4105-aa7c-ba781701301e req-6c46be57-1c4f-4f04-84b0-b223ca15900e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:43.501159 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9a047885-ef73-4105-aa7c-ba781701301e req-6c46be57-1c4f-4f04-84b0-b223ca15900e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 944 time: 0.2766633 Dec 24 04:59:43.565479 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-9ee996d5-4dc7-424b-bcf5-ad9ec73129e9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:43.567547 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-dfbcb8cc-5fde-42c8-8c73-76edbc768bb1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:43.572024 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-dfbcb8cc-5fde-42c8-8c73-76edbc768bb1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:43.616927 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-dfbcb8cc-5fde-42c8-8c73-76edbc768bb1 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=d13b030d8dcf4f56a602d519618ba88d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1390271 Dec 24 04:59:43.617529 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 52306) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:43.626772 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfbcb8cc-5fde-42c8-8c73-76edbc768bb1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2905fa3b-82c4-4d95-8016-808dce0ac607,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:43.665227 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94443b49-3099-4f74-9e6f-c20c97783531 req-b76b6f5c-b7cb-4723-b55a-fe996bb4986c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:43.666692 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-94443b49-3099-4f74-9e6f-c20c97783531 req-b76b6f5c-b7cb-4723-b55a-fe996bb4986c service neutron] 10.222.0.46 "GET /v2.0/networks?id=0d368baa-5733-40a7-b836-139a541f4ebb HTTP/1.1" status: 200 len: 919 time: 0.3472331 Dec 24 04:59:43.681034 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-8847ada2-17cd-478e-af7f-fea22b0b56e4 service neutron] Attempting to bind port 24d08627-8243-4361-b6b4-8461a18d110f on host hv-cinder-81644 for vnic_type normal with profile {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 04:59:43.681370 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-8847ada2-17cd-478e-af7f-fea22b0b56e4 service neutron] Attempting to bind port 24d08627-8243-4361-b6b4-8461a18d110f by drivers openvswitch,hyperv on host hv-cinder-81644 at level 0 using segments [{'id': 'd94b0a1e-2098-4b10-9091-c566351ffe74', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '0d368baa-5733-40a7-b836-139a541f4ebb'}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 04:59:43.681707 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-8847ada2-17cd-478e-af7f-fea22b0b56e4 service neutron] Attempting to bind port 24d08627-8243-4361-b6b4-8461a18d110f on network 0d368baa-5733-40a7-b836-139a541f4ebb {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 04:59:43.683830 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1b0dbc20-692e-4cb1-b0ba-b72f5b2d60af admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:43.694551 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9a047885-ef73-4105-aa7c-ba781701301e req-15609800-ce1e-4694-a290-fdf1194a323e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1558266 Dec 24 04:59:43.710963 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1b0dbc20-692e-4cb1-b0ba-b72f5b2d60af admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:43.740220 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-94443b49-3099-4f74-9e6f-c20c97783531 req-3002b03d-b1ec-4697-ab54-583cecb946f3 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ea61b5c0-ffb7-42bf-9289-095515c125a2 HTTP/1.1" status: 200 len: 217 time: 0.0620048 Dec 24 04:59:43.741170 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-8847ada2-17cd-478e-af7f-fea22b0b56e4 service neutron] Port 24d08627-8243-4361-b6b4-8461a18d110f on network 0d368baa-5733-40a7-b836-139a541f4ebb not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81644 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 24 04:59:43.741360 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-8847ada2-17cd-478e-af7f-fea22b0b56e4 service neutron] Attempting to bind port 24d08627-8243-4361-b6b4-8461a18d110f on network 0d368baa-5733-40a7-b836-139a541f4ebb {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 04:59:43.768069 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1b0dbc20-692e-4cb1-b0ba-b72f5b2d60af admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:43.771064 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1b0dbc20-692e-4cb1-b0ba-b72f5b2d60af admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:43.772401 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-1b0dbc20-692e-4cb1-b0ba-b72f5b2d60af admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/2905fa3b-82c4-4d95-8016-808dce0ac607 HTTP/1.1" status: 204 len: 168 time: 0.1529822 Dec 24 04:59:43.780931 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b0dbc20-692e-4cb1-b0ba-b72f5b2d60af admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2905fa3b-82c4-4d95-8016-808dce0ac607,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:43.802633 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-8847ada2-17cd-478e-af7f-fea22b0b56e4 service neutron] Checking agent: {'id': '7a2ffd19-371f-4f7b-a239-eea3b5cfd55b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81644', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'started_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 4, 59, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 04:59:43.803211 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-8847ada2-17cd-478e-af7f-fea22b0b56e4 service neutron] Checking segment: {'id': 'd94b0a1e-2098-4b10-9091-c566351ffe74', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '0d368baa-5733-40a7-b836-139a541f4ebb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:59:43.803593 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-8847ada2-17cd-478e-af7f-fea22b0b56e4 service neutron] Bound using segment: {'id': 'd94b0a1e-2098-4b10-9091-c566351ffe74', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '0d368baa-5733-40a7-b836-139a541f4ebb'} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 04:59:43.804202 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-8847ada2-17cd-478e-af7f-fea22b0b56e4 service neutron] Bound port: 24d08627-8243-4361-b6b4-8461a18d110f, host: hv-cinder-81644, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd94b0a1e-2098-4b10-9091-c566351ffe74', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '0d368baa-5733-40a7-b836-139a541f4ebb'}}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 04:59:43.804968 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-8847ada2-17cd-478e-af7f-fea22b0b56e4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:43.912678 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94443b49-3099-4f74-9e6f-c20c97783531 req-5cff9951-688e-485a-82b4-8d8c0b6a5f46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:43.914201 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-94443b49-3099-4f74-9e6f-c20c97783531 req-5cff9951-688e-485a-82b4-8d8c0b6a5f46 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=88f274d6-bcf0-47e8-9f0a-783a53214be4 HTTP/1.1" status: 200 len: 858 time: 0.1655593 Dec 24 04:59:43.927732 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23c630fa-e806-47c9-81d0-8699fc96b759 req-f11e865d-0a7a-4be5-ab3e-791a89cbc07f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:43.929526 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-23c630fa-e806-47c9-81d0-8699fc96b759 req-f11e865d-0a7a-4be5-ab3e-791a89cbc07f tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 943 time: 0.0671196 Dec 24 04:59:44.012214 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-23c630fa-e806-47c9-81d0-8699fc96b759 req-ab44fc42-4c5e-459c-953d-6e862b5a528d tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0725591 Dec 24 04:59:44.017032 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-94443b49-3099-4f74-9e6f-c20c97783531 req-727f5bd5-1d89-4996-97a6-4cefab8a1d8b service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=0d368baa-5733-40a7-b836-139a541f4ebb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0831251 Dec 24 04:59:44.023661 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 52320) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:44.033980 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 50d50f46-e761-4fb1-9761-fa48778aa8aa details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 04:59:44.052598 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-8847ada2-17cd-478e-af7f-fea22b0b56e4 service neutron] For port 24d08627-8243-4361-b6b4-8461a18d110f, host hv-cinder-81644, cleared binding levels {{(pid=102476) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 04:59:44.093109 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-8847ada2-17cd-478e-af7f-fea22b0b56e4 service neutron] For port 24d08627-8243-4361-b6b4-8461a18d110f, host hv-cinder-81644, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=24d08627-8243-4361-b6b4-8461a18d110f,segment=NetworkSegment(d94b0a1e-2098-4b10-9091-c566351ffe74),segment_id=d94b0a1e-2098-4b10-9091-c566351ffe74)] {{(pid=102476) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 04:59:44.115352 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74ff9184-162c-4618-8ac4-26a9ee50da55 req-53120b66-2277-4631-8e25-7bbdf7a70a28 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:44.116923 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-74ff9184-162c-4618-8ac4-26a9ee50da55 req-53120b66-2277-4631-8e25-7bbdf7a70a28 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 944 time: 0.2077026 Dec 24 04:59:44.145402 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-8847ada2-17cd-478e-af7f-fea22b0b56e4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:44.193553 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 50d50f46-e761-4fb1-9761-fa48778aa8aa, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=50d50f46-e761-4fb1-9761-fa48778aa8aa,segment=NetworkSegment(10307c97-e214-473b-b760-bb1b770153ec),segment_id=10307c97-e214-473b-b760-bb1b770153ec)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 04:59:44.217163 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': '50d50f46-e761-4fb1-9761-fa48778aa8aa', 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e', 'port_id': '50d50f46-e761-4fb1-9761-fa48778aa8aa', 'mac_address': 'fa:16:3e:a4:6c:f0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9b9ff65f-93c8-4cb1-8a99-961ba0d4beaa', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 04:59:44.269690 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:44.285699 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 50d50f46-e761-4fb1-9761-fa48778aa8aa {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 04:59:44.317637 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 50d50f46-e761-4fb1-9761-fa48778aa8aa, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=50d50f46-e761-4fb1-9761-fa48778aa8aa,segment=NetworkSegment(10307c97-e214-473b-b760-bb1b770153ec),segment_id=10307c97-e214-473b-b760-bb1b770153ec)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 04:59:44.328502 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:44.403728 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=50d50f46-e761-4fb1-9761-fa48778aa8aa,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:44.486581 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-8847ada2-17cd-478e-af7f-fea22b0b56e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:44.487210 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-8847ada2-17cd-478e-af7f-fea22b0b56e4 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:44.489840 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-8847ada2-17cd-478e-af7f-fea22b0b56e4 service neutron] 10.222.0.46 "PUT /v2.0/ports/24d08627-8243-4361-b6b4-8461a18d110f HTTP/1.1" status: 200 len: 1094 time: 2.6255832 Dec 24 04:59:44.492860 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '580344bb-42e6-4fd7-967d-04e85d821fd2', 'tag': '24d08627-8243-4361-b6b4-8461a18d110f'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 04:59:44.495612 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-753dd227-2cb1-4206-b7f4-aabbf9853dfc" -d '{"events": [{"name": "network-changed", "server_uuid": "580344bb-42e6-4fd7-967d-04e85d821fd2", "tag": "24d08627-8243-4361-b6b4-8461a18d110f"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 04:59:44.499163 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c6629c29-4532-47d3-9dd5-71928dabf0ad admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:44.542220 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd6cb00-8afe-4011-b914-a420d7ff3ef2 req-0959ef60-b0af-4411-be82-775245e620ba tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:44.572755 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-fdd6cb00-8afe-4011-b914-a420d7ff3ef2 req-0959ef60-b0af-4411-be82-775245e620ba tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 931 time: 0.1721640 Dec 24 04:59:44.613050 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-94443b49-3099-4f74-9e6f-c20c97783531 req-c9e2c4f2-fa9d-4b4a-8c20-34b8b3c6d5a4 service neutron] 10.222.0.46 "GET /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5724380 Dec 24 04:59:44.634242 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8847ada2-17cd-478e-af7f-fea22b0b56e4 service neutron] Pushing event updated for resources: {'Port': ['ID=24d08627-8243-4361-b6b4-8461a18d110f,revision_number=3']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:44.652197 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-fdd6cb00-8afe-4011-b914-a420d7ff3ef2 req-caf133f9-fe3b-436f-9e8a-6c068fc1776b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0772274 Dec 24 04:59:44.688061 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-74ff9184-162c-4618-8ac4-26a9ee50da55 req-f37b4691-a607-4ed4-9e39-d9aea0e2c7b6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5384581 Dec 24 04:59:44.726098 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-9ee996d5-4dc7-424b-bcf5-ad9ec73129e9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 61ec3441-5b75-4c07-b8ad-4174450d6a55 {{(pid=102476) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 04:59:44.762824 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-9ee996d5-4dc7-424b-bcf5-ad9ec73129e9 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:44.774502 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 04:59:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-58e888c7-7de1-4094-9db5-5624fae2df5e x-openstack-request-id: req-58e888c7-7de1-4094-9db5-5624fae2df5e {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 04:59:44.774776 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "580344bb-42e6-4fd7-967d-04e85d821fd2", "tag": "24d08627-8243-4361-b6b4-8461a18d110f", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 04:59:44.775212 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-58e888c7-7de1-4094-9db5-5624fae2df5e {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 04:59:44.775788 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '580344bb-42e6-4fd7-967d-04e85d821fd2', 'tag': '24d08627-8243-4361-b6b4-8461a18d110f', 'status': 'completed', 'code': 200} Dec 24 04:59:44.795665 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-f2202575-db2b-44ad-b152-fe7c477acfbd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:44.797346 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-f2202575-db2b-44ad-b152-fe7c477acfbd service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=1b651e55b1a349a0b9582c526d3b5d67&device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 1097 time: 0.1922398 Dec 24 04:59:44.799395 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 52366) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:44.851167 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.provisioning_blocks [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-9ee996d5-4dc7-424b-bcf5-ad9ec73129e9 service neutron] Transition to ACTIVE for port object 61ec3441-5b75-4c07-b8ad-4174450d6a55 will not be triggered until provisioned by entity L2. {{(pid=102476) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 24 04:59:44.863550 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 52370) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:44.923660 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-9ee996d5-4dc7-424b-bcf5-ad9ec73129e9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:44.938818 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['50d50f46-e761-4fb1-9761-fa48778aa8aa'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 04:59:44.944838 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-7e5721c0-8db8-45bc-9515-f2a90a15f174 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1147006189-network', 'tenant_id': '1e014b3683d841968563e0aa0705e862'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:44.957643 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-43a15969-337e-45a9-a5a6-a823015599fe service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=24d08627-8243-4361-b6b4-8461a18d110f HTTP/1.1" status: 200 len: 217 time: 0.1050062 Dec 24 04:59:44.983300 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7e5721c0-8db8-45bc-9515-f2a90a15f174 admin admin] Made reservation on behalf of 1e014b3683d841968563e0aa0705e862 for: {'network': 1} {{(pid=102477) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:59:44.990145 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7e5721c0-8db8-45bc-9515-f2a90a15f174 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for network, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.004670 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7e5721c0-8db8-45bc-9515-f2a90a15f174 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.038091 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-852ff45d-4d14-49df-a2f9-3f77a409da03 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.075633 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-94443b49-3099-4f74-9e6f-c20c97783531 req-6295366b-9058-4ce8-8d00-5180f26d4369 service neutron] 10.222.0.46 "GET /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4328253 Dec 24 04:59:45.091622 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c6629c29-4532-47d3-9dd5-71928dabf0ad admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.110408 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ee996d5-4dc7-424b-bcf5-ad9ec73129e9 service neutron] Pushing event updated for resources: {'Port': ['ID=61ec3441-5b75-4c07-b8ad-4174450d6a55,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:45.113702 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c6629c29-4532-47d3-9dd5-71928dabf0ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:45.144962 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:45.146792 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:45.146792 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:45.146792 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:45.146792 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:45.146792 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:45.146792 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:45.146792 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:45.146792 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:45.146792 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:45.146792 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:45.146792 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 04:59:45.146792 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 04:59:45.146792 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-200701c9-5ab7-479c-9dc4-f4d4204f9050 req-62b90bbb-403c-4d59-973e-cda5c18d96be tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:45.154335 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-200701c9-5ab7-479c-9dc4-f4d4204f9050 req-62b90bbb-403c-4d59-973e-cda5c18d96be tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 945 time: 0.2914772 Dec 24 04:59:45.156923 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-360e4939-ad6a-4b26-8a50-6d8e4031a700 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:45.158543 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-360e4939-ad6a-4b26-8a50-6d8e4031a700 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=88f274d6-bcf0-47e8-9f0a-783a53214be4 HTTP/1.1" status: 200 len: 858 time: 0.1798725 Dec 24 04:59:45.292230 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-6860880d-977a-4f03-8fc8-362652c7fa17 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=0d368baa-5733-40a7-b836-139a541f4ebb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1017118 Dec 24 04:59:45.298378 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-c6629c29-4532-47d3-9dd5-71928dabf0ad admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=1902a6ad87414fb187bc9daafee87d64&name=default HTTP/1.1" status: 200 len: 2996 time: 1.2706344 Dec 24 04:59:45.301259 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 52376) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:45.303222 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6629c29-4532-47d3-9dd5-71928dabf0ad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=75f5ca1f-c793-4c54-972b-332efa663ec6,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:45.310919 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7e5721c0-8db8-45bc-9515-f2a90a15f174 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.327243 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7e5721c0-8db8-45bc-9515-f2a90a15f174 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.362703 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-591ce55e-83cb-49e3-bd02-cf2f4ccf8688 req-9750aec2-eeab-4b27-bd35-c9d5a7833ee4 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:45.364236 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-591ce55e-83cb-49e3-bd02-cf2f4ccf8688 req-9750aec2-eeab-4b27-bd35-c9d5a7833ee4 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 943 time: 0.1468632 Dec 24 04:59:45.376990 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7e5721c0-8db8-45bc-9515-f2a90a15f174 admin admin] vlan segment allocate from pool success with {'vlan_id': 103, 'physical_network': 'physnet1'} {{(pid=102477) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 24 04:59:45.422256 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7e5721c0-8db8-45bc-9515-f2a90a15f174 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.422619 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.db.segments_db [None req-7e5721c0-8db8-45bc-9515-f2a90a15f174 admin admin] Added segment 00999af0-b9ae-4a2b-9c30-590dbe00c43a of type vlan for network c2c27570-f2cd-4dac-9473-e82a4e432501 Dec 24 04:59:45.423860 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e5721c0-8db8-45bc-9515-f2a90a15f174 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4e2bef2c-8155-47f6-8213-b403361d85dc,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:45.448446 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-200701c9-5ab7-479c-9dc4-f4d4204f9050 req-c85cd23f-8c54-4fd9-b93c-3b6fda148ac8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2935030 Dec 24 04:59:45.465717 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-9ee996d5-4dc7-424b-bcf5-ad9ec73129e9 service neutron] Attempting to bind port 61ec3441-5b75-4c07-b8ad-4174450d6a55 on host hv-cinder-81644 for vnic_type normal with profile {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 04:59:45.466128 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-9ee996d5-4dc7-424b-bcf5-ad9ec73129e9 service neutron] Attempting to bind port 61ec3441-5b75-4c07-b8ad-4174450d6a55 by drivers openvswitch,hyperv on host hv-cinder-81644 at level 0 using segments [{'id': 'db374990-dadf-47a9-9824-44188ba20dd8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6'}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 04:59:45.466547 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-9ee996d5-4dc7-424b-bcf5-ad9ec73129e9 service neutron] Attempting to bind port 61ec3441-5b75-4c07-b8ad-4174450d6a55 on network c908572e-3b6b-470c-8b88-35b51f1472c6 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 04:59:45.467298 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-852ff45d-4d14-49df-a2f9-3f77a409da03 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.480979 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-852ff45d-4d14-49df-a2f9-3f77a409da03 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.488325 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-9ee996d5-4dc7-424b-bcf5-ad9ec73129e9 service neutron] Port 61ec3441-5b75-4c07-b8ad-4174450d6a55 on network c908572e-3b6b-470c-8b88-35b51f1472c6 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81644 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 24 04:59:45.488674 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-9ee996d5-4dc7-424b-bcf5-ad9ec73129e9 service neutron] Attempting to bind port 61ec3441-5b75-4c07-b8ad-4174450d6a55 on network c908572e-3b6b-470c-8b88-35b51f1472c6 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 04:59:45.497708 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e8f1be0d-46e3-45b2-b6d0-5b3ca4b42ee9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.501570 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-06490b2d-a9c3-4e30-957a-4cf91a6cf612 service neutron] 10.222.0.46 "GET /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1993124 Dec 24 04:59:45.502264 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-9ee996d5-4dc7-424b-bcf5-ad9ec73129e9 service neutron] Checking agent: {'id': '7a2ffd19-371f-4f7b-a239-eea3b5cfd55b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81644', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'started_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 4, 59, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 04:59:45.502590 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-9ee996d5-4dc7-424b-bcf5-ad9ec73129e9 service neutron] Checking segment: {'id': 'db374990-dadf-47a9-9824-44188ba20dd8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:59:45.502951 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-9ee996d5-4dc7-424b-bcf5-ad9ec73129e9 service neutron] Bound using segment: {'id': 'db374990-dadf-47a9-9824-44188ba20dd8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6'} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 04:59:45.503380 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-9ee996d5-4dc7-424b-bcf5-ad9ec73129e9 service neutron] Bound port: 61ec3441-5b75-4c07-b8ad-4174450d6a55, host: hv-cinder-81644, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'db374990-dadf-47a9-9824-44188ba20dd8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6'}}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 04:59:45.503712 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-9ee996d5-4dc7-424b-bcf5-ad9ec73129e9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.510240 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7e5721c0-8db8-45bc-9515-f2a90a15f174 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750577486812'] for network, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.539978 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-591ce55e-83cb-49e3-bd02-cf2f4ccf8688 req-f9e469c6-e9ff-4ec8-8cdf-b91f30e7e6b4 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1599929 Dec 24 04:59:45.552287 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-852ff45d-4d14-49df-a2f9-3f77a409da03 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=f65fb81402bc4237ae5f45bfe0915c73&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6876616 Dec 24 04:59:45.552995 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e8f1be0d-46e3-45b2-b6d0-5b3ca4b42ee9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.555434 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 52378) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:45.563341 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-852ff45d-4d14-49df-a2f9-3f77a409da03 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4dee6273-065f-43ed-8ae4-a4f3b599d321,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:45.583455 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7e5721c0-8db8-45bc-9515-f2a90a15f174 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for network, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.584396 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e5721c0-8db8-45bc-9515-f2a90a15f174 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:45.585336 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7e5721c0-8db8-45bc-9515-f2a90a15f174 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.634034 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-7e5721c0-8db8-45bc-9515-f2a90a15f174 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.8335016 Dec 24 04:59:45.644790 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 52380) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:45.653131 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-2a069455-c70f-449a-ac89-2ecbb97b07fe admin admin] Request body: {'subnet': {'network_id': 'c2c27570-f2cd-4dac-9473-e82a4e432501', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1147006189-subnet', 'tenant_id': '1e014b3683d841968563e0aa0705e862', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:45.677755 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e5721c0-8db8-45bc-9515-f2a90a15f174 admin admin] Pushing event updated for resources: {'Network': ['ID=c2c27570-f2cd-4dac-9473-e82a4e432501,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:45.679769 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a1bbb09a-a3ee-420b-9413-af34fd77ab41 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.695703 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Network c2c27570-f2cd-4dac-9473-e82a4e432501 details requested by agent ovs-agent-dv-cinder-816443-2-iscsi with host dv-cinder-816443-2-iscsi {{(pid=102478) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 24 04:59:45.711537 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-9ee996d5-4dc7-424b-bcf5-ad9ec73129e9 service neutron] For port 61ec3441-5b75-4c07-b8ad-4174450d6a55, host hv-cinder-81644, cleared binding levels {{(pid=102476) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 04:59:45.716364 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-9ee996d5-4dc7-424b-bcf5-ad9ec73129e9 service neutron] For port 61ec3441-5b75-4c07-b8ad-4174450d6a55, host hv-cinder-81644, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=61ec3441-5b75-4c07-b8ad-4174450d6a55,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102476) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 04:59:45.721039 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d9b65ee9-8c1e-4fb9-9246-88698528c21a req-a1113b0e-c967-4dcd-81fd-79c8c2bbdd97 service neutron] 10.222.0.46 "GET /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2024155 Dec 24 04:59:45.726257 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-9ee996d5-4dc7-424b-bcf5-ad9ec73129e9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.727641 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a1bbb09a-a3ee-420b-9413-af34fd77ab41 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.734532 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e8f1be0d-46e3-45b2-b6d0-5b3ca4b42ee9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.737190 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e8f1be0d-46e3-45b2-b6d0-5b3ca4b42ee9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.741037 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-e8f1be0d-46e3-45b2-b6d0-5b3ca4b42ee9 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/75f5ca1f-c793-4c54-972b-332efa663ec6 HTTP/1.1" status: 204 len: 168 time: 0.4349880 Dec 24 04:59:45.765324 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2a069455-c70f-449a-ac89-2ecbb97b07fe admin admin] Made reservation on behalf of 1e014b3683d841968563e0aa0705e862 for: {'subnet': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:59:45.767850 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2a069455-c70f-449a-ac89-2ecbb97b07fe admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-32970422'] for subnet, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.791415 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8f1be0d-46e3-45b2-b6d0-5b3ca4b42ee9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=75f5ca1f-c793-4c54-972b-332efa663ec6,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:45.797336 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-9ee996d5-4dc7-424b-bcf5-ad9ec73129e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:45.797954 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-9ee996d5-4dc7-424b-bcf5-ad9ec73129e9 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.799343 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-9ee996d5-4dc7-424b-bcf5-ad9ec73129e9 service neutron] 10.222.0.46 "PUT /v2.0/ports/61ec3441-5b75-4c07-b8ad-4174450d6a55 HTTP/1.1" status: 200 len: 1093 time: 2.4969628 Dec 24 04:59:45.848021 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a1bbb09a-a3ee-420b-9413-af34fd77ab41 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.854356 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a1bbb09a-a3ee-420b-9413-af34fd77ab41 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:45.860306 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-a1bbb09a-a3ee-420b-9413-af34fd77ab41 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/4dee6273-065f-43ed-8ae4-a4f3b599d321 HTTP/1.1" status: 204 len: 168 time: 0.3014135 Dec 24 04:59:45.907664 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1bbb09a-a3ee-420b-9413-af34fd77ab41 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4dee6273-065f-43ed-8ae4-a4f3b599d321,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:46.011074 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b74c73f-064c-44fb-b110-fe94aace199e req-d3d62ce2-768c-4869-b8a1-41ba6a835e25 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:46.012850 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4b74c73f-064c-44fb-b110-fe94aace199e req-d3d62ce2-768c-4869-b8a1-41ba6a835e25 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 944 time: 0.0850966 Dec 24 04:59:46.036012 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device c20bf82b-830b-4f29-b2bf-97f490cf78c9 details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 04:59:46.072305 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ee996d5-4dc7-424b-bcf5-ad9ec73129e9 service neutron] Pushing event updated for resources: {'Port': ['ID=61ec3441-5b75-4c07-b8ad-4174450d6a55,revision_number=3']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:46.126463 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4b74c73f-064c-44fb-b110-fe94aace199e req-d2444345-5da6-476f-8a69-086f39487a27 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1041775 Dec 24 04:59:46.147479 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84505c28-513a-4051-87b9-c2ca82cf65ef req-2b8bc788-fd1d-41d6-8d7a-7f895bf08ba8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:46.154909 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-84505c28-513a-4051-87b9-c2ca82cf65ef req-2b8bc788-fd1d-41d6-8d7a-7f895bf08ba8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.3362856 Dec 24 04:59:46.189420 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-0c8d971a-0d36-40ec-9743-eb704d36055b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:46.191270 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-0c8d971a-0d36-40ec-9743-eb704d36055b service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=6c9c47f70b8d4da5827a8ef4349559ab&device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 1096 time: 0.1825299 Dec 24 04:59:46.195362 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-753dd227-2cb1-4206-b7f4-aabbf9853dfc req-08b9f728-b46b-4f4d-8ad0-7b855bdb3f1e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:46.197026 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-753dd227-2cb1-4206-b7f4-aabbf9853dfc req-08b9f728-b46b-4f4d-8ad0-7b855bdb3f1e service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=1b651e55b1a349a0b9582c526d3b5d67&device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 1097 time: 0.1942301 Dec 24 04:59:46.301170 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port c20bf82b-830b-4f29-b2bf-97f490cf78c9, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=c20bf82b-830b-4f29-b2bf-97f490cf78c9,segment=NetworkSegment(3203d346-5464-46d2-aeaa-9836964b7a28),segment_id=3203d346-5464-46d2-aeaa-9836964b7a28)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 04:59:46.316485 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': 'c20bf82b-830b-4f29-b2bf-97f490cf78c9', 'network_id': '598b6cd9-9673-4e27-b33e-451cd98b5f1c', 'port_id': 'c20bf82b-830b-4f29-b2bf-97f490cf78c9', 'mac_address': 'fa:16:3e:72:3d:4c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 115, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '32199feb-6f3a-4642-a10b-5d278d90a9e5', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 04:59:46.356661 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-566cc8d6-7704-41ed-a066-cd712060b3d5 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=61ec3441-5b75-4c07-b8ad-4174450d6a55 HTTP/1.1" status: 200 len: 217 time: 0.0837402 Dec 24 04:59:46.361213 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:46.377885 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c20bf82b-830b-4f29-b2bf-97f490cf78c9 {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 04:59:46.400397 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-84505c28-513a-4051-87b9-c2ca82cf65ef req-bfc4be86-ddd7-4109-9a02-718ea91382a5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2393889 Dec 24 04:59:46.401952 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port c20bf82b-830b-4f29-b2bf-97f490cf78c9, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=c20bf82b-830b-4f29-b2bf-97f490cf78c9,segment=NetworkSegment(3203d346-5464-46d2-aeaa-9836964b7a28),segment_id=3203d346-5464-46d2-aeaa-9836964b7a28)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 04:59:46.408659 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:46.438747 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 52414) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:46.456305 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a6ff87bb-cc01-44cb-bed5-a620269c4017 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:46.473632 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=c20bf82b-830b-4f29-b2bf-97f490cf78c9,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:46.518995 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2a069455-c70f-449a-ac89-2ecbb97b07fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-32528573', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-32970404'] for subnet, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:46.591569 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-753dd227-2cb1-4206-b7f4-aabbf9853dfc req-3e1042b0-246d-4fa1-a18d-fe02b5046ebd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:46.594033 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-753dd227-2cb1-4206-b7f4-aabbf9853dfc req-3e1042b0-246d-4fa1-a18d-fe02b5046ebd service neutron] 10.222.0.46 "GET /v2.0/networks?id=0d368baa-5733-40a7-b836-139a541f4ebb HTTP/1.1" status: 200 len: 919 time: 0.3274143 Dec 24 04:59:46.598370 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-bd635b01-0d1a-41ab-9643-ec2dfdf4dbd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:46.599787 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-bd635b01-0d1a-41ab-9643-ec2dfdf4dbd0 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=699b398d-7f9d-4acb-bc18-ac32f35377c3 HTTP/1.1" status: 200 len: 855 time: 0.1916237 Dec 24 04:59:46.619657 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fa85cc1-3a8c-4838-b6fa-193298ff246e req-5112527e-fc5b-4230-b56a-a69aaf99076e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:46.621300 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-2fa85cc1-3a8c-4838-b6fa-193298ff246e req-5112527e-fc5b-4230-b56a-a69aaf99076e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 945 time: 0.0941343 Dec 24 04:59:46.626291 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a6ff87bb-cc01-44cb-bed5-a620269c4017 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:46.632040 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a069455-c70f-449a-ac89-2ecbb97b07fe admin admin] Pushing event updated for resources: {'Subnet': ['ID=b6657dc9-704f-488f-a929-3d0573a04d1f,revision_number=0']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:46.642330 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a6ff87bb-cc01-44cb-bed5-a620269c4017 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:46.681128 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-753dd227-2cb1-4206-b7f4-aabbf9853dfc req-4569ad98-28c3-4cb7-93f7-1042cc41a7de service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=24d08627-8243-4361-b6b4-8461a18d110f HTTP/1.1" status: 200 len: 217 time: 0.0726726 Dec 24 04:59:46.708561 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-a6ff87bb-cc01-44cb-bed5-a620269c4017 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=397e8dfbbe584e879a829c8e8acb2b86&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2683446 Dec 24 04:59:46.710285 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6ff87bb-cc01-44cb-bed5-a620269c4017 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=403bc750-f5f7-4da9-a6f6-1aeefd3855ac,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:46.713631 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 52424) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:46.726766 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2a069455-c70f-449a-ac89-2ecbb97b07fe admin admin] Checking segment: {'id': '00999af0-b9ae-4a2b-9c30-590dbe00c43a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'c2c27570-f2cd-4dac-9473-e82a4e432501'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:59:46.727118 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a069455-c70f-449a-ac89-2ecbb97b07fe admin admin] Network hostable DHCP agents. Network: c2c27570-f2cd-4dac-9473-e82a4e432501, hostable agents: ['01bc2530-0600-4d1b-b486-2fd9d63a2d51'], hosted agents: [] {{(pid=102476) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 24 04:59:46.733700 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-2fa85cc1-3a8c-4838-b6fa-193298ff246e req-dca4bfb5-e36b-4d4c-97bc-a5a48b4b9fbc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1026809 Dec 24 04:59:46.778169 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6485c286-d5e3-42e7-bf58-c4685f8c3066', 'tag': '61ec3441-5b75-4c07-b8ad-4174450d6a55'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 04:59:46.780407 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-abc3d076-e328-4f73-80af-8e8c64df9e54" -d '{"events": [{"name": "network-changed", "server_uuid": "6485c286-d5e3-42e7-bf58-c4685f8c3066", "tag": "61ec3441-5b75-4c07-b8ad-4174450d6a55"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 04:59:46.782024 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d7d67859-31b3-4eeb-b49e-0c28d49a50d8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:46.805357 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d7d67859-31b3-4eeb-b49e-0c28d49a50d8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:46.809741 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-c3b99373-8c13-44de-b94d-a62a904f514e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:46.811266 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-c3b99373-8c13-44de-b94d-a62a904f514e service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=c908572e-3b6b-470c-8b88-35b51f1472c6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1999295 Dec 24 04:59:46.817672 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-753dd227-2cb1-4206-b7f4-aabbf9853dfc req-d2d4991c-a73c-43e3-a2fd-51451c97e4a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:46.819241 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-753dd227-2cb1-4206-b7f4-aabbf9853dfc req-d2d4991c-a73c-43e3-a2fd-51451c97e4a7 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=88f274d6-bcf0-47e8-9f0a-783a53214be4 HTTP/1.1" status: 200 len: 858 time: 0.1255360 Dec 24 04:59:46.837245 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98be1ba9-f733-47d4-8ab7-f82d687bc570 req-f3f7b8da-fa31-4217-948c-498a27efcfc3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:46.838733 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-98be1ba9-f733-47d4-8ab7-f82d687bc570 req-f3f7b8da-fa31-4217-948c-498a27efcfc3 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 944 time: 0.1736109 Dec 24 04:59:46.849722 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 04:59:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7dd98c93-fd5b-4bec-a6e2-7275bd05e38e x-openstack-request-id: req-7dd98c93-fd5b-4bec-a6e2-7275bd05e38e {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 04:59:46.850042 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6485c286-d5e3-42e7-bf58-c4685f8c3066", "tag": "61ec3441-5b75-4c07-b8ad-4174450d6a55", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 04:59:46.850255 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-7dd98c93-fd5b-4bec-a6e2-7275bd05e38e {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 04:59:46.850731 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6485c286-d5e3-42e7-bf58-c4685f8c3066', 'tag': '61ec3441-5b75-4c07-b8ad-4174450d6a55', 'status': 'completed', 'code': 200} Dec 24 04:59:46.869607 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d7d67859-31b3-4eeb-b49e-0c28d49a50d8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:46.871852 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['c20bf82b-830b-4f29-b2bf-97f490cf78c9'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 04:59:46.873866 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d7d67859-31b3-4eeb-b49e-0c28d49a50d8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:46.877667 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-d7d67859-31b3-4eeb-b49e-0c28d49a50d8 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/403bc750-f5f7-4da9-a6f6-1aeefd3855ac HTTP/1.1" status: 204 len: 168 time: 0.1555150 Dec 24 04:59:46.877810 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a069455-c70f-449a-ac89-2ecbb97b07fe admin admin] Network c2c27570-f2cd-4dac-9473-e82a4e432501 is scheduled to be hosted by DHCP agent 01bc2530-0600-4d1b-b486-2fd9d63a2d51 with binding_index 1 {{(pid=102476) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 24 04:59:46.885876 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7d67859-31b3-4eeb-b49e-0c28d49a50d8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=403bc750-f5f7-4da9-a6f6-1aeefd3855ac,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:46.912885 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-753dd227-2cb1-4206-b7f4-aabbf9853dfc req-9d9276f6-8ae1-4cfa-9edb-78d6a444bb2f service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=0d368baa-5733-40a7-b836-139a541f4ebb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0719051 Dec 24 04:59:46.955396 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-2a069455-c70f-449a-ac89-2ecbb97b07fe admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816443-2-iscsi, c2c27570-f2cd-4dac-9473-e82a4e432501) {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:59:46.969444 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90c5c2e8-c0d3-48b4-8c7f-0d44f421aa09 None None] Network c2c27570-f2cd-4dac-9473-e82a4e432501 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 04:59:46.990679 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a069455-c70f-449a-ac89-2ecbb97b07fe admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:46.991274 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2a069455-c70f-449a-ac89-2ecbb97b07fe admin admin] Publish callbacks [] for subnet, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:47.101848 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-98be1ba9-f733-47d4-8ab7-f82d687bc570 req-7bbc76a1-217e-43a8-81c5-ee2fe56b8b36 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2229476 Dec 24 04:59:47.115392 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-2a069455-c70f-449a-ac89-2ecbb97b07fe admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 1.4594259 Dec 24 04:59:47.153209 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-ade7d9ad-9aa6-4bd7-982d-bb7efd34214c service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3314800 Dec 24 04:59:47.156049 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-753dd227-2cb1-4206-b7f4-aabbf9853dfc req-32fc8841-4579-464d-8ceb-f338af500a76 service neutron] 10.222.0.46 "GET /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2340732 Dec 24 04:59:47.274772 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c398f47-aa84-4201-a220-9779982d4f85 req-2424817d-4776-4035-9e4c-194e2fe381f3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:47.283180 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7c398f47-aa84-4201-a220-9779982d4f85 req-2424817d-4776-4035-9e4c-194e2fe381f3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 944 time: 0.0705562 Dec 24 04:59:47.342688 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a98b9c1-ce78-4fc9-b30a-e573b2156891 None None] Network c2c27570-f2cd-4dac-9473-e82a4e432501 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 04:59:47.382225 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7c398f47-aa84-4201-a220-9779982d4f85 req-364f132c-25df-41dd-b7e3-c368c1d88d06 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0976603 Dec 24 04:59:47.708075 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-753dd227-2cb1-4206-b7f4-aabbf9853dfc req-5d35b6a5-3a38-4ff5-b4d0-90857534855e service neutron] 10.222.0.46 "GET /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5407145 Dec 24 04:59:47.719137 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-915c4afe-4225-426a-adc4-1b9bbd768b1a req-2577ad80-a0e0-47ef-8b41-b104e6f686a2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:47.720692 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-915c4afe-4225-426a-adc4-1b9bbd768b1a req-2577ad80-a0e0-47ef-8b41-b104e6f686a2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.1613824 Dec 24 04:59:47.724855 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-792ce83f-357e-48f4-95ed-aa45505c1150 req-7efef10d-067d-42e4-9bfe-b3b1f50c5b5f service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5556242 Dec 24 04:59:47.836802 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-915c4afe-4225-426a-adc4-1b9bbd768b1a req-3f743b67-9bae-429a-a5da-574b0d9f0414 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0930383 Dec 24 04:59:47.990941 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abc3d076-e328-4f73-80af-8e8c64df9e54 req-03e0c7df-d612-45cc-89a2-08583635bbf1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:47.994809 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-abc3d076-e328-4f73-80af-8e8c64df9e54 req-03e0c7df-d612-45cc-89a2-08583635bbf1 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=6c9c47f70b8d4da5827a8ef4349559ab&device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 1096 time: 0.1565492 Dec 24 04:59:48.042488 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device ea61b5c0-ffb7-42bf-9289-095515c125a2 details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 04:59:48.093369 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68b32df8-7227-4ef4-9306-35cfbf491875 req-25b3dd43-23a1-4a7e-9fa3-14fca2a41cda tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:48.115757 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-68b32df8-7227-4ef4-9306-35cfbf491875 req-25b3dd43-23a1-4a7e-9fa3-14fca2a41cda tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 945 time: 0.1727207 Dec 24 04:59:48.184488 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 50d50f46-e761-4fb1-9761-fa48778aa8aa up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 04:59:48.262189 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-68b32df8-7227-4ef4-9306-35cfbf491875 req-def6fe65-400c-4222-ac6e-f704b89a0340 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1451862 Dec 24 04:59:48.301980 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abc3d076-e328-4f73-80af-8e8c64df9e54 req-b5db60d8-eb90-427b-9511-47ad5615cfaf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:48.303495 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-abc3d076-e328-4f73-80af-8e8c64df9e54 req-b5db60d8-eb90-427b-9511-47ad5615cfaf service neutron] 10.222.0.46 "GET /v2.0/networks?id=c908572e-3b6b-470c-8b88-35b51f1472c6 HTTP/1.1" status: 200 len: 917 time: 0.2994821 Dec 24 04:59:48.358245 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning for port 50d50f46-e761-4fb1-9761-fa48778aa8aa completed by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 24 04:59:48.362598 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port ea61b5c0-ffb7-42bf-9289-095515c125a2, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=ea61b5c0-ffb7-42bf-9289-095515c125a2,segment=NetworkSegment(d94b0a1e-2098-4b10-9091-c566351ffe74),segment_id=d94b0a1e-2098-4b10-9091-c566351ffe74)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 04:59:48.374728 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port 50d50f46-e761-4fb1-9761-fa48778aa8aa triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:59:48.375436 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:48.380121 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': 'ea61b5c0-ffb7-42bf-9289-095515c125a2', 'network_id': '0d368baa-5733-40a7-b836-139a541f4ebb', 'port_id': 'ea61b5c0-ffb7-42bf-9289-095515c125a2', 'mac_address': 'fa:16:3e:f5:97:e8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 133, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '88f274d6-bcf0-47e8-9f0a-783a53214be4', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 04:59:48.391859 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-abc3d076-e328-4f73-80af-8e8c64df9e54 req-310a2b26-1f44-4f42-b970-7a7e6fc29003 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=61ec3441-5b75-4c07-b8ad-4174450d6a55 HTTP/1.1" status: 200 len: 217 time: 0.0781972 Dec 24 04:59:48.489996 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9427ecbd-d746-4351-853b-218e0d71366b req-e9c18379-d856-4f8c-9a16-23a5ab49065e tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:48.491773 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9427ecbd-d746-4351-853b-218e0d71366b req-e9c18379-d856-4f8c-9a16-23a5ab49065e tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 944 time: 0.2644582 Dec 24 04:59:48.509575 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abc3d076-e328-4f73-80af-8e8c64df9e54 req-e44b1d3e-79c7-4229-8768-9fcec3e719b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:48.511416 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-abc3d076-e328-4f73-80af-8e8c64df9e54 req-e44b1d3e-79c7-4229-8768-9fcec3e719b7 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=699b398d-7f9d-4acb-bc18-ac32f35377c3 HTTP/1.1" status: 200 len: 855 time: 0.1091835 Dec 24 04:59:48.515134 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:48.553178 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ea61b5c0-ffb7-42bf-9289-095515c125a2 {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 04:59:48.570558 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aee29f56-47f4-4381-beec-8cee00edd1db req-899a9cfc-d9f6-4894-b604-aa2180a21e70 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:48.572372 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-aee29f56-47f4-4381-beec-8cee00edd1db req-899a9cfc-d9f6-4894-b604-aa2180a21e70 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 944 time: 0.0901792 Dec 24 04:59:48.609490 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:48.634532 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9427ecbd-d746-4351-853b-218e0d71366b req-964bbc99-f448-4e3d-b38d-e8bcddee2593 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1323583 Dec 24 04:59:48.649207 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abc3d076-e328-4f73-80af-8e8c64df9e54 req-75c8a2da-b3b4-4d90-ae87-aceb2d3ff6d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:48.651370 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-aee29f56-47f4-4381-beec-8cee00edd1db req-2fb8758d-12b0-426e-b286-8a819f1e77a3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0690084 Dec 24 04:59:48.653533 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-abc3d076-e328-4f73-80af-8e8c64df9e54 req-75c8a2da-b3b4-4d90-ae87-aceb2d3ff6d1 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=c908572e-3b6b-470c-8b88-35b51f1472c6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1344249 Dec 24 04:59:48.661583 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7c07c04e-36eb-4aa0-8a33-1c1424a2db2e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '50d50f46-e761-4fb1-9761-fa48778aa8aa'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 04:59:48.750438 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 50d50f46-e761-4fb1-9761-fa48778aa8aa, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=50d50f46-e761-4fb1-9761-fa48778aa8aa,segment=NetworkSegment(10307c97-e214-473b-b760-bb1b770153ec),segment_id=10307c97-e214-473b-b760-bb1b770153ec)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 04:59:48.764392 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:48.765219 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-abc3d076-e328-4f73-80af-8e8c64df9e54 req-57382129-6a8e-48db-b6bf-30770e5ce247 service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1016705 Dec 24 04:59:48.768876 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port ea61b5c0-ffb7-42bf-9289-095515c125a2, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=ea61b5c0-ffb7-42bf-9289-095515c125a2,segment=NetworkSegment(d94b0a1e-2098-4b10-9091-c566351ffe74),segment_id=d94b0a1e-2098-4b10-9091-c566351ffe74)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 04:59:48.797656 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:48.837353 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=50d50f46-e761-4fb1-9761-fa48778aa8aa,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:48.905705 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-abc3d076-e328-4f73-80af-8e8c64df9e54 req-3c086f9e-c80c-4aea-8fc4-c7a950f4422d service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1310871 Dec 24 04:59:48.949084 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-84176541-336b-4206-985f-4c364e83cd80" -d '{"events": [{"server_uuid": "7c07c04e-36eb-4aa0-8a33-1c1424a2db2e", "name": "network-vif-plugged", "status": "completed", "tag": "50d50f46-e761-4fb1-9761-fa48778aa8aa"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 04:59:48.951969 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=ea61b5c0-ffb7-42bf-9289-095515c125a2,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:49.048297 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3929e53-d390-4543-ba6e-a2bc2a2a0eb3 req-f6d4477c-56f7-44be-bd37-bb00aa4fd8bc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:49.050143 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e3929e53-d390-4543-ba6e-a2bc2a2a0eb3 req-f6d4477c-56f7-44be-bd37-bb00aa4fd8bc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0556951 Dec 24 04:59:49.065724 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 04:59:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2b572a57-b921-4ddb-8306-4ac9336565e7 x-openstack-request-id: req-2b572a57-b921-4ddb-8306-4ac9336565e7 {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 04:59:49.066464 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7c07c04e-36eb-4aa0-8a33-1c1424a2db2e", "name": "network-vif-plugged", "status": "completed", "tag": "50d50f46-e761-4fb1-9761-fa48778aa8aa", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 04:59:49.066747 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-2b572a57-b921-4ddb-8306-4ac9336565e7 {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 04:59:49.067570 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7c07c04e-36eb-4aa0-8a33-1c1424a2db2e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '50d50f46-e761-4fb1-9761-fa48778aa8aa', 'code': 200} Dec 24 04:59:49.107905 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e3929e53-d390-4543-ba6e-a2bc2a2a0eb3 req-5f342acd-8dac-4a03-93df-5c074ef54227 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0504985 Dec 24 04:59:49.323722 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 52538) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:49.369187 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13a27fbd-d2a0-4197-84bf-191251ed217b req-6416e35a-327e-47b3-9afa-fd85bfc3650f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:49.371484 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-13a27fbd-d2a0-4197-84bf-191251ed217b req-6416e35a-327e-47b3-9afa-fd85bfc3650f service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 1099 time: 0.0976105 Dec 24 04:59:49.381372 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['ea61b5c0-ffb7-42bf-9289-095515c125a2'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 04:59:49.397457 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-13a27fbd-d2a0-4197-84bf-191251ed217b req-cc8cd286-75e3-4959-a2ba-f3cdf923235f service neutron] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:49.416586 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-797f811a-966b-473d-bf3a-253a668186c2 req-c5c3a4ac-ef46-4e26-b09e-c2f0718749a3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:49.424605 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-797f811a-966b-473d-bf3a-253a668186c2 req-c5c3a4ac-ef46-4e26-b09e-c2f0718749a3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 946 time: 0.0598097 Dec 24 04:59:49.460450 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:49.485216 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-797f811a-966b-473d-bf3a-253a668186c2 req-2faa364e-be11-40cc-9668-f24a72a02910 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0548720 Dec 24 04:59:49.526645 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-884a2f28-213c-4265-800c-b86f2e54b4a2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:49.573706 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-13a27fbd-d2a0-4197-84bf-191251ed217b req-cc8cd286-75e3-4959-a2ba-f3cdf923235f service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:49.581891 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-13a27fbd-d2a0-4197-84bf-191251ed217b req-cc8cd286-75e3-4959-a2ba-f3cdf923235f service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:49.633716 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc8cd286-75e3-4959-a2ba-f3cdf923235f service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=67a7d5f9-6c2f-4d87-aef3-3657f5063c71,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:49.639634 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-13a27fbd-d2a0-4197-84bf-191251ed217b req-cc8cd286-75e3-4959-a2ba-f3cdf923235f service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2571325 Dec 24 04:59:49.649418 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-884a2f28-213c-4265-800c-b86f2e54b4a2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:49.654228 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-884a2f28-213c-4265-800c-b86f2e54b4a2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:49.681537 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-884a2f28-213c-4265-800c-b86f2e54b4a2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3cc5c69e-2cad-4319-b6cf-efe6259981fe,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:49.705064 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-884a2f28-213c-4265-800c-b86f2e54b4a2 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=7625862aac6143b1be7e02bea4a3b2de&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3802199 Dec 24 04:59:49.707494 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 52560) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 04:59:49.763489 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-507edb97-efc4-4cb7-82ab-bea8bbd91924 req-d12a4989-c175-4ff1-8965-a8522cae39b6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:49.765022 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-507edb97-efc4-4cb7-82ab-bea8bbd91924 req-d12a4989-c175-4ff1-8965-a8522cae39b6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 944 time: 0.0509200 Dec 24 04:59:49.787473 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b19c1ab9-f716-4274-ad39-76e211e64bb3 req-95221bb9-d877-4412-bdf4-98a62b4cb842 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:49.788994 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b19c1ab9-f716-4274-ad39-76e211e64bb3 req-95221bb9-d877-4412-bdf4-98a62b4cb842 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 944 time: 0.0744252 Dec 24 04:59:49.804601 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-14ca47ed-c122-4c48-b7d6-2d37ef4a07ff admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:49.813187 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-507edb97-efc4-4cb7-82ab-bea8bbd91924 req-328a511a-ca97-47b6-849c-3fac3b673bbd tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414543 Dec 24 04:59:49.842260 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-14ca47ed-c122-4c48-b7d6-2d37ef4a07ff admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:49.869110 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b19c1ab9-f716-4274-ad39-76e211e64bb3 req-6925197b-4f31-41ee-99d6-44e8679a6cce tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0730312 Dec 24 04:59:49.908896 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-14ca47ed-c122-4c48-b7d6-2d37ef4a07ff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:49.911444 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-14ca47ed-c122-4c48-b7d6-2d37ef4a07ff admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:49.912613 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-14ca47ed-c122-4c48-b7d6-2d37ef4a07ff admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/3cc5c69e-2cad-4319-b6cf-efe6259981fe HTTP/1.1" status: 204 len: 168 time: 0.2040126 Dec 24 04:59:49.920706 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14ca47ed-c122-4c48-b7d6-2d37ef4a07ff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3cc5c69e-2cad-4319-b6cf-efe6259981fe,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:49.990005 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-bc1f99b7-9b01-4dfb-9d6f-b54ee319925e tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:49.991494 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-bc1f99b7-9b01-4dfb-9d6f-b54ee319925e tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/networks?id=c2c27570-f2cd-4dac-9473-e82a4e432501 HTTP/1.1" status: 200 len: 809 time: 0.1037784 Dec 24 04:59:50.012508 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-fd013055-6194-4cef-85d0-a8d657841ad6 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/quotas/1e014b3683d841968563e0aa0705e862 HTTP/1.1" status: 200 len: 375 time: 0.0146799 Dec 24 04:59:50.044959 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 24d08627-8243-4361-b6b4-8461a18d110f details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 04:59:50.051117 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device c20bf82b-830b-4f29-b2bf-97f490cf78c9 up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 04:59:50.054036 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-63333159-820d-4459-a17b-b28eabe9d688 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=1e014b3683d841968563e0aa0705e862&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0352299 Dec 24 04:59:50.194313 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-cb222323-a9d2-4eef-8ad8-e220e65e907a service neutron] 10.222.0.43 "GET /v2.0/networks/c2c27570-f2cd-4dac-9473-e82a4e432501?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1315763 Dec 24 04:59:50.206351 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning for port c20bf82b-830b-4f29-b2bf-97f490cf78c9 completed by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 24 04:59:50.221050 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port c20bf82b-830b-4f29-b2bf-97f490cf78c9 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:59:50.221758 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:50.263543 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 24d08627-8243-4361-b6b4-8461a18d110f, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=24d08627-8243-4361-b6b4-8461a18d110f,segment=NetworkSegment(d94b0a1e-2098-4b10-9091-c566351ffe74),segment_id=d94b0a1e-2098-4b10-9091-c566351ffe74)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 04:59:50.265107 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e84044ff-be4d-4067-88dd-fc3ec2ba18bb req-88e66e6d-6b40-4028-8345-9f3d322300fd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:50.273113 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e84044ff-be4d-4067-88dd-fc3ec2ba18bb req-88e66e6d-6b40-4028-8345-9f3d322300fd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0622573 Dec 24 04:59:50.283893 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': '24d08627-8243-4361-b6b4-8461a18d110f', 'network_id': '0d368baa-5733-40a7-b836-139a541f4ebb', 'port_id': '24d08627-8243-4361-b6b4-8461a18d110f', 'mac_address': 'fa:16:3e:e1:3f:2f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 133, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '88f274d6-bcf0-47e8-9f0a-783a53214be4', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 04:59:50.338426 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-d06203bd-afbd-4f10-a4bf-cde1a4203e96 service neutron] 10.222.0.43 "GET /v2.0/networks/c2c27570-f2cd-4dac-9473-e82a4e432501?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1365187 Dec 24 04:59:50.345566 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e84044ff-be4d-4067-88dd-fc3ec2ba18bb req-2b0ad537-08ff-4498-96dc-61149998df10 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0712261 Dec 24 04:59:50.358199 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:50.370175 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:50.384180 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 24d08627-8243-4361-b6b4-8461a18d110f {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 04:59:50.419433 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 24d08627-8243-4361-b6b4-8461a18d110f, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=24d08627-8243-4361-b6b4-8461a18d110f,segment=NetworkSegment(d94b0a1e-2098-4b10-9091-c566351ffe74),segment_id=d94b0a1e-2098-4b10-9091-c566351ffe74)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 04:59:50.424070 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port c20bf82b-830b-4f29-b2bf-97f490cf78c9, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=c20bf82b-830b-4f29-b2bf-97f490cf78c9,segment=NetworkSegment(3203d346-5464-46d2-aeaa-9836964b7a28),segment_id=3203d346-5464-46d2-aeaa-9836964b7a28)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 04:59:50.425609 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:50.429714 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:50.483568 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=24d08627-8243-4361-b6b4-8461a18d110f,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:50.546310 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0f0ccc6f-ffd1-4134-952b-3001087f5950 req-8bb13003-34a9-4c34-a497-b5b6d517c86f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 210 time: 0.0346470 Dec 24 04:59:50.584117 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=c20bf82b-830b-4f29-b2bf-97f490cf78c9,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:50.647120 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b95aacfb-4288-4639-b578-da810675a2ad req-bbe7a9d4-18ba-4b6a-adfa-28c352d90b75 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:50.648641 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b95aacfb-4288-4639-b578-da810675a2ad req-bbe7a9d4-18ba-4b6a-adfa-28c352d90b75 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 946 time: 0.0816348 Dec 24 04:59:50.738440 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b95aacfb-4288-4639-b578-da810675a2ad req-18b26955-93bc-469e-8136-9e18ffcf336f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0675263 Dec 24 04:59:50.944551 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b433aee8-0434-4030-b352-10e5b7626cbf req-17c92e17-6cce-4ae9-a548-d5d2f1c5fb61 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:50.946821 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b433aee8-0434-4030-b352-10e5b7626cbf req-17c92e17-6cce-4ae9-a548-d5d2f1c5fb61 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 945 time: 0.0586348 Dec 24 04:59:50.990641 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['24d08627-8243-4361-b6b4-8461a18d110f'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 04:59:51.001575 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b433aee8-0434-4030-b352-10e5b7626cbf req-578034a9-8c04-4bb6-a062-65c8fd192529 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486827 Dec 24 04:59:51.003330 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e2afde6-6c99-4b8f-84c8-12b22b54da16 req-020f517e-4cd6-42de-aacc-940a05ef9b98 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:51.004904 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5e2afde6-6c99-4b8f-84c8-12b22b54da16 req-020f517e-4cd6-42de-aacc-940a05ef9b98 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 945 time: 0.0651071 Dec 24 04:59:51.069771 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'de66f13f-d7ee-49ab-b071-e5b7acd3b2fe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c20bf82b-830b-4f29-b2bf-97f490cf78c9'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 04:59:51.071840 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5e2afde6-6c99-4b8f-84c8-12b22b54da16 req-0bd1ae7a-b617-4b26-93ba-91ab884d583a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0581698 Dec 24 04:59:51.072082 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e7e1280f-8c70-497c-8ac4-470fedd867f9" -d '{"events": [{"server_uuid": "de66f13f-d7ee-49ab-b071-e5b7acd3b2fe", "name": "network-vif-plugged", "status": "completed", "tag": "c20bf82b-830b-4f29-b2bf-97f490cf78c9"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 04:59:51.112363 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 04:59:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-892f4403-d350-46f7-a31f-1bed6309f99f x-openstack-request-id: req-892f4403-d350-46f7-a31f-1bed6309f99f {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 04:59:51.112712 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "de66f13f-d7ee-49ab-b071-e5b7acd3b2fe", "name": "network-vif-plugged", "status": "completed", "tag": "c20bf82b-830b-4f29-b2bf-97f490cf78c9", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 04:59:51.112959 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-892f4403-d350-46f7-a31f-1bed6309f99f {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 04:59:51.113336 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'de66f13f-d7ee-49ab-b071-e5b7acd3b2fe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c20bf82b-830b-4f29-b2bf-97f490cf78c9', 'code': 200} Dec 24 04:59:51.352373 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b51730d-b717-4829-b1f9-5b26a8d43886 req-d5206b76-6a02-457c-a569-5d5c5c666123 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:51.353949 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4b51730d-b717-4829-b1f9-5b26a8d43886 req-d5206b76-6a02-457c-a569-5d5c5c666123 service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 1098 time: 0.0391457 Dec 24 04:59:51.402440 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4b51730d-b717-4829-b1f9-5b26a8d43886 req-2a9b9df5-7e00-4ad6-86fd-0a864046f6f1 service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394053 Dec 24 04:59:51.473042 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f25ab987-1a8e-438e-84a7-00ddb7430c8d req-ecffc277-5881-42da-825f-73ea2a292da6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:51.474886 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f25ab987-1a8e-438e-84a7-00ddb7430c8d req-ecffc277-5881-42da-825f-73ea2a292da6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0512266 Dec 24 04:59:51.534718 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f25ab987-1a8e-438e-84a7-00ddb7430c8d req-5aa95bc1-6335-4212-9d6f-323b76120d12 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0515687 Dec 24 04:59:51.647781 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b6a4627c-13a7-4285-8026-7f72cd12a85d req-21649ce7-e1e4-4391-876a-e7ca59f28af6 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 210 time: 0.0287807 Dec 24 04:59:51.837785 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7495eaed-c89d-45f1-9cce-6f9b99cbeceb req-5f857dc7-463b-493e-9086-ad0a48375dce tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:51.839308 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7495eaed-c89d-45f1-9cce-6f9b99cbeceb req-5f857dc7-463b-493e-9086-ad0a48375dce tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 946 time: 0.0538192 Dec 24 04:59:51.907071 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7495eaed-c89d-45f1-9cce-6f9b99cbeceb req-d496d788-00bc-4ab6-b343-d2565cb6633e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0609355 Dec 24 04:59:52.059179 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 61ec3441-5b75-4c07-b8ad-4174450d6a55 details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 04:59:52.069386 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device ea61b5c0-ffb7-42bf-9289-095515c125a2 up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 04:59:52.146364 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c4eaf8c-15dc-48ff-9941-46b917d4f766 req-bbc215bf-6cc5-42f1-b509-82b32a464a87 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:52.147930 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8c4eaf8c-15dc-48ff-9941-46b917d4f766 req-bbc215bf-6cc5-42f1-b509-82b32a464a87 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 945 time: 0.0700147 Dec 24 04:59:52.191045 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning for port ea61b5c0-ffb7-42bf-9289-095515c125a2 completed by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 24 04:59:52.205178 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port ea61b5c0-ffb7-42bf-9289-095515c125a2 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:59:52.206147 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:52.250990 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 61ec3441-5b75-4c07-b8ad-4174450d6a55, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=61ec3441-5b75-4c07-b8ad-4174450d6a55,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 04:59:52.267911 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': '61ec3441-5b75-4c07-b8ad-4174450d6a55', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'port_id': '61ec3441-5b75-4c07-b8ad-4174450d6a55', 'mac_address': 'fa:16:3e:41:aa:aa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 04:59:52.283162 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1c25cb2-eb5f-453d-bb93-adf87165b702 req-db53323b-c789-4c87-91b0-eaf133cc959d tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:52.287933 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a1c25cb2-eb5f-453d-bb93-adf87165b702 req-db53323b-c789-4c87-91b0-eaf133cc959d tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 945 time: 0.1336474 Dec 24 04:59:52.297184 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8c4eaf8c-15dc-48ff-9941-46b917d4f766 req-c60f1233-549e-4cdc-9d8c-19a120267424 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1179063 Dec 24 04:59:52.356793 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-f50eae6a-3662-4f88-8194-fe8776f690c3 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:52.359411 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-f50eae6a-3662-4f88-8194-fe8776f690c3 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.46 "GET /v2.0/networks?id=c2c27570-f2cd-4dac-9473-e82a4e432501 HTTP/1.1" status: 200 len: 809 time: 0.2362752 Dec 24 04:59:52.380652 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a1c25cb2-eb5f-453d-bb93-adf87165b702 req-0d784c43-b787-41d6-b88a-d8b8eedd1a60 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0855534 Dec 24 04:59:52.394469 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:52.412676 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:52.415295 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-c3384b84-b7d0-4e4d-8cc0-9957b62a5ad8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Request body: {'port': {'device_id': '1f2eb78b-9eeb-4011-b480-333a74a448a7', 'network_id': 'c2c27570-f2cd-4dac-9473-e82a4e432501', 'admin_state_up': True, 'tenant_id': '1e014b3683d841968563e0aa0705e862'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:52.417622 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 61ec3441-5b75-4c07-b8ad-4174450d6a55 {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 04:59:52.451894 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 61ec3441-5b75-4c07-b8ad-4174450d6a55, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=61ec3441-5b75-4c07-b8ad-4174450d6a55,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 04:59:52.464804 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:52.475880 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port ea61b5c0-ffb7-42bf-9289-095515c125a2, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=ea61b5c0-ffb7-42bf-9289-095515c125a2,segment=NetworkSegment(d94b0a1e-2098-4b10-9091-c566351ffe74),segment_id=d94b0a1e-2098-4b10-9091-c566351ffe74)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 04:59:52.495592 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:52.525371 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=61ec3441-5b75-4c07-b8ad-4174450d6a55,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:52.536766 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-c3384b84-b7d0-4e4d-8cc0-9957b62a5ad8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Made reservation on behalf of 1e014b3683d841968563e0aa0705e862 for: {'port': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 04:59:52.540771 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-c3384b84-b7d0-4e4d-8cc0-9957b62a5ad8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:52.599159 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=ea61b5c0-ffb7-42bf-9289-095515c125a2,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:52.720972 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b4d7199-64d3-4dab-9b54-7774e176b3f7 req-e0df7daf-88c3-4659-b643-436fa84e7da4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:52.722477 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6b4d7199-64d3-4dab-9b54-7774e176b3f7 req-e0df7daf-88c3-4659-b643-436fa84e7da4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 944 time: 0.0891552 Dec 24 04:59:52.731057 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-c3384b84-b7d0-4e4d-8cc0-9957b62a5ad8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Allocated IP 172.20.0.3 (c2c27570-f2cd-4dac-9473-e82a4e432501/b6657dc9-704f-488f-a929-3d0573a04d1f/95dbce62-23b4-409c-85a9-e1a32a7eb1bb) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 04:59:52.764718 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-78daab25-c7a0-4836-909f-fba1220a1aa5 req-efa89b1b-8942-42b8-9548-d6c2a25d543b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 210 time: 0.0336306 Dec 24 04:59:52.812597 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6b4d7199-64d3-4dab-9b54-7774e176b3f7 req-ecdd1202-1bcf-4cab-a6f1-e68c9434f103 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0790827 Dec 24 04:59:52.932277 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-c3384b84-b7d0-4e4d-8cc0-9957b62a5ad8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:52.981759 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-c3384b84-b7d0-4e4d-8cc0-9957b62a5ad8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:53.028140 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['61ec3441-5b75-4c07-b8ad-4174450d6a55'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 04:59:53.039445 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-c3384b84-b7d0-4e4d-8cc0-9957b62a5ad8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Network c2c27570-f2cd-4dac-9473-e82a4e432501 is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 04:59:53.042564 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-c3384b84-b7d0-4e4d-8cc0-9957b62a5ad8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 04:59:53.047928 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-c3384b84-b7d0-4e4d-8cc0-9957b62a5ad8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 04:59:53.068441 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57f6834e-008a-4fec-b5a7-66d2cc15a129 req-f65674f7-6b32-4170-a9f3-89c9945fd703 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:53.072335 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3384b84-b7d0-4e4d-8cc0-9957b62a5ad8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Pushing event updated for resources: {'Port': ['ID=95dbce62-23b4-409c-85a9-e1a32a7eb1bb,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:53.086840 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-57f6834e-008a-4fec-b5a7-66d2cc15a129 req-f65674f7-6b32-4170-a9f3-89c9945fd703 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 946 time: 0.1095655 Dec 24 04:59:53.114995 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-c3384b84-b7d0-4e4d-8cc0-9957b62a5ad8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:53.115217 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '27408900-d9e8-47e1-be4d-aac80e3f6fae', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ea61b5c0-ffb7-42bf-9289-095515c125a2'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 04:59:53.116591 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-c3384b84-b7d0-4e4d-8cc0-9957b62a5ad8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:53.117465 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f3d2d229-ca6d-4acc-8323-38787c4fd6a9" -d '{"events": [{"server_uuid": "27408900-d9e8-47e1-be4d-aac80e3f6fae", "name": "network-vif-plugged", "status": "completed", "tag": "ea61b5c0-ffb7-42bf-9289-095515c125a2"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 04:59:53.156932 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-c3384b84-b7d0-4e4d-8cc0-9957b62a5ad8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.46 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7467868 Dec 24 04:59:53.164742 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-57f6834e-008a-4fec-b5a7-66d2cc15a129 req-fa210392-2a7f-485e-876c-fb317e15dffa tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0768723 Dec 24 04:59:53.174311 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 04:59:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-179133f1-7a65-49ad-8829-5060db32b75c x-openstack-request-id: req-179133f1-7a65-49ad-8829-5060db32b75c {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 04:59:53.174624 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "27408900-d9e8-47e1-be4d-aac80e3f6fae", "name": "network-vif-plugged", "status": "completed", "tag": "ea61b5c0-ffb7-42bf-9289-095515c125a2", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 04:59:53.174880 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-179133f1-7a65-49ad-8829-5060db32b75c {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 04:59:53.175352 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '27408900-d9e8-47e1-be4d-aac80e3f6fae', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ea61b5c0-ffb7-42bf-9289-095515c125a2', 'code': 200} Dec 24 04:59:53.197737 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-b69da150-7419-4e87-82a9-3a9aa5fcb877 service neutron] Request body: {'port': {'device_id': '1f2eb78b-9eeb-4011-b480-333a74a448a7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81644'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 04:59:53.234526 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-d5a32afb-8fb9-44b9-b102-d3fea44596a8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:53.273251 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-b69da150-7419-4e87-82a9-3a9aa5fcb877 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:53.510435 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c88b459-f200-4325-9741-656015bd6249 req-f4914345-ccbb-464f-a2c8-df884466292e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:53.516998 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2c88b459-f200-4325-9741-656015bd6249 req-f4914345-ccbb-464f-a2c8-df884466292e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 945 time: 0.1443207 Dec 24 04:59:53.560368 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97c6acfd-818e-47f8-8db8-ee346c46df81 req-38d447db-9de7-478a-bed8-730061faad39 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:53.579197 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-97c6acfd-818e-47f8-8db8-ee346c46df81 req-38d447db-9de7-478a-bed8-730061faad39 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 945 time: 0.1043739 Dec 24 04:59:53.632149 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-97c6acfd-818e-47f8-8db8-ee346c46df81 req-5864214d-9e9b-46e4-bf7f-689768142c5b tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0518136 Dec 24 04:59:53.649712 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c68591b-0a9d-49c0-b4d6-b70466b721f0 req-d1dc9611-e917-4cfa-9684-a05bb77f0a9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:53.651191 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0c68591b-0a9d-49c0-b4d6-b70466b721f0 req-d1dc9611-e917-4cfa-9684-a05bb77f0a9c service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 1098 time: 0.1151180 Dec 24 04:59:53.655906 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2c88b459-f200-4325-9741-656015bd6249 req-b3c48833-b47a-49b4-843b-6682b3dee53c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1353772 Dec 24 04:59:53.723092 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0c68591b-0a9d-49c0-b4d6-b70466b721f0 req-9dc5dd13-4e99-4434-ae25-e8ca2c6bc4e2 service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0642571 Dec 24 04:59:53.766091 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-b69da150-7419-4e87-82a9-3a9aa5fcb877 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 95dbce62-23b4-409c-85a9-e1a32a7eb1bb {{(pid=102476) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 04:59:53.775261 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-b69da150-7419-4e87-82a9-3a9aa5fcb877 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:53.788054 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.provisioning_blocks [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-b69da150-7419-4e87-82a9-3a9aa5fcb877 service neutron] Transition to ACTIVE for port object 95dbce62-23b4-409c-85a9-e1a32a7eb1bb will not be triggered until provisioned by entity L2. {{(pid=102476) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 24 04:59:53.792476 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-b69da150-7419-4e87-82a9-3a9aa5fcb877 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:53.841861 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b69da150-7419-4e87-82a9-3a9aa5fcb877 service neutron] Pushing event updated for resources: {'Port': ['ID=95dbce62-23b4-409c-85a9-e1a32a7eb1bb,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:53.889806 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a897ae6-3ae3-41af-a811-656cc6cdd637 req-3a8e6d1c-71cb-45b8-b31e-9bafd1315f9d tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:53.894169 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8a897ae6-3ae3-41af-a811-656cc6cdd637 req-3a8e6d1c-71cb-45b8-b31e-9bafd1315f9d tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 943 time: 0.0651028 Dec 24 04:59:53.941954 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-b69da150-7419-4e87-82a9-3a9aa5fcb877 service neutron] Attempting to bind port 95dbce62-23b4-409c-85a9-e1a32a7eb1bb on host hv-cinder-81644 for vnic_type normal with profile {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 04:59:53.942360 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-b69da150-7419-4e87-82a9-3a9aa5fcb877 service neutron] Attempting to bind port 95dbce62-23b4-409c-85a9-e1a32a7eb1bb by drivers openvswitch,hyperv on host hv-cinder-81644 at level 0 using segments [{'id': '00999af0-b9ae-4a2b-9c30-590dbe00c43a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'c2c27570-f2cd-4dac-9473-e82a4e432501'}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 04:59:53.942764 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-b69da150-7419-4e87-82a9-3a9aa5fcb877 service neutron] Attempting to bind port 95dbce62-23b4-409c-85a9-e1a32a7eb1bb on network c2c27570-f2cd-4dac-9473-e82a4e432501 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 04:59:53.950881 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-b69da150-7419-4e87-82a9-3a9aa5fcb877 service neutron] Port 95dbce62-23b4-409c-85a9-e1a32a7eb1bb on network c2c27570-f2cd-4dac-9473-e82a4e432501 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81644 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 24 04:59:53.951264 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-b69da150-7419-4e87-82a9-3a9aa5fcb877 service neutron] Attempting to bind port 95dbce62-23b4-409c-85a9-e1a32a7eb1bb on network c2c27570-f2cd-4dac-9473-e82a4e432501 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 04:59:53.958845 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-b69da150-7419-4e87-82a9-3a9aa5fcb877 service neutron] Checking agent: {'id': '7a2ffd19-371f-4f7b-a239-eea3b5cfd55b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81644', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'started_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 4, 59, 49), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 04:59:53.959266 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-b69da150-7419-4e87-82a9-3a9aa5fcb877 service neutron] Checking segment: {'id': '00999af0-b9ae-4a2b-9c30-590dbe00c43a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'c2c27570-f2cd-4dac-9473-e82a4e432501'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 04:59:53.960017 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-b69da150-7419-4e87-82a9-3a9aa5fcb877 service neutron] Bound using segment: {'id': '00999af0-b9ae-4a2b-9c30-590dbe00c43a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'c2c27570-f2cd-4dac-9473-e82a4e432501'} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 04:59:53.960502 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-b69da150-7419-4e87-82a9-3a9aa5fcb877 service neutron] Bound port: 95dbce62-23b4-409c-85a9-e1a32a7eb1bb, host: hv-cinder-81644, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '00999af0-b9ae-4a2b-9c30-590dbe00c43a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'c2c27570-f2cd-4dac-9473-e82a4e432501'}}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 04:59:53.960954 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-b69da150-7419-4e87-82a9-3a9aa5fcb877 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:53.976311 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8a897ae6-3ae3-41af-a811-656cc6cdd637 req-68434ec4-159b-4e4f-ac3f-a49a7b06b2ba tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0748696 Dec 24 04:59:54.011209 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ae71f55-1bcb-47b9-af16-da86ce1794ac req-dc2b2add-5692-479a-85f7-718e9bf559f9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:54.012708 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0ae71f55-1bcb-47b9-af16-da86ce1794ac req-dc2b2add-5692-479a-85f7-718e9bf559f9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 944 time: 0.1029296 Dec 24 04:59:54.050627 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 24d08627-8243-4361-b6b4-8461a18d110f up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 04:59:54.075119 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-b69da150-7419-4e87-82a9-3a9aa5fcb877 service neutron] For port 95dbce62-23b4-409c-85a9-e1a32a7eb1bb, host hv-cinder-81644, cleared binding levels {{(pid=102476) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 04:59:54.090344 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0ae71f55-1bcb-47b9-af16-da86ce1794ac req-16833ae7-4d5f-4870-99fa-089af986564c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0708959 Dec 24 04:59:54.094130 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-b69da150-7419-4e87-82a9-3a9aa5fcb877 service neutron] For port 95dbce62-23b4-409c-85a9-e1a32a7eb1bb, host hv-cinder-81644, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=95dbce62-23b4-409c-85a9-e1a32a7eb1bb,segment=NetworkSegment(00999af0-b9ae-4a2b-9c30-590dbe00c43a),segment_id=00999af0-b9ae-4a2b-9c30-590dbe00c43a)] {{(pid=102476) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 04:59:54.099562 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-b69da150-7419-4e87-82a9-3a9aa5fcb877 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:54.121077 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning for port 24d08627-8243-4361-b6b4-8461a18d110f completed by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 24 04:59:54.127720 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port 24d08627-8243-4361-b6b4-8461a18d110f triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:59:54.128254 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:54.141817 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-b69da150-7419-4e87-82a9-3a9aa5fcb877 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:54.142433 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-b69da150-7419-4e87-82a9-3a9aa5fcb877 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:54.143828 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-b69da150-7419-4e87-82a9-3a9aa5fcb877 service neutron] 10.222.0.46 "PUT /v2.0/ports/95dbce62-23b4-409c-85a9-e1a32a7eb1bb HTTP/1.1" status: 200 len: 1093 time: 0.9515114 Dec 24 04:59:54.144265 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1f2eb78b-9eeb-4011-b480-333a74a448a7', 'tag': '95dbce62-23b4-409c-85a9-e1a32a7eb1bb'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 04:59:54.146541 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fadb2538-f71c-44e4-bf49-34deda9fed5c" -d '{"events": [{"name": "network-changed", "server_uuid": "1f2eb78b-9eeb-4011-b480-333a74a448a7", "tag": "95dbce62-23b4-409c-85a9-e1a32a7eb1bb"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 04:59:54.165677 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b69da150-7419-4e87-82a9-3a9aa5fcb877 service neutron] Pushing event updated for resources: {'Port': ['ID=95dbce62-23b4-409c-85a9-e1a32a7eb1bb,revision_number=3']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:54.201078 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 04:59:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b9180766-1783-4f63-b788-3039244b6a7b x-openstack-request-id: req-b9180766-1783-4f63-b788-3039244b6a7b {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 04:59:54.201533 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1f2eb78b-9eeb-4011-b480-333a74a448a7", "tag": "95dbce62-23b4-409c-85a9-e1a32a7eb1bb", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 04:59:54.201782 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-b9180766-1783-4f63-b788-3039244b6a7b {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 04:59:54.202183 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1f2eb78b-9eeb-4011-b480-333a74a448a7', 'tag': '95dbce62-23b4-409c-85a9-e1a32a7eb1bb', 'status': 'completed', 'code': 200} Dec 24 04:59:54.325177 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-7a193cfb-fb2d-4571-b372-c1b9f3e275c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:54.328559 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-7a193cfb-fb2d-4571-b372-c1b9f3e275c4 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=1e014b3683d841968563e0aa0705e862&device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 1096 time: 0.0501981 Dec 24 04:59:54.355174 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:54.388459 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-88e846aa-dcfd-435f-b2e3-da5a6b6a8047 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=95dbce62-23b4-409c-85a9-e1a32a7eb1bb HTTP/1.1" status: 200 len: 217 time: 0.0389588 Dec 24 04:59:54.393280 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 24d08627-8243-4361-b6b4-8461a18d110f, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=24d08627-8243-4361-b6b4-8461a18d110f,segment=NetworkSegment(d94b0a1e-2098-4b10-9091-c566351ffe74),segment_id=d94b0a1e-2098-4b10-9091-c566351ffe74)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 04:59:54.397724 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:54.439479 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-cd95c808-ea50-4069-9170-9e0fec48108f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:54.441404 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-cd95c808-ea50-4069-9170-9e0fec48108f service neutron] 10.222.0.46 "GET /v2.0/subnets?id=b6657dc9-704f-488f-a929-3d0573a04d1f HTTP/1.1" status: 200 len: 849 time: 0.0444012 Dec 24 04:59:54.452577 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=24d08627-8243-4361-b6b4-8461a18d110f,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:54.473968 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-489a435f-549a-41ec-86ab-fc638e72ddc4 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=c2c27570-f2cd-4dac-9473-e82a4e432501&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0246527 Dec 24 04:59:54.579775 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-144d2f61-d156-483d-bcbb-c2c0a3b4715f service neutron] 10.222.0.46 "GET /v2.0/networks/c2c27570-f2cd-4dac-9473-e82a4e432501?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0978975 Dec 24 04:59:54.678630 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b1cce6d9-3f33-40fd-a928-1207280d20e2 req-eeb116db-59cd-416f-ac1a-be27ae7b94bb service neutron] 10.222.0.46 "GET /v2.0/networks/c2c27570-f2cd-4dac-9473-e82a4e432501?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860581 Dec 24 04:59:54.803753 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2416a87-f261-485f-9822-b9af5351beb6 req-19060cd5-3e4f-4f9d-ba61-be8ba6e4629b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:54.805242 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d2416a87-f261-485f-9822-b9af5351beb6 req-19060cd5-3e4f-4f9d-ba61-be8ba6e4629b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0583937 Dec 24 04:59:54.848354 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fadb2538-f71c-44e4-bf49-34deda9fed5c req-91fceb5c-b52b-43a6-bb2a-b3a0b35917bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:54.850209 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-fadb2538-f71c-44e4-bf49-34deda9fed5c req-91fceb5c-b52b-43a6-bb2a-b3a0b35917bf service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=1e014b3683d841968563e0aa0705e862&device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 1096 time: 0.0474296 Dec 24 04:59:54.859746 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d2416a87-f261-485f-9822-b9af5351beb6 req-86e4404b-e6ad-4159-9afd-b1f2d8a7df53 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485146 Dec 24 04:59:54.961094 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fadb2538-f71c-44e4-bf49-34deda9fed5c req-ba6a89b6-7c08-4fd7-8834-d9287f39adb4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:54.962562 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-fadb2538-f71c-44e4-bf49-34deda9fed5c req-ba6a89b6-7c08-4fd7-8834-d9287f39adb4 service neutron] 10.222.0.46 "GET /v2.0/networks?id=c2c27570-f2cd-4dac-9473-e82a4e432501 HTTP/1.1" status: 200 len: 910 time: 0.1018219 Dec 24 04:59:55.009067 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-fadb2538-f71c-44e4-bf49-34deda9fed5c req-a68c682a-6ac8-4a5b-88a1-221890e20004 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=95dbce62-23b4-409c-85a9-e1a32a7eb1bb HTTP/1.1" status: 200 len: 217 time: 0.0389402 Dec 24 04:59:55.130218 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-777ced79-2015-497c-9c9e-089fdffbc4ed req-0951074f-4f72-48b1-93e3-45ab7722ff38 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:55.137130 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-777ced79-2015-497c-9c9e-089fdffbc4ed req-0951074f-4f72-48b1-93e3-45ab7722ff38 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 943 time: 0.0698154 Dec 24 04:59:55.176876 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '580344bb-42e6-4fd7-967d-04e85d821fd2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '24d08627-8243-4361-b6b4-8461a18d110f'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 04:59:55.179387 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dad99408-ee29-4f25-a517-253d9a3eb333" -d '{"events": [{"server_uuid": "580344bb-42e6-4fd7-967d-04e85d821fd2", "name": "network-vif-plugged", "status": "completed", "tag": "24d08627-8243-4361-b6b4-8461a18d110f"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 04:59:55.189182 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-777ced79-2015-497c-9c9e-089fdffbc4ed req-0579585a-a8c3-40b5-820c-54d1c9c4af3f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0488517 Dec 24 04:59:55.254170 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e3c78aea-5b57-4b02-969b-499680cab319 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:55.310909 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d47cf30e-6aa7-437a-9a67-46453eb2e68d req-58e35efe-7b9b-48bd-8816-f3801b6a829f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:55.314627 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d47cf30e-6aa7-437a-9a67-46453eb2e68d req-58e35efe-7b9b-48bd-8816-f3801b6a829f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 944 time: 0.0616763 Dec 24 04:59:55.328861 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fadb2538-f71c-44e4-bf49-34deda9fed5c req-83a4c1ae-913a-48e1-90df-d78f953e23aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:55.330432 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-fadb2538-f71c-44e4-bf49-34deda9fed5c req-83a4c1ae-913a-48e1-90df-d78f953e23aa service neutron] 10.222.0.46 "GET /v2.0/subnets?id=b6657dc9-704f-488f-a929-3d0573a04d1f HTTP/1.1" status: 200 len: 849 time: 0.3141627 Dec 24 04:59:55.374419 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d47cf30e-6aa7-437a-9a67-46453eb2e68d req-456cbe08-e932-4fa6-bedd-2cde60a1700b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0510740 Dec 24 04:59:55.426017 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 04:59:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-44238f5b-30df-4f7d-b361-c3d8197e0b01 x-openstack-request-id: req-44238f5b-30df-4f7d-b361-c3d8197e0b01 {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 04:59:55.426317 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "580344bb-42e6-4fd7-967d-04e85d821fd2", "name": "network-vif-plugged", "status": "completed", "tag": "24d08627-8243-4361-b6b4-8461a18d110f", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 04:59:55.426712 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-44238f5b-30df-4f7d-b361-c3d8197e0b01 {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 04:59:55.426956 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '580344bb-42e6-4fd7-967d-04e85d821fd2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '24d08627-8243-4361-b6b4-8461a18d110f', 'code': 200} Dec 24 04:59:55.510422 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-fadb2538-f71c-44e4-bf49-34deda9fed5c req-9dc11e97-e4a6-4dca-a326-7eac66a2f200 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=c2c27570-f2cd-4dac-9473-e82a4e432501&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0335562 Dec 24 04:59:55.698398 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-fadb2538-f71c-44e4-bf49-34deda9fed5c req-8e765a06-1bd8-4af8-932c-898ecbfe28ad service neutron] 10.222.0.46 "GET /v2.0/networks/c2c27570-f2cd-4dac-9473-e82a4e432501?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1334429 Dec 24 04:59:55.882827 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6173d93-d7b0-4221-8f43-61e184392beb req-2606a401-2b9f-46c2-b366-99a9bebefad0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:55.884370 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e6173d93-d7b0-4221-8f43-61e184392beb req-2606a401-2b9f-46c2-b366-99a9bebefad0 service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 1099 time: 0.0893118 Dec 24 04:59:55.886683 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-fadb2538-f71c-44e4-bf49-34deda9fed5c req-4627543c-2102-4f2d-8261-63726c026664 service neutron] 10.222.0.46 "GET /v2.0/networks/c2c27570-f2cd-4dac-9473-e82a4e432501?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1349046 Dec 24 04:59:55.974498 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e6173d93-d7b0-4221-8f43-61e184392beb req-9c2ba864-8af7-4276-a522-f453624dcf6c service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0593793 Dec 24 04:59:56.009517 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da7fabfd-34f5-4658-85b0-5e1ce483328d req-595862a5-7f7b-42cc-9645-83194d8af17a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:56.010921 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-da7fabfd-34f5-4658-85b0-5e1ce483328d req-595862a5-7f7b-42cc-9645-83194d8af17a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0559261 Dec 24 04:59:56.060311 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-da7fabfd-34f5-4658-85b0-5e1ce483328d req-8af6c2fe-d97e-49f6-bad4-2a8b06f7a19a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431302 Dec 24 04:59:56.071820 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 61ec3441-5b75-4c07-b8ad-4174450d6a55 up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 04:59:56.130398 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning for port 61ec3441-5b75-4c07-b8ad-4174450d6a55 completed by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 24 04:59:56.134430 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port 61ec3441-5b75-4c07-b8ad-4174450d6a55 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 04:59:56.134800 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:56.223351 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:56.257842 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 61ec3441-5b75-4c07-b8ad-4174450d6a55, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=61ec3441-5b75-4c07-b8ad-4174450d6a55,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 04:59:56.262552 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:56.312964 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=61ec3441-5b75-4c07-b8ad-4174450d6a55,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 04:59:56.337324 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fe2762b-4e28-4f59-9309-f1dae2b8e43c req-4edef3a7-0ef6-4d32-af05-d3529b553d12 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:56.339048 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9fe2762b-4e28-4f59-9309-f1dae2b8e43c req-4edef3a7-0ef6-4d32-af05-d3529b553d12 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 943 time: 0.0629361 Dec 24 04:59:56.384290 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9fe2762b-4e28-4f59-9309-f1dae2b8e43c req-b563e4ff-fece-4b39-b62e-0a916a5c91f9 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391448 Dec 24 04:59:56.433844 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:56.498067 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a8504e2-4737-4e3f-9430-62c79dd9d26c req-d03ea7db-495a-48fd-bb58-2035969dfb82 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:56.499569 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7a8504e2-4737-4e3f-9430-62c79dd9d26c req-d03ea7db-495a-48fd-bb58-2035969dfb82 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0508685 Dec 24 04:59:56.565005 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7a8504e2-4737-4e3f-9430-62c79dd9d26c req-ed948518-f4da-4e91-8a90-87c6af17396f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0548308 Dec 24 04:59:57.192687 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c58790f-7641-4056-aa76-08c421831da2 req-3d1e8e3e-e102-4398-92e7-ebb3153df250 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:57.194206 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8c58790f-7641-4056-aa76-08c421831da2 req-3d1e8e3e-e102-4398-92e7-ebb3153df250 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0503788 Dec 24 04:59:57.248449 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8c58790f-7641-4056-aa76-08c421831da2 req-ffa1d826-8b41-4717-a991-24fc3415eb47 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0481396 Dec 24 04:59:57.428060 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6485c286-d5e3-42e7-bf58-c4685f8c3066', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '61ec3441-5b75-4c07-b8ad-4174450d6a55'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 04:59:57.430503 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6a507996-ec03-4fb1-a296-4de094377145" -d '{"events": [{"server_uuid": "6485c286-d5e3-42e7-bf58-c4685f8c3066", "name": "network-vif-plugged", "status": "completed", "tag": "61ec3441-5b75-4c07-b8ad-4174450d6a55"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 04:59:57.471986 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 04:59:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-572badad-152e-459f-b0bf-6f426788879d x-openstack-request-id: req-572badad-152e-459f-b0bf-6f426788879d {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 04:59:57.472550 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6485c286-d5e3-42e7-bf58-c4685f8c3066", "name": "network-vif-plugged", "status": "completed", "tag": "61ec3441-5b75-4c07-b8ad-4174450d6a55", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 04:59:57.473152 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-572badad-152e-459f-b0bf-6f426788879d {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 04:59:57.473842 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6485c286-d5e3-42e7-bf58-c4685f8c3066', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '61ec3441-5b75-4c07-b8ad-4174450d6a55', 'code': 200} Dec 24 04:59:57.504257 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f448df60-7870-4be4-a02d-5ab1653ab3be req-0d653746-d9cd-4d34-a98b-70041f3b6828 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:57.505754 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f448df60-7870-4be4-a02d-5ab1653ab3be req-0d653746-d9cd-4d34-a98b-70041f3b6828 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 943 time: 0.0547481 Dec 24 04:59:57.567740 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f448df60-7870-4be4-a02d-5ab1653ab3be req-9ab4dd5b-648b-4f0f-aa80-af0f704047a3 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0546005 Dec 24 04:59:57.688502 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a1831aa-3b6c-48fb-8cac-7bd6639bf543 req-dfe22d5c-5d59-44a0-a721-793ed333cca6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:57.689977 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0a1831aa-3b6c-48fb-8cac-7bd6639bf543 req-dfe22d5c-5d59-44a0-a721-793ed333cca6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0509064 Dec 24 04:59:57.740376 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0a1831aa-3b6c-48fb-8cac-7bd6639bf543 req-cf16ebf5-048c-461c-901a-db6b6d6cf506 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419123 Dec 24 04:59:57.885364 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:58.369049 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1441e8ea-bf83-4639-bab9-3b13e869949a req-0fe0e217-a9ee-4a6e-80f3-7f86161ac66e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:58.370539 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1441e8ea-bf83-4639-bab9-3b13e869949a req-0fe0e217-a9ee-4a6e-80f3-7f86161ac66e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0483208 Dec 24 04:59:58.428037 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1441e8ea-bf83-4639-bab9-3b13e869949a req-abdda8cb-22c1-48e7-8779-115ff939c927 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0512679 Dec 24 04:59:58.597245 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 04:59:58.695517 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ead3ff1-1d9c-46d1-a645-636d5c58b592 req-b14e8eb4-e1d6-4556-8940-ae38c869023d tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:58.697098 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7ead3ff1-1d9c-46d1-a645-636d5c58b592 req-b14e8eb4-e1d6-4556-8940-ae38c869023d tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 943 time: 0.0545399 Dec 24 04:59:58.744289 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7ead3ff1-1d9c-46d1-a645-636d5c58b592 req-f5d14b17-e0e1-4abd-ba02-7e9bc9b98e6c tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408590 Dec 24 04:59:58.873661 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8dd88ed-a44b-45a3-86bd-4209258c2036 req-3b1796e3-8836-43d7-95e1-775669eafacc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:58.876118 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a8dd88ed-a44b-45a3-86bd-4209258c2036 req-3b1796e3-8836-43d7-95e1-775669eafacc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0580566 Dec 24 04:59:58.929241 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a8dd88ed-a44b-45a3-86bd-4209258c2036 req-e4628a46-f1e8-4ac1-9ea3-04cb380a54f6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0478024 Dec 24 04:59:59.570871 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dac2a339-8ed4-4d5e-94ed-9150c2ad779e req-44cca18d-722b-44c2-aa36-4b31c791c365 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:59.573148 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-dac2a339-8ed4-4d5e-94ed-9150c2ad779e req-44cca18d-722b-44c2-aa36-4b31c791c365 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0605781 Dec 24 04:59:59.622862 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-dac2a339-8ed4-4d5e-94ed-9150c2ad779e req-b5f97c30-724c-40c9-8052-659e479f769d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414536 Dec 24 04:59:59.869488 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd61bbb-1603-4b95-86b1-9078c8fd3b21 req-1e52d1b9-e043-4167-840f-d7e16fdb3fb6 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 04:59:59.871615 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ecd61bbb-1603-4b95-86b1-9078c8fd3b21 req-1e52d1b9-e043-4167-840f-d7e16fdb3fb6 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 943 time: 0.0616579 Dec 24 04:59:59.920236 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ecd61bbb-1603-4b95-86b1-9078c8fd3b21 req-5e07bc28-69bc-42c6-b493-50e2d2953949 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422056 Dec 24 05:00:00.056908 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcae18e4-c0e0-4e4c-9fc0-9d460778b343 req-2f09ac67-fddd-440f-aab8-0bb9cf289245 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:00.058357 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bcae18e4-c0e0-4e4c-9fc0-9d460778b343 req-2f09ac67-fddd-440f-aab8-0bb9cf289245 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0587890 Dec 24 05:00:00.107978 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bcae18e4-c0e0-4e4c-9fc0-9d460778b343 req-ec70ab56-3ed4-4490-a4d4-2c9c8960dbee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425291 Dec 24 05:00:00.743701 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef888909-57aa-4b54-bfb2-b1bd729e579b req-c39556af-1379-4e2d-b57f-7e146bceb608 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:00.745180 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ef888909-57aa-4b54-bfb2-b1bd729e579b req-c39556af-1379-4e2d-b57f-7e146bceb608 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0488319 Dec 24 05:00:00.795016 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ef888909-57aa-4b54-bfb2-b1bd729e579b req-ff1abbbf-980d-437f-8bd9-873b6c549541 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438907 Dec 24 05:00:01.049580 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1865471-9c56-4a7f-8413-9ffc9e1e96a4 req-db76a899-5bd3-4f19-90af-91a94f70fabb tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:01.051066 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a1865471-9c56-4a7f-8413-9ffc9e1e96a4 req-db76a899-5bd3-4f19-90af-91a94f70fabb tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 943 time: 0.0615234 Dec 24 05:00:01.101846 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a1865471-9c56-4a7f-8413-9ffc9e1e96a4 req-50537927-4a34-494a-8ce6-61a5e14788e4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445611 Dec 24 05:00:01.229553 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-876a5d48-cce1-4718-ae5c-e4be7a1c261f req-608f6b5c-47e2-476e-a795-ad8ba5c38e3d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:01.231046 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-876a5d48-cce1-4718-ae5c-e4be7a1c261f req-608f6b5c-47e2-476e-a795-ad8ba5c38e3d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0479207 Dec 24 05:00:01.241537 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14df9264-b1e8-471c-8434-89ab434898cf req-77a7ba90-7167-4725-b32e-9a383b2958d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:01.243183 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-14df9264-b1e8-471c-8434-89ab434898cf req-77a7ba90-7167-4725-b32e-9a383b2958d1 service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 1098 time: 0.0387106 Dec 24 05:00:01.284422 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-876a5d48-cce1-4718-ae5c-e4be7a1c261f req-17dba13e-136c-4824-968b-778aa15cb996 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0467479 Dec 24 05:00:01.303833 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-14df9264-b1e8-471c-8434-89ab434898cf req-677bee68-e22a-43aa-8aaf-046dbebbd14a service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432022 Dec 24 05:00:01.920024 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5531ca9-c3d6-429e-8686-4ec6af302e98 req-e2739495-8380-4d12-91ad-cea19be70c79 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:01.921532 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c5531ca9-c3d6-429e-8686-4ec6af302e98 req-e2739495-8380-4d12-91ad-cea19be70c79 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0525761 Dec 24 05:00:01.970687 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c5531ca9-c3d6-429e-8686-4ec6af302e98 req-f92574a1-07a2-4886-8be7-f7d76a62042e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428731 Dec 24 05:00:02.232113 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed82e480-8d64-427b-8409-abea9c2c8e0f req-411f8964-31af-442c-9ab9-c4d29996ca67 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:02.233642 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ed82e480-8d64-427b-8409-abea9c2c8e0f req-411f8964-31af-442c-9ab9-c4d29996ca67 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 943 time: 0.0495782 Dec 24 05:00:02.283339 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ed82e480-8d64-427b-8409-abea9c2c8e0f req-cb2a68b9-2849-4056-a818-80d4c9563a85 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434182 Dec 24 05:00:02.408945 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-698b59c8-2c46-4e77-ae18-5fcfa6e12a3b req-68375a64-484d-41c2-b94c-1ff8e03d55ac tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:02.410524 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-698b59c8-2c46-4e77-ae18-5fcfa6e12a3b req-68375a64-484d-41c2-b94c-1ff8e03d55ac tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0538180 Dec 24 05:00:02.460685 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-698b59c8-2c46-4e77-ae18-5fcfa6e12a3b req-fb3e0dd7-deff-487d-877d-9525a5a07a03 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439548 Dec 24 05:00:03.091705 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a46ef2ab-cf18-4326-b95e-6e77857d785b req-8eb62dd5-7e66-4eb1-8c6f-0aed3861aaef tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:03.093181 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a46ef2ab-cf18-4326-b95e-6e77857d785b req-8eb62dd5-7e66-4eb1-8c6f-0aed3861aaef tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0537486 Dec 24 05:00:03.144717 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a46ef2ab-cf18-4326-b95e-6e77857d785b req-798aca58-47be-414a-bb60-51a0308a6ce9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423398 Dec 24 05:00:03.419526 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73ff3481-33a5-4198-b2ab-75b2b384929f req-bfd426c5-118d-491d-997a-3e5539df8798 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:03.420995 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-73ff3481-33a5-4198-b2ab-75b2b384929f req-bfd426c5-118d-491d-997a-3e5539df8798 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 943 time: 0.0627117 Dec 24 05:00:03.467954 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-73ff3481-33a5-4198-b2ab-75b2b384929f req-a2feee8d-fa9a-432d-b7b0-a4f788b6b9fa tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404744 Dec 24 05:00:03.591172 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55579b70-fb36-47df-9340-9ec5f6ada691 req-370a64d5-9afb-4a57-ae25-2c4337fa33cf tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:03.592888 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-55579b70-fb36-47df-9340-9ec5f6ada691 req-370a64d5-9afb-4a57-ae25-2c4337fa33cf tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0588069 Dec 24 05:00:03.639239 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-55579b70-fb36-47df-9340-9ec5f6ada691 req-ee818a97-f6e3-4691-a3e8-01a39fb9ec2f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401783 Dec 24 05:00:04.269788 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71d5d931-c2ce-427e-8758-a1aedbf12495 req-7f2317b4-bd74-4d0e-ae7b-b98286cba7fa tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:04.271310 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-71d5d931-c2ce-427e-8758-a1aedbf12495 req-7f2317b4-bd74-4d0e-ae7b-b98286cba7fa tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0525970 Dec 24 05:00:04.321655 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-71d5d931-c2ce-427e-8758-a1aedbf12495 req-5e8435ad-332d-4430-9e90-ebb1fdba4c0a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445213 Dec 24 05:00:04.412213 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:00:04.593908 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fb8a432-446a-4b2f-a44e-8fdd75438179 req-df8f110c-a5f3-428e-92b6-af1359631477 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:04.595466 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0fb8a432-446a-4b2f-a44e-8fdd75438179 req-df8f110c-a5f3-428e-92b6-af1359631477 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 943 time: 0.0566580 Dec 24 05:00:04.650936 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0fb8a432-446a-4b2f-a44e-8fdd75438179 req-7cd91fd7-f030-4d50-95a5-a459d3f61f50 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493031 Dec 24 05:00:04.767254 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b98b685e-6ddd-4057-bff0-a776a2048d67 req-3775af81-dff2-423e-970e-c91fbdf4e953 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:04.768739 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b98b685e-6ddd-4057-bff0-a776a2048d67 req-3775af81-dff2-423e-970e-c91fbdf4e953 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0571530 Dec 24 05:00:04.818327 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b98b685e-6ddd-4057-bff0-a776a2048d67 req-330f35bb-3b80-4f10-9624-4b92588ed84d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408430 Dec 24 05:00:05.449671 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae20ea90-5e07-43a5-9907-6265b8918357 req-938e2ead-a56c-47e1-a4ff-4858795f9efc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:05.451607 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ae20ea90-5e07-43a5-9907-6265b8918357 req-938e2ead-a56c-47e1-a4ff-4858795f9efc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0539255 Dec 24 05:00:05.502112 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ae20ea90-5e07-43a5-9907-6265b8918357 req-fc72c182-2941-4fa4-b50c-6be3ae28eead tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442908 Dec 24 05:00:05.771795 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9466fc0b-a961-41c0-83dc-f1776c0a3030 req-84126826-230a-42f5-a9f0-c6e1d389b25b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:05.773309 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9466fc0b-a961-41c0-83dc-f1776c0a3030 req-84126826-230a-42f5-a9f0-c6e1d389b25b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 943 time: 0.0499322 Dec 24 05:00:05.820344 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9466fc0b-a961-41c0-83dc-f1776c0a3030 req-a0160c1d-9a8f-4f79-af09-a01fe7de5cf3 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411131 Dec 24 05:00:05.938881 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18ae270d-27e6-473e-9270-49a22efdf410 req-108cec05-4818-49e5-b860-bf79ac77b8de tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:05.940332 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-18ae270d-27e6-473e-9270-49a22efdf410 req-108cec05-4818-49e5-b860-bf79ac77b8de tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0517268 Dec 24 05:00:06.000394 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-18ae270d-27e6-473e-9270-49a22efdf410 req-2c5cce67-5ae6-4430-a872-5660d9ab9d4a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0539494 Dec 24 05:00:06.630830 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e961ad51-c93a-4312-b443-2fca4b7012f8 req-4bf6b370-0e4d-4644-86a4-005e0f5efbc7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:06.632317 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e961ad51-c93a-4312-b443-2fca4b7012f8 req-4bf6b370-0e4d-4644-86a4-005e0f5efbc7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0599501 Dec 24 05:00:06.680370 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e961ad51-c93a-4312-b443-2fca4b7012f8 req-cb035922-9a44-4879-b42e-e684d604cc3f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398421 Dec 24 05:00:06.960712 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28e238ec-be08-4533-8b8a-487fbabcbe9f req-e56ffdfe-11d0-45d3-b6da-0daa246d618b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:06.962149 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-28e238ec-be08-4533-8b8a-487fbabcbe9f req-e56ffdfe-11d0-45d3-b6da-0daa246d618b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 943 time: 0.0570080 Dec 24 05:00:07.016392 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-28e238ec-be08-4533-8b8a-487fbabcbe9f req-cf538d1b-5605-4bb4-be2d-acd44c380b0a tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0481770 Dec 24 05:00:07.134880 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cdecf94-4b1e-45e8-9977-4ff5643fb9ce req-676f9b4c-c299-49d3-b17e-fc8f6424bfed tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:07.136365 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2cdecf94-4b1e-45e8-9977-4ff5643fb9ce req-676f9b4c-c299-49d3-b17e-fc8f6424bfed tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0494819 Dec 24 05:00:07.183888 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2cdecf94-4b1e-45e8-9977-4ff5643fb9ce req-95e7a316-06aa-4ce1-8130-24b8115e4380 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415108 Dec 24 05:00:07.811150 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c09b3b40-99d1-4e14-8902-23eb7cb7eb3f req-d8907dc8-c4b6-4c42-9511-d6bf0206415b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:07.812722 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c09b3b40-99d1-4e14-8902-23eb7cb7eb3f req-d8907dc8-c4b6-4c42-9511-d6bf0206415b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0501029 Dec 24 05:00:07.859962 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c09b3b40-99d1-4e14-8902-23eb7cb7eb3f req-045ad193-84ab-44aa-a559-6a07fdc7ba83 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412924 Dec 24 05:00:08.144827 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd8a11e2-a971-4f23-a41c-e2be3a240337 req-074dde7b-19f0-43b2-8fd3-5d0a61f98179 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:08.146274 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bd8a11e2-a971-4f23-a41c-e2be3a240337 req-074dde7b-19f0-43b2-8fd3-5d0a61f98179 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 943 time: 0.0520942 Dec 24 05:00:08.197900 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bd8a11e2-a971-4f23-a41c-e2be3a240337 req-61dbe299-43f5-4d0f-9b2a-18b86d48cecb tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432076 Dec 24 05:00:08.312462 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6292e436-2b6e-4a45-9536-383df2b6cb5a req-1d97cba9-2ec0-4322-a638-eb4f14aa9224 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:08.314070 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6292e436-2b6e-4a45-9536-383df2b6cb5a req-1d97cba9-2ec0-4322-a638-eb4f14aa9224 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0543058 Dec 24 05:00:08.368412 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6292e436-2b6e-4a45-9536-383df2b6cb5a req-a1cfde24-8c65-4d60-a560-c8913fbe8132 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425618 Dec 24 05:00:08.980792 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4432d3c6-5334-42c7-99a1-caaea6dab386 req-4e7e0e2e-a3bf-40cb-ab16-fe368e5d9ab5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:08.984115 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4432d3c6-5334-42c7-99a1-caaea6dab386 req-4e7e0e2e-a3bf-40cb-ab16-fe368e5d9ab5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0576272 Dec 24 05:00:09.033245 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4432d3c6-5334-42c7-99a1-caaea6dab386 req-64d2f572-d3b4-4ad8-a754-03483b37da1d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447822 Dec 24 05:00:09.325725 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42db5a25-bf45-4d1a-bccc-6367412d1bb5 req-927ed0e2-b6c0-413e-8a8b-c31b638b10ba tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:09.327201 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-42db5a25-bf45-4d1a-bccc-6367412d1bb5 req-927ed0e2-b6c0-413e-8a8b-c31b638b10ba tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 943 time: 0.0540614 Dec 24 05:00:09.384864 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-42db5a25-bf45-4d1a-bccc-6367412d1bb5 req-c01e173b-2004-4eba-aae5-555bbb1084d8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0512156 Dec 24 05:00:09.491024 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85c379af-05ac-49fc-8455-d5e6f9394bf4 req-a8f77654-7c34-4bc4-9d36-26491eee5884 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:09.492552 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-85c379af-05ac-49fc-8455-d5e6f9394bf4 req-a8f77654-7c34-4bc4-9d36-26491eee5884 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0489149 Dec 24 05:00:09.547569 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-85c379af-05ac-49fc-8455-d5e6f9394bf4 req-e7dd02e7-2273-4e62-895e-09f27a6cb093 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0459743 Dec 24 05:00:10.165415 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e339d3-eed8-4a8b-8580-385d48ac0b6e req-fcefd140-9541-4b11-af29-962d843db692 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:10.166766 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d2e339d3-eed8-4a8b-8580-385d48ac0b6e req-fcefd140-9541-4b11-af29-962d843db692 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0610392 Dec 24 05:00:10.219829 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d2e339d3-eed8-4a8b-8580-385d48ac0b6e req-a8c58612-eab0-493f-992c-62cb2d02876f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449944 Dec 24 05:00:10.514452 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecb4d42d-6f00-4c5f-abe5-8cd67851a637 req-146e1f4a-d34b-4476-810b-f9d21bc5deed tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:10.516192 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ecb4d42d-6f00-4c5f-abe5-8cd67851a637 req-146e1f4a-d34b-4476-810b-f9d21bc5deed tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 943 time: 0.0507340 Dec 24 05:00:10.567590 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ecb4d42d-6f00-4c5f-abe5-8cd67851a637 req-c206243d-f484-4ed6-b8b5-2a7dd459f679 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441258 Dec 24 05:00:10.677574 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d330bed-6664-4677-a0a1-40cb0301b7ca req-0afa23fb-3d4b-4ca7-a4b8-2ebed2533506 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:10.679271 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6d330bed-6664-4677-a0a1-40cb0301b7ca req-0afa23fb-3d4b-4ca7-a4b8-2ebed2533506 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0570369 Dec 24 05:00:10.741121 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6d330bed-6664-4677-a0a1-40cb0301b7ca req-a26466f1-2e13-4b67-9c40-d777769539e0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0552471 Dec 24 05:00:11.338838 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4a30d16-9ea8-4416-af93-67dc219e3fb8 req-7d4de007-6024-49f8-9957-d1c5228d5790 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:11.340236 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a4a30d16-9ea8-4416-af93-67dc219e3fb8 req-7d4de007-6024-49f8-9957-d1c5228d5790 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0497782 Dec 24 05:00:11.389239 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a4a30d16-9ea8-4416-af93-67dc219e3fb8 req-7f5cba18-78b0-467a-9d85-179973a2792d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427830 Dec 24 05:00:11.705307 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60282809-c155-4ef4-a47e-368182c6ad2b req-d1962105-7e11-4671-95c0-f69b2ac200c7 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:11.715507 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-60282809-c155-4ef4-a47e-368182c6ad2b req-d1962105-7e11-4671-95c0-f69b2ac200c7 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 943 time: 0.0700476 Dec 24 05:00:11.742999 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4834dad5-ccf1-4888-b524-96cd3ff992a3 req-47a4391c-ae75-4064-bd4c-d7443db120b1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:11.744591 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4834dad5-ccf1-4888-b524-96cd3ff992a3 req-47a4391c-ae75-4064-bd4c-d7443db120b1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0677431 Dec 24 05:00:11.805211 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-60282809-c155-4ef4-a47e-368182c6ad2b req-f02b5f52-77a1-445d-b24f-eb6dfe34f949 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0883200 Dec 24 05:00:11.826065 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01a82663-f70b-421c-9875-723ab30b7fc3 req-c66ae233-f071-4e4a-99fe-2c6e5a8b6f0d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:11.828079 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-01a82663-f70b-421c-9875-723ab30b7fc3 req-c66ae233-f071-4e4a-99fe-2c6e5a8b6f0d service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=1b651e55b1a349a0b9582c526d3b5d67&device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 1099 time: 0.1042271 Dec 24 05:00:11.833712 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4834dad5-ccf1-4888-b524-96cd3ff992a3 req-8fda11f9-0ab0-45d5-ba09-62e13775ce6c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0802410 Dec 24 05:00:11.925881 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ac289aa-d16c-43ea-9deb-1a7d2e846e1e req-84aba4c2-034b-43de-82f5-aa3edaa796eb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:11.927706 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1ac289aa-d16c-43ea-9deb-1a7d2e846e1e req-84aba4c2-034b-43de-82f5-aa3edaa796eb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0579484 Dec 24 05:00:12.044569 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1ac289aa-d16c-43ea-9deb-1a7d2e846e1e req-87998f4e-3edc-49d8-98d5-070488c745b7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1093469 Dec 24 05:00:12.065864 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01a82663-f70b-421c-9875-723ab30b7fc3 req-11d96346-7168-4d9e-b88e-5eb62baad499 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:12.067437 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-01a82663-f70b-421c-9875-723ab30b7fc3 req-11d96346-7168-4d9e-b88e-5eb62baad499 service neutron] 10.222.0.46 "GET /v2.0/networks?id=0d368baa-5733-40a7-b836-139a541f4ebb HTTP/1.1" status: 200 len: 919 time: 0.1310334 Dec 24 05:00:12.119826 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 95dbce62-23b4-409c-85a9-e1a32a7eb1bb details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 05:00:12.139819 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-01a82663-f70b-421c-9875-723ab30b7fc3 req-4775e361-1c17-4fd0-9d65-73add0a0b371 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=24d08627-8243-4361-b6b4-8461a18d110f HTTP/1.1" status: 200 len: 217 time: 0.0360932 Dec 24 05:00:12.205068 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01a82663-f70b-421c-9875-723ab30b7fc3 req-343d3c20-562f-4962-ab4f-bf1d7cf7b823 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:12.206533 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-01a82663-f70b-421c-9875-723ab30b7fc3 req-343d3c20-562f-4962-ab4f-bf1d7cf7b823 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=88f274d6-bcf0-47e8-9f0a-783a53214be4 HTTP/1.1" status: 200 len: 858 time: 0.0495470 Dec 24 05:00:12.222503 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 95dbce62-23b4-409c-85a9-e1a32a7eb1bb, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=95dbce62-23b4-409c-85a9-e1a32a7eb1bb,segment=NetworkSegment(00999af0-b9ae-4a2b-9c30-590dbe00c43a),segment_id=00999af0-b9ae-4a2b-9c30-590dbe00c43a)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:00:12.234605 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': '95dbce62-23b4-409c-85a9-e1a32a7eb1bb', 'network_id': 'c2c27570-f2cd-4dac-9473-e82a4e432501', 'port_id': '95dbce62-23b4-409c-85a9-e1a32a7eb1bb', 'mac_address': 'fa:16:3e:24:ae:d1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 103, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b6657dc9-704f-488f-a929-3d0573a04d1f', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 05:00:12.274190 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:12.282145 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-01a82663-f70b-421c-9875-723ab30b7fc3 req-1787fd31-8ff2-476a-88a7-8d6d243bcec6 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=0d368baa-5733-40a7-b836-139a541f4ebb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0256829 Dec 24 05:00:12.289272 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 95dbce62-23b4-409c-85a9-e1a32a7eb1bb {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:00:12.310097 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 95dbce62-23b4-409c-85a9-e1a32a7eb1bb, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=95dbce62-23b4-409c-85a9-e1a32a7eb1bb,segment=NetworkSegment(00999af0-b9ae-4a2b-9c30-590dbe00c43a),segment_id=00999af0-b9ae-4a2b-9c30-590dbe00c43a)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:00:12.317396 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:12.366066 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=95dbce62-23b4-409c-85a9-e1a32a7eb1bb,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:12.373258 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:12.373632 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:12.373999 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:12.374341 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:12.374736 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:12.375160 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:12.375400 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:12.375730 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:12.376055 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:12.376378 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:12.376730 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:12.377052 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:12.377371 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:12.378744 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-01a82663-f70b-421c-9875-723ab30b7fc3 req-2314b9e6-ffc1-4d9f-aa4d-5cd18a70b561 service neutron] 10.222.0.46 "GET /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844219 Dec 24 05:00:12.485200 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-01a82663-f70b-421c-9875-723ab30b7fc3 req-52f1117e-5dd3-4ce3-9b58-e003c4654c25 service neutron] 10.222.0.46 "GET /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0887532 Dec 24 05:00:12.910461 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d07dba6a-bc47-4703-9017-00ea58c19a30 req-97f15c3e-d3be-48df-868e-208ce04dc6e6 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:12.912098 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d07dba6a-bc47-4703-9017-00ea58c19a30 req-97f15c3e-d3be-48df-868e-208ce04dc6e6 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 944 time: 0.0521519 Dec 24 05:00:12.962266 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d07dba6a-bc47-4703-9017-00ea58c19a30 req-27196ec0-a99a-4998-b2fb-74fabcb1d6f2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439076 Dec 24 05:00:12.989816 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08f92b31-2122-4f57-87ed-45f4a6aef036 req-040b8a51-ba4a-4c33-90ed-3169ef020e64 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:12.999835 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-08f92b31-2122-4f57-87ed-45f4a6aef036 req-040b8a51-ba4a-4c33-90ed-3169ef020e64 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0934918 Dec 24 05:00:13.041645 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['95dbce62-23b4-409c-85a9-e1a32a7eb1bb'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:00:13.067838 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-08f92b31-2122-4f57-87ed-45f4a6aef036 req-a7116880-10a2-4386-9bed-15e146d162e5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0647740 Dec 24 05:00:13.183413 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7a1aff3-53d4-4930-a70b-0285d4a968e7 req-72cac51f-882e-406c-b44b-c20d6d32d506 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:13.185009 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b7a1aff3-53d4-4930-a70b-0285d4a968e7 req-72cac51f-882e-406c-b44b-c20d6d32d506 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0510678 Dec 24 05:00:13.235504 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b7a1aff3-53d4-4930-a70b-0285d4a968e7 req-6b94d1bb-0ac5-470a-b9d7-f8954506e43d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445235 Dec 24 05:00:13.358905 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85f84946-09ae-4038-92d8-106f46a927b3 req-9dc9c462-f2ac-4d22-899a-8aaca2a6be39 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:13.360718 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-85f84946-09ae-4038-92d8-106f46a927b3 req-9dc9c462-f2ac-4d22-899a-8aaca2a6be39 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0590167 Dec 24 05:00:13.373792 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 53218) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:13.378585 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-677c8c73-ab31-4c8e-b50a-c1192decd326 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Request body: {'floatingip': {'port_id': '61ec3441-5b75-4c07-b8ad-4174450d6a55'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:00:13.448234 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-677c8c73-ab31-4c8e-b50a-c1192decd326 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for floatingip, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:14.059693 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-677c8c73-ab31-4c8e-b50a-c1192decd326 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:14.064829 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-677c8c73-ab31-4c8e-b50a-c1192decd326 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-545804'] for floatingip, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:14.097800 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b85b9f6-4548-4257-a653-a01229b38583 req-85404a2c-ead5-4d94-8572-96294805c972 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:14.099259 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-2b85b9f6-4548-4257-a653-a01229b38583 req-85404a2c-ead5-4d94-8572-96294805c972 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 944 time: 0.0554650 Dec 24 05:00:14.198252 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-2b85b9f6-4548-4257-a653-a01229b38583 req-96a0c518-d6d4-4e29-bdbb-4fe9693285a9 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0898781 Dec 24 05:00:14.417244 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c9c897e-f6cf-47c7-9429-6331608298e7 req-36faedc9-0f9d-4cf8-b149-a541b440d7b8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:14.418720 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0c9c897e-f6cf-47c7-9429-6331608298e7 req-36faedc9-0f9d-4cf8-b149-a541b440d7b8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.1021051 Dec 24 05:00:14.423849 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.l3_db [None req-677c8c73-ab31-4c8e-b50a-c1192decd326 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Floating IP 84745415-6c2d-486f-9fad-9bd76e6c1538 associated. External IP: 172.27.1.63, port: 61ec3441-5b75-4c07-b8ad-4174450d6a55. Dec 24 05:00:14.537594 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0c9c897e-f6cf-47c7-9429-6331608298e7 req-1057b65e-7257-45e0-8b5f-9438b0b00c99 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1113303 Dec 24 05:00:14.665035 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-677c8c73-ab31-4c8e-b50a-c1192decd326 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Router d1392df8-0562-4659-9906-2d085b726626 has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102476) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:00:14.780804 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-677c8c73-ab31-4c8e-b50a-c1192decd326 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:00:14.786594 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-677c8c73-ab31-4c8e-b50a-c1192decd326 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for floatingip, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:14.794692 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7e46702-634f-4a2c-9da5-e805f814b2d6 None None] Sync routers for ids ['d1392df8-0562-4659-9906-2d085b726626'] in dv-cinder-816443-2-iscsi {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:00:14.805424 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7e46702-634f-4a2c-9da5-e805f814b2d6 None None] Routers {'d1392df8-0562-4659-9906-2d085b726626'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:00:14.806435 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-b7e46702-634f-4a2c-9da5-e805f814b2d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T04:59:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['d1392df8-0562-4659-9906-2d085b726626'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:00:14.816693 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-677c8c73-ab31-4c8e-b50a-c1192decd326 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "PUT /v2.0/floatingips/84745415-6c2d-486f-9fad-9bd76e6c1538 HTTP/1.1" status: 200 len: 990 time: 1.4417720 Dec 24 05:00:14.817384 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6485c286-d5e3-42e7-bf58-c4685f8c3066', 'tag': '61ec3441-5b75-4c07-b8ad-4174450d6a55'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:00:14.819758 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a3a0478e-fb80-44b4-9117-28d62fea9a3b" -d '{"events": [{"name": "network-changed", "server_uuid": "6485c286-d5e3-42e7-bf58-c4685f8c3066", "tag": "61ec3441-5b75-4c07-b8ad-4174450d6a55"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:00:14.879014 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:00:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9eb07324-4929-4ce3-a62c-04f2edc630e8 x-openstack-request-id: req-9eb07324-4929-4ce3-a62c-04f2edc630e8 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:00:14.879299 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6485c286-d5e3-42e7-bf58-c4685f8c3066", "tag": "61ec3441-5b75-4c07-b8ad-4174450d6a55", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:00:14.879549 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-9eb07324-4929-4ce3-a62c-04f2edc630e8 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:00:14.879947 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6485c286-d5e3-42e7-bf58-c4685f8c3066', 'tag': '61ec3441-5b75-4c07-b8ad-4174450d6a55', 'status': 'completed', 'code': 200} Dec 24 05:00:14.931713 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-b7e46702-634f-4a2c-9da5-e805f814b2d6 None None] Set router d1392df8-0562-4659-9906-2d085b726626 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:00:14.996060 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3a0478e-fb80-44b4-9117-28d62fea9a3b req-61fdaf30-8a11-481a-b7b2-502c72295d55 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:14.997613 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a3a0478e-fb80-44b4-9117-28d62fea9a3b req-61fdaf30-8a11-481a-b7b2-502c72295d55 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=6c9c47f70b8d4da5827a8ef4349559ab&device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 1098 time: 0.0416591 Dec 24 05:00:15.121402 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3a0478e-fb80-44b4-9117-28d62fea9a3b req-0076b506-8a55-4b2c-86fa-66f99f5388f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:15.122890 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a3a0478e-fb80-44b4-9117-28d62fea9a3b req-0076b506-8a55-4b2c-86fa-66f99f5388f8 service neutron] 10.222.0.46 "GET /v2.0/networks?id=c908572e-3b6b-470c-8b88-35b51f1472c6 HTTP/1.1" status: 200 len: 917 time: 0.0950367 Dec 24 05:00:15.204936 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-b7e46702-634f-4a2c-9da5-e805f814b2d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1392df8-0562-4659-9906-2d085b726626', 'name': 'tempest-AttachVolumeShelveTestJSON-634320677-router', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148'}], 'enable_snat': True}, 'gw_port_id': 'd5be979e-f11f-424a-bd46-164029481a60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:06Z', 'updated_at': '2021-12-24T04:59:13Z', 'revision_number': 4, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'gw_port': {'id': 'd5be979e-f11f-424a-bd46-164029481a60', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:30:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:07Z', 'updated_at': '2021-12-24T04:59:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': '84745415-6c2d-486f-9fad-9bd76e6c1538', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'floating_ip_address': '172.27.1.63', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': 'd1392df8-0562-4659-9906-2d085b726626', 'port_id': '61ec3441-5b75-4c07-b8ad-4174450d6a55', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 114, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'mac_address': 'fa:16:3e:41:aa:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6485c286-d5e3-42e7-bf58-c4685f8c3066', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T04:59:24Z', 'updated_at': '2021-12-24T05:00:13Z', 'revision_number': 1, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3e72624e-ab22-45c6-b262-91a63ca05279', 'name': '', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'mac_address': 'fa:16:3e:38:ea:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:12Z', 'updated_at': '2021-12-24T04:59:19Z', 'revision_number': 5, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'subnets': [{'id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:00:15.232722 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a3a0478e-fb80-44b4-9117-28d62fea9a3b req-d0eccc67-66a7-4fc7-81ae-f8851192d5fc service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=61ec3441-5b75-4c07-b8ad-4174450d6a55 HTTP/1.1" status: 200 len: 998 time: 0.0975821 Dec 24 05:00:15.246513 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7e46702-634f-4a2c-9da5-e805f814b2d6 None None] Checking router: d1392df8-0562-4659-9906-2d085b726626 for host: dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:00:15.256401 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7e46702-634f-4a2c-9da5-e805f814b2d6 None None] Routers {'d1392df8-0562-4659-9906-2d085b726626'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:00:15.257259 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-b7e46702-634f-4a2c-9da5-e805f814b2d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T04:59:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['d1392df8-0562-4659-9906-2d085b726626'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:00:15.365979 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3a0478e-fb80-44b4-9117-28d62fea9a3b req-96692767-8e7f-4956-9353-a46c5a562234 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:15.367448 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a3a0478e-fb80-44b4-9117-28d62fea9a3b req-96692767-8e7f-4956-9353-a46c5a562234 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=699b398d-7f9d-4acb-bc18-ac32f35377c3 HTTP/1.1" status: 200 len: 855 time: 0.1256421 Dec 24 05:00:15.375886 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fea526c-56db-4982-a2f2-9aed8c7a01f4 req-0f7eb7a3-96f8-4c0c-ac95-eb3a0ebdce94 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:15.377421 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7fea526c-56db-4982-a2f2-9aed8c7a01f4 req-0f7eb7a3-96f8-4c0c-ac95-eb3a0ebdce94 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 944 time: 0.0964408 Dec 24 05:00:15.478366 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7fea526c-56db-4982-a2f2-9aed8c7a01f4 req-6586b2ab-dfd4-419f-97c5-cc863ca717c7 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0891061 Dec 24 05:00:15.497075 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3a0478e-fb80-44b4-9117-28d62fea9a3b req-d03697b8-ebfe-43ad-b6ff-b72640fc256c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:15.497075 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a3a0478e-fb80-44b4-9117-28d62fea9a3b req-d03697b8-ebfe-43ad-b6ff-b72640fc256c service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=c908572e-3b6b-470c-8b88-35b51f1472c6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1144681 Dec 24 05:00:15.510260 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-b7e46702-634f-4a2c-9da5-e805f814b2d6 None None] Set router d1392df8-0562-4659-9906-2d085b726626 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:00:15.626554 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a3a0478e-fb80-44b4-9117-28d62fea9a3b req-f0323ed2-66d6-418f-ba09-fe037778168f service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1236012 Dec 24 05:00:15.677246 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e4beb2b-22a1-43cd-b9cc-ec7ee5bfe337 req-7c586e7d-f6d8-4cfc-b9fc-f5a95281051a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:15.684416 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5e4beb2b-22a1-43cd-b9cc-ec7ee5bfe337 req-7c586e7d-f6d8-4cfc-b9fc-f5a95281051a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0625181 Dec 24 05:00:15.736349 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5e4beb2b-22a1-43cd-b9cc-ec7ee5bfe337 req-6302ec5d-539a-4020-bf50-2c4583714f9e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0489838 Dec 24 05:00:15.750849 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a3a0478e-fb80-44b4-9117-28d62fea9a3b req-334b1ea5-b8e8-42c0-b970-862a797b594b service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1162128 Dec 24 05:00:15.814395 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-b7e46702-634f-4a2c-9da5-e805f814b2d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1392df8-0562-4659-9906-2d085b726626', 'name': 'tempest-AttachVolumeShelveTestJSON-634320677-router', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148'}], 'enable_snat': True}, 'gw_port_id': 'd5be979e-f11f-424a-bd46-164029481a60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:06Z', 'updated_at': '2021-12-24T04:59:13Z', 'revision_number': 4, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'gw_port': {'id': 'd5be979e-f11f-424a-bd46-164029481a60', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:30:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:07Z', 'updated_at': '2021-12-24T04:59:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': '84745415-6c2d-486f-9fad-9bd76e6c1538', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'floating_ip_address': '172.27.1.63', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': 'd1392df8-0562-4659-9906-2d085b726626', 'port_id': '61ec3441-5b75-4c07-b8ad-4174450d6a55', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 114, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'mac_address': 'fa:16:3e:41:aa:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6485c286-d5e3-42e7-bf58-c4685f8c3066', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T04:59:24Z', 'updated_at': '2021-12-24T05:00:13Z', 'revision_number': 1, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3e72624e-ab22-45c6-b262-91a63ca05279', 'name': '', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'mac_address': 'fa:16:3e:38:ea:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:12Z', 'updated_at': '2021-12-24T04:59:19Z', 'revision_number': 5, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'subnets': [{'id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:00:15.840113 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7e46702-634f-4a2c-9da5-e805f814b2d6 None None] The sync data for ids ['d1392df8-0562-4659-9906-2d085b726626'] in dv-cinder-816443-2-iscsi is: [{'id': 'd1392df8-0562-4659-9906-2d085b726626', 'name': 'tempest-AttachVolumeShelveTestJSON-634320677-router', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148'}], 'enable_snat': True}, 'gw_port_id': 'd5be979e-f11f-424a-bd46-164029481a60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:06Z', 'updated_at': '2021-12-24T04:59:13Z', 'revision_number': 4, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'gw_port': {'id': 'd5be979e-f11f-424a-bd46-164029481a60', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:30:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:07Z', 'updated_at': '2021-12-24T04:59:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': '84745415-6c2d-486f-9fad-9bd76e6c1538', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'floating_ip_address': '172.27.1.63', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': 'd1392df8-0562-4659-9906-2d085b726626', 'port_id': '61ec3441-5b75-4c07-b8ad-4174450d6a55', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 114, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'mac_address': 'fa:16:3e:41:aa:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6485c286-d5e3-42e7-bf58-c4685f8c3066', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T04:59:24Z', 'updated_at': '2021-12-24T05:00:13Z', 'revision_number': 1, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3e72624e-ab22-45c6-b262-91a63ca05279', 'name': '', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'mac_address': 'fa:16:3e:38:ea:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:12Z', 'updated_at': '2021-12-24T04:59:19Z', 'revision_number': 5, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'subnets': [{'id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:00:16.022948 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83d483cf-efae-42f1-8c67-fe59ea64b0e9 None None] New status for floating IP 84745415-6c2d-486f-9fad-9bd76e6c1538: ACTIVE {{(pid=102478) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 24 05:00:16.105977 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 95dbce62-23b4-409c-85a9-e1a32a7eb1bb up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:00:16.279041 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning for port 95dbce62-23b4-409c-85a9-e1a32a7eb1bb completed by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 24 05:00:16.284058 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port 95dbce62-23b4-409c-85a9-e1a32a7eb1bb triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:00:16.284431 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:16.298994 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bd2ef428-643f-4fe4-989c-50664f34adb4 req-ffd36d07-daf2-4f65-bf97-30c2ee4ebdbf service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0412102 Dec 24 05:00:16.373765 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:16.395566 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1f2eb78b-9eeb-4011-b480-333a74a448a7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '95dbce62-23b4-409c-85a9-e1a32a7eb1bb'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:00:16.397882 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4202da97-28f5-4590-bde5-c8bcda08ea8d" -d '{"events": [{"server_uuid": "1f2eb78b-9eeb-4011-b480-333a74a448a7", "name": "network-vif-plugged", "status": "completed", "tag": "95dbce62-23b4-409c-85a9-e1a32a7eb1bb"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:00:16.411043 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 95dbce62-23b4-409c-85a9-e1a32a7eb1bb, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=95dbce62-23b4-409c-85a9-e1a32a7eb1bb,segment=NetworkSegment(00999af0-b9ae-4a2b-9c30-590dbe00c43a),segment_id=00999af0-b9ae-4a2b-9c30-590dbe00c43a)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:00:16.417423 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:16.432176 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd2ef428-643f-4fe4-989c-50664f34adb4 req-14db88f9-7a96-4552-9140-2969b59d9102 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:16.433670 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bd2ef428-643f-4fe4-989c-50664f34adb4 req-14db88f9-7a96-4552-9140-2969b59d9102 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=14dbe9b1ff9041858e25c4fafebc1a51&device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 1098 time: 0.0476477 Dec 24 05:00:16.441101 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:00:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3000d2dc-f2ae-4cac-97f2-09446645de61 x-openstack-request-id: req-3000d2dc-f2ae-4cac-97f2-09446645de61 {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:00:16.441411 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1f2eb78b-9eeb-4011-b480-333a74a448a7", "name": "network-vif-plugged", "status": "completed", "tag": "95dbce62-23b4-409c-85a9-e1a32a7eb1bb", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:00:16.441686 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-3000d2dc-f2ae-4cac-97f2-09446645de61 {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:00:16.442054 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1f2eb78b-9eeb-4011-b480-333a74a448a7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '95dbce62-23b4-409c-85a9-e1a32a7eb1bb', 'code': 200} Dec 24 05:00:16.467397 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=95dbce62-23b4-409c-85a9-e1a32a7eb1bb,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:16.631984 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd2ef428-643f-4fe4-989c-50664f34adb4 req-2c8fdc9a-8383-4dbb-b905-0751b6df4b05 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:16.633482 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bd2ef428-643f-4fe4-989c-50664f34adb4 req-2c8fdc9a-8383-4dbb-b905-0751b6df4b05 service neutron] 10.222.0.46 "GET /v2.0/networks?id=598b6cd9-9673-4e27-b33e-451cd98b5f1c HTTP/1.1" status: 200 len: 913 time: 0.1202922 Dec 24 05:00:16.641877 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edc0ca9b-a385-4a14-8c48-f3b6efba9b45 req-99b9951b-cb1b-4152-a603-6097f95a818b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:16.643348 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-edc0ca9b-a385-4a14-8c48-f3b6efba9b45 req-99b9951b-cb1b-4152-a603-6097f95a818b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 945 time: 0.0716395 Dec 24 05:00:16.701910 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bd2ef428-643f-4fe4-989c-50664f34adb4 req-4121af2a-91bb-4368-bd61-6434091580c9 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c20bf82b-830b-4f29-b2bf-97f490cf78c9 HTTP/1.1" status: 200 len: 217 time: 0.0575767 Dec 24 05:00:16.802966 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-edc0ca9b-a385-4a14-8c48-f3b6efba9b45 req-88716598-9955-42c7-9c40-4b77b3e7f258 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1527762 Dec 24 05:00:16.817281 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd2ef428-643f-4fe4-989c-50664f34adb4 req-0693c789-9a49-41db-a65d-b7efd3f4ed6a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:16.818802 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bd2ef428-643f-4fe4-989c-50664f34adb4 req-0693c789-9a49-41db-a65d-b7efd3f4ed6a service neutron] 10.222.0.46 "GET /v2.0/subnets?id=32199feb-6f3a-4642-a10b-5d278d90a9e5 HTTP/1.1" status: 200 len: 852 time: 0.0969899 Dec 24 05:00:16.842967 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8a1b51e-47d1-40f0-838f-43f38e0d5936 req-cc43dddc-cfdd-41cb-8b0f-1d896af75c8b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:16.845142 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c8a1b51e-47d1-40f0-838f-43f38e0d5936 req-cc43dddc-cfdd-41cb-8b0f-1d896af75c8b service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 1098 time: 0.1533239 Dec 24 05:00:16.871854 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bd2ef428-643f-4fe4-989c-50664f34adb4 req-08ac3b4c-72c0-40a1-9486-288394199ede service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=598b6cd9-9673-4e27-b33e-451cd98b5f1c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0386333 Dec 24 05:00:16.878225 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7612dff6-a3db-4ccb-a28b-216886ec1d13 req-5918a763-d504-4945-bed0-3e5cab6a9e7c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:16.881155 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7612dff6-a3db-4ccb-a28b-216886ec1d13 req-5918a763-d504-4945-bed0-3e5cab6a9e7c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0601737 Dec 24 05:00:16.941268 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c8a1b51e-47d1-40f0-838f-43f38e0d5936 req-e979d271-12f3-4e9c-9222-4e2f8e3fa6eb service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0760453 Dec 24 05:00:16.960006 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7612dff6-a3db-4ccb-a28b-216886ec1d13 req-0eda98f2-f408-4819-a73b-5a3615f5e9de tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0657589 Dec 24 05:00:16.999502 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bd2ef428-643f-4fe4-989c-50664f34adb4 req-7e8c35d3-c787-4845-9ab6-1acb9840c4e9 service neutron] 10.222.0.46 "GET /v2.0/networks/598b6cd9-9673-4e27-b33e-451cd98b5f1c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1131878 Dec 24 05:00:17.552718 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bd2ef428-643f-4fe4-989c-50664f34adb4 req-50ab42cc-afd3-461b-af1f-4b462c440662 service neutron] 10.222.0.46 "GET /v2.0/networks/598b6cd9-9673-4e27-b33e-451cd98b5f1c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1052587 Dec 24 05:00:17.924168 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e232e061-47ea-4e91-8863-894703c5d687 req-bfda38e1-f55a-40ce-88fd-6ff18c7eae11 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:17.925667 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e232e061-47ea-4e91-8863-894703c5d687 req-bfda38e1-f55a-40ce-88fd-6ff18c7eae11 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 945 time: 0.0554242 Dec 24 05:00:17.981094 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e232e061-47ea-4e91-8863-894703c5d687 req-4e9d018c-44ea-40a0-9552-e0632c8fd251 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464971 Dec 24 05:00:18.068500 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca84a35a-c63d-4ad5-bbd2-0689ed8e6d7a req-40a83de3-e08a-4a46-a9db-56fe33256af0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:18.069969 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ca84a35a-c63d-4ad5-bbd2-0689ed8e6d7a req-40a83de3-e08a-4a46-a9db-56fe33256af0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0472815 Dec 24 05:00:18.123062 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ca84a35a-c63d-4ad5-bbd2-0689ed8e6d7a req-e4156c3c-5464-4b67-9d2f-4387847e5d73 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442114 Dec 24 05:00:19.095281 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eec8cad-4663-43c6-8d48-09efff7f2da3 req-15488663-53bc-4287-bcba-4a2471358c15 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:19.096847 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3eec8cad-4663-43c6-8d48-09efff7f2da3 req-15488663-53bc-4287-bcba-4a2471358c15 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 945 time: 0.0465987 Dec 24 05:00:19.145347 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3eec8cad-4663-43c6-8d48-09efff7f2da3 req-199825d8-6ad9-4aed-a89b-211300493c22 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422640 Dec 24 05:00:19.253987 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90c2c708-496a-4e7e-87b7-213d56126b08 req-a4b65629-8c3b-4484-a483-debd11f563b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:19.255486 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-90c2c708-496a-4e7e-87b7-213d56126b08 req-a4b65629-8c3b-4484-a483-debd11f563b3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0515296 Dec 24 05:00:19.311459 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-90c2c708-496a-4e7e-87b7-213d56126b08 req-01d65636-4c20-4cb8-8c8d-38beab376468 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474527 Dec 24 05:00:19.386381 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:20.281805 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d7f7195-990d-4838-9d71-fca7b5015465 req-62bb111f-21b7-45e1-bd08-3baf1210a512 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:20.283276 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-9d7f7195-990d-4838-9d71-fca7b5015465 req-62bb111f-21b7-45e1-bd08-3baf1210a512 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 945 time: 0.0538757 Dec 24 05:00:20.330683 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-9d7f7195-990d-4838-9d71-fca7b5015465 req-ae49a9aa-42eb-40d0-bef9-ee4e29590e15 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415368 Dec 24 05:00:20.431876 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff2d2107-c705-42ad-87fd-8d0989555154 req-ac8d31fe-50aa-4279-9293-b0b5baaad843 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:20.433380 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ff2d2107-c705-42ad-87fd-8d0989555154 req-ac8d31fe-50aa-4279-9293-b0b5baaad843 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0482352 Dec 24 05:00:20.480432 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ff2d2107-c705-42ad-87fd-8d0989555154 req-2764f7cb-975e-4766-b5d0-4508a8805a4a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409665 Dec 24 05:00:21.111413 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-f9a29117-2df4-4105-967c-c9f3871c97e7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:21.112905 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-f9a29117-2df4-4105-967c-c9f3871c97e7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/networks?id=b92a87f3-957a-4ccb-9b5b-98ad92aebe6e HTTP/1.1" status: 200 len: 815 time: 0.2751331 Dec 24 05:00:21.128377 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-b7543074-64ed-4711-93fc-97c1b67ae597 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/quotas/8f1c3a94f02049e3a76c4fc01fa7a022 HTTP/1.1" status: 200 len: 375 time: 0.0096416 Dec 24 05:00:21.177085 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-9c312181-fa42-4f35-ab37-f706efef20ba tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=8f1c3a94f02049e3a76c4fc01fa7a022&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0428581 Dec 24 05:00:21.281961 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-05adae7a-512c-41b6-8654-efbe97ac143d service neutron] 10.222.0.43 "GET /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0977681 Dec 24 05:00:21.369650 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-fcd4c7bf-c8eb-453e-829a-ec93995fb648 service neutron] 10.222.0.43 "GET /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0816300 Dec 24 05:00:21.542024 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3408ae27-bae7-4c67-a97b-2b54301c198b req-d4450eeb-8897-439d-9fbc-f44235568c6a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 210 time: 0.0315540 Dec 24 05:00:21.602870 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b00cfe4c-e343-4141-b344-ba0627644052 req-f66901ae-b50b-46c6-a139-f48f543a9f58 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:21.604288 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b00cfe4c-e343-4141-b344-ba0627644052 req-f66901ae-b50b-46c6-a139-f48f543a9f58 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0498171 Dec 24 05:00:21.656285 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b00cfe4c-e343-4141-b344-ba0627644052 req-3d3aed9d-8add-4de9-a972-ac53b0c3f412 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456758 Dec 24 05:00:22.648502 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-eb361913-8779-4251-980d-0c0b6f9a0f13 req-4bf63410-1810-45d2-9959-72bc2e38cfd4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 210 time: 0.0286503 Dec 24 05:00:22.772008 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f26035df-b14a-42fd-b2a8-3ca00fd1c9d9 req-f1bc8c69-7903-4875-aadd-1ac39a9779fc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:22.773572 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f26035df-b14a-42fd-b2a8-3ca00fd1c9d9 req-f1bc8c69-7903-4875-aadd-1ac39a9779fc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0514660 Dec 24 05:00:22.829525 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f26035df-b14a-42fd-b2a8-3ca00fd1c9d9 req-fb209abc-85bc-4f14-a6b2-b2d25f0cc1a3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499640 Dec 24 05:00:23.195868 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b67f1947-d620-414e-a29e-82f83a23e811 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:23.759472 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-da4174b8-820b-4c60-96ec-e0ce4ca48b27 req-7df2a309-18ad-4962-8f6a-d439c97e1de6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 210 time: 0.0250013 Dec 24 05:00:23.968218 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fc828b1-4cac-4b14-8a48-e375cdbf3a2b req-60526546-75a4-4376-a63c-14bd6271d8ea tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:23.969480 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8fc828b1-4cac-4b14-8a48-e375cdbf3a2b req-60526546-75a4-4376-a63c-14bd6271d8ea tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0621233 Dec 24 05:00:24.015873 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8fc828b1-4cac-4b14-8a48-e375cdbf3a2b req-8bc244b5-a9be-424f-8279-c2eb2274350e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402567 Dec 24 05:00:24.862015 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a412f79d-0113-4847-b3d4-4fdf053d2fbe req-be2e5be0-cfd9-443e-b212-06218a9d4065 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 210 time: 0.0338109 Dec 24 05:00:25.135996 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c58fc56-b028-429e-9606-0360f92330ce req-4c9a9e45-efe7-4ccc-b948-94fbcaa43cae tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:25.137462 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0c58fc56-b028-429e-9606-0360f92330ce req-4c9a9e45-efe7-4ccc-b948-94fbcaa43cae tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0495071 Dec 24 05:00:25.184764 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0c58fc56-b028-429e-9606-0360f92330ce req-0656df28-4d79-413e-b3ce-a1c26919449a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400958 Dec 24 05:00:25.258332 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-cf03b2b8-54b4-4cdf-804d-a9b409626699 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:25.954603 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-850abbeb-c32e-4104-9190-b20e67577f33 req-0bd85d21-aaf1-49f4-b831-df2b756aa0ad tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 210 time: 0.0265777 Dec 24 05:00:26.314475 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-427a211e-9f37-41d1-b523-ab95fbefd920 req-5a8ae5c1-2dae-4aab-8f0a-16ababc674a9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:26.316002 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-427a211e-9f37-41d1-b523-ab95fbefd920 req-5a8ae5c1-2dae-4aab-8f0a-16ababc674a9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0587001 Dec 24 05:00:26.383771 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-427a211e-9f37-41d1-b523-ab95fbefd920 req-c8065b53-c519-4c80-87b5-b0b8449ac774 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0609291 Dec 24 05:00:26.438053 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:27.072541 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ff99a34c-525e-4fcc-affb-5a91c3458fcc req-c05b8b02-3fef-4aa4-9e80-ed8f2d178409 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 210 time: 0.0333464 Dec 24 05:00:27.646760 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d182dde-c84b-48ce-ae59-66d3de76a840 req-b58ed651-1b5b-4a4f-9732-76febc77ec0c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:27.648952 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4d182dde-c84b-48ce-ae59-66d3de76a840 req-b58ed651-1b5b-4a4f-9732-76febc77ec0c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0553868 Dec 24 05:00:27.667492 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2ad79b7-9fd5-4419-a08c-4f7edcd377fe req-afe785bb-3e7d-4259-9521-2969c780f77d tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:27.669115 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d2ad79b7-9fd5-4419-a08c-4f7edcd377fe req-afe785bb-3e7d-4259-9521-2969c780f77d tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 945 time: 0.0527539 Dec 24 05:00:27.701045 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4d182dde-c84b-48ce-ae59-66d3de76a840 req-fe86a69e-e58b-46a8-a0c2-af7aba0c1716 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449493 Dec 24 05:00:27.719709 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d2ad79b7-9fd5-4419-a08c-4f7edcd377fe req-db1122b8-7b7b-41fa-a1e5-633e576cec96 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441504 Dec 24 05:00:27.835095 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-a76cd4b9-fa41-4062-8e46-1da9766d3f07 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:27.836679 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-a76cd4b9-fa41-4062-8e46-1da9766d3f07 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.46 "GET /v2.0/networks?id=b92a87f3-957a-4ccb-9b5b-98ad92aebe6e HTTP/1.1" status: 200 len: 815 time: 0.1160965 Dec 24 05:00:27.881638 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-5dd9a82a-3906-4542-93bd-06e1c55c0996 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Request body: {'port': {'device_id': 'cccacaaf-be31-4169-8a5b-13ea806dbd2c', 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e', 'admin_state_up': True, 'tenant_id': '8f1c3a94f02049e3a76c4fc01fa7a022'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:00:27.886860 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:27.917926 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 53510) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:28.034177 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-5dd9a82a-3906-4542-93bd-06e1c55c0996 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Made reservation on behalf of 8f1c3a94f02049e3a76c4fc01fa7a022 for: {'port': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:00:28.038085 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-5dd9a82a-3906-4542-93bd-06e1c55c0996 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:28.050162 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-78b5388d-ed32-427e-a39b-e1233a3bfd54 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:28.138167 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-78b5388d-ed32-427e-a39b-e1233a3bfd54 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:28.143317 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-78b5388d-ed32-427e-a39b-e1233a3bfd54 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:28.180193 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-5dd9a82a-3906-4542-93bd-06e1c55c0996 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Allocated IP 172.20.0.10 (b92a87f3-957a-4ccb-9b5b-98ad92aebe6e/9b9ff65f-93c8-4cb1-8a99-961ba0d4beaa/b0bd939a-1211-4ec1-b074-b2767d087f95) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:00:28.197943 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78b5388d-ed32-427e-a39b-e1233a3bfd54 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1436baa9-74cb-4843-8d59-b852433686d1,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:28.201850 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-78b5388d-ed32-427e-a39b-e1233a3bfd54 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=8cea02e840af439e88cfe9464b0d69ac&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2823694 Dec 24 05:00:28.208839 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 53532) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:28.222523 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3942f171-625b-472d-9123-768ad081933c req-a56e28ce-3a39-4657-870c-fb2fc457fd99 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 210 time: 0.0499380 Dec 24 05:00:28.223953 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78b5388d-ed32-427e-a39b-e1233a3bfd54 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.224222 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78b5388d-ed32-427e-a39b-e1233a3bfd54 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.224581 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78b5388d-ed32-427e-a39b-e1233a3bfd54 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.224920 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78b5388d-ed32-427e-a39b-e1233a3bfd54 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.225247 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78b5388d-ed32-427e-a39b-e1233a3bfd54 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.225651 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78b5388d-ed32-427e-a39b-e1233a3bfd54 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.225878 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78b5388d-ed32-427e-a39b-e1233a3bfd54 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.226198 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78b5388d-ed32-427e-a39b-e1233a3bfd54 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.226545 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78b5388d-ed32-427e-a39b-e1233a3bfd54 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.226866 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78b5388d-ed32-427e-a39b-e1233a3bfd54 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.227182 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78b5388d-ed32-427e-a39b-e1233a3bfd54 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.227497 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78b5388d-ed32-427e-a39b-e1233a3bfd54 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.227821 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78b5388d-ed32-427e-a39b-e1233a3bfd54 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.354353 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-edd21959-b351-4b01-9be4-265e50b54a3a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:28.390551 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-edd21959-b351-4b01-9be4-265e50b54a3a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:28.414676 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-5dd9a82a-3906-4542-93bd-06e1c55c0996 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:28.463538 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-5dd9a82a-3906-4542-93bd-06e1c55c0996 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:28.465937 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-edd21959-b351-4b01-9be4-265e50b54a3a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:28.469287 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-edd21959-b351-4b01-9be4-265e50b54a3a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:28.470474 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-edd21959-b351-4b01-9be4-265e50b54a3a admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/1436baa9-74cb-4843-8d59-b852433686d1 HTTP/1.1" status: 204 len: 168 time: 0.2597229 Dec 24 05:00:28.504091 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edd21959-b351-4b01-9be4-265e50b54a3a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1436baa9-74cb-4843-8d59-b852433686d1,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:28.522163 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['50d50f46-e761-4fb1-9761-fa48778aa8aa'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:00:28.524186 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd21959-b351-4b01-9be4-265e50b54a3a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.525183 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd21959-b351-4b01-9be4-265e50b54a3a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.525521 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd21959-b351-4b01-9be4-265e50b54a3a admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.525853 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd21959-b351-4b01-9be4-265e50b54a3a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.526180 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd21959-b351-4b01-9be4-265e50b54a3a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.526496 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd21959-b351-4b01-9be4-265e50b54a3a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.526840 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd21959-b351-4b01-9be4-265e50b54a3a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.527156 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd21959-b351-4b01-9be4-265e50b54a3a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.527465 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd21959-b351-4b01-9be4-265e50b54a3a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.527817 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd21959-b351-4b01-9be4-265e50b54a3a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.528102 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd21959-b351-4b01-9be4-265e50b54a3a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.528442 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd21959-b351-4b01-9be4-265e50b54a3a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.528852 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edd21959-b351-4b01-9be4-265e50b54a3a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:00:28.533187 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-5dd9a82a-3906-4542-93bd-06e1c55c0996 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Network b92a87f3-957a-4ccb-9b5b-98ad92aebe6e is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:00:28.538864 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-5dd9a82a-3906-4542-93bd-06e1c55c0996 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:00:28.542609 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-5dd9a82a-3906-4542-93bd-06e1c55c0996 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:00:28.570286 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dd9a82a-3906-4542-93bd-06e1c55c0996 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Pushing event updated for resources: {'Port': ['ID=b0bd939a-1211-4ec1-b074-b2767d087f95,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:28.597932 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:28.600394 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:28.600394 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:28.600394 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:28.600394 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:28.600394 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:28.600394 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:28.600394 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:28.600394 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:28.600394 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:28.600394 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:28.600394 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:28.600394 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:28.605469 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-5dd9a82a-3906-4542-93bd-06e1c55c0996 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:28.606340 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-5dd9a82a-3906-4542-93bd-06e1c55c0996 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:28.627720 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:28.632334 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-5dd9a82a-3906-4542-93bd-06e1c55c0996 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.46 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7549205 Dec 24 05:00:28.661168 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-83dd2618-ea3d-41cf-9eed-7b03771f0b74 service neutron] Request body: {'port': {'device_id': 'cccacaaf-be31-4169-8a5b-13ea806dbd2c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81644'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:00:28.717469 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-83dd2618-ea3d-41cf-9eed-7b03771f0b74 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:28.811219 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 53548) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:28.826099 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-940e0166-0a37-4212-bb9c-74701ca46b75 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:28.854809 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc82ce6-75d0-4683-a092-1e27d90076f3 req-1940499f-017b-4518-a938-b224160acdfc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:28.857038 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-bdc82ce6-75d0-4683-a092-1e27d90076f3 req-1940499f-017b-4518-a938-b224160acdfc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0738964 Dec 24 05:00:28.933730 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c0c82c8-75bf-41cb-b992-187d335e3975 req-1a6b2f5d-5360-4949-9e9f-abbe9a1f3557 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:28.935349 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4c0c82c8-75bf-41cb-b992-187d335e3975 req-1a6b2f5d-5360-4949-9e9f-abbe9a1f3557 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 945 time: 0.0941191 Dec 24 05:00:28.940971 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-bdc82ce6-75d0-4683-a092-1e27d90076f3 req-c4bdb4ac-764a-4831-8c37-6eb992b99721 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0750120 Dec 24 05:00:28.977774 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-940e0166-0a37-4212-bb9c-74701ca46b75 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:28.982830 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-940e0166-0a37-4212-bb9c-74701ca46b75 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:29.007361 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-940e0166-0a37-4212-bb9c-74701ca46b75 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0b2d3d7d-61f2-4e8f-99eb-9bf7cd0e68b8,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:29.044323 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 53554) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:29.044569 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-940e0166-0a37-4212-bb9c-74701ca46b75 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=78b83fe1d31b4c218c15989d48d506c8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2318256 Dec 24 05:00:29.070576 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4c0c82c8-75bf-41cb-b992-187d335e3975 req-255d8440-5ace-4cf6-86b6-973234cbcfe3 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1063612 Dec 24 05:00:29.148193 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-792c52a3-8069-4bf8-837f-e46a04c44c4e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:29.150718 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-83dd2618-ea3d-41cf-9eed-7b03771f0b74 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b0bd939a-1211-4ec1-b074-b2767d087f95 {{(pid=102476) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:00:29.160417 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-83dd2618-ea3d-41cf-9eed-7b03771f0b74 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:29.186267 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-792c52a3-8069-4bf8-837f-e46a04c44c4e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:29.188616 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.provisioning_blocks [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-83dd2618-ea3d-41cf-9eed-7b03771f0b74 service neutron] Transition to ACTIVE for port object b0bd939a-1211-4ec1-b074-b2767d087f95 will not be triggered until provisioned by entity L2. {{(pid=102476) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 24 05:00:29.195209 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-83dd2618-ea3d-41cf-9eed-7b03771f0b74 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:29.352888 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da170ea-6d71-4002-9504-30cf14611dfb req-f82c1def-3982-46b3-9c10-7b4310d979ad tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:29.354527 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3da170ea-6d71-4002-9504-30cf14611dfb req-f82c1def-3982-46b3-9c10-7b4310d979ad tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 944 time: 0.0570626 Dec 24 05:00:29.408606 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3da170ea-6d71-4002-9504-30cf14611dfb req-c7667759-bb46-40e1-b05f-a17924652289 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461581 Dec 24 05:00:29.501946 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83dd2618-ea3d-41cf-9eed-7b03771f0b74 service neutron] Pushing event updated for resources: {'Port': ['ID=b0bd939a-1211-4ec1-b074-b2767d087f95,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:29.560748 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-792c52a3-8069-4bf8-837f-e46a04c44c4e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:29.564469 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-792c52a3-8069-4bf8-837f-e46a04c44c4e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:29.565831 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-792c52a3-8069-4bf8-837f-e46a04c44c4e admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/0b2d3d7d-61f2-4e8f-99eb-9bf7cd0e68b8 HTTP/1.1" status: 204 len: 168 time: 0.5171146 Dec 24 05:00:29.580204 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-792c52a3-8069-4bf8-837f-e46a04c44c4e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0b2d3d7d-61f2-4e8f-99eb-9bf7cd0e68b8,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:29.597481 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-83dd2618-ea3d-41cf-9eed-7b03771f0b74 service neutron] Attempting to bind port b0bd939a-1211-4ec1-b074-b2767d087f95 on host hv-cinder-81644 for vnic_type normal with profile {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:00:29.597829 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-83dd2618-ea3d-41cf-9eed-7b03771f0b74 service neutron] Attempting to bind port b0bd939a-1211-4ec1-b074-b2767d087f95 by drivers openvswitch,hyperv on host hv-cinder-81644 at level 0 using segments [{'id': '10307c97-e214-473b-b760-bb1b770153ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e'}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:00:29.598323 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-83dd2618-ea3d-41cf-9eed-7b03771f0b74 service neutron] Attempting to bind port b0bd939a-1211-4ec1-b074-b2767d087f95 on network b92a87f3-957a-4ccb-9b5b-98ad92aebe6e {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:00:29.604254 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-83dd2618-ea3d-41cf-9eed-7b03771f0b74 service neutron] Port b0bd939a-1211-4ec1-b074-b2767d087f95 on network b92a87f3-957a-4ccb-9b5b-98ad92aebe6e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81644 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 24 05:00:29.604613 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-83dd2618-ea3d-41cf-9eed-7b03771f0b74 service neutron] Attempting to bind port b0bd939a-1211-4ec1-b074-b2767d087f95 on network b92a87f3-957a-4ccb-9b5b-98ad92aebe6e {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:00:29.611062 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-83dd2618-ea3d-41cf-9eed-7b03771f0b74 service neutron] Checking agent: {'id': '7a2ffd19-371f-4f7b-a239-eea3b5cfd55b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81644', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'started_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 0, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:00:29.611551 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-83dd2618-ea3d-41cf-9eed-7b03771f0b74 service neutron] Checking segment: {'id': '10307c97-e214-473b-b760-bb1b770153ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:00:29.612044 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-83dd2618-ea3d-41cf-9eed-7b03771f0b74 service neutron] Bound using segment: {'id': '10307c97-e214-473b-b760-bb1b770153ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e'} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:00:29.612552 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-83dd2618-ea3d-41cf-9eed-7b03771f0b74 service neutron] Bound port: b0bd939a-1211-4ec1-b074-b2767d087f95, host: hv-cinder-81644, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '10307c97-e214-473b-b760-bb1b770153ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e'}}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:00:29.613088 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-83dd2618-ea3d-41cf-9eed-7b03771f0b74 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:29.686269 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-83dd2618-ea3d-41cf-9eed-7b03771f0b74 service neutron] For port b0bd939a-1211-4ec1-b074-b2767d087f95, host hv-cinder-81644, cleared binding levels {{(pid=102476) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:00:29.690165 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-83dd2618-ea3d-41cf-9eed-7b03771f0b74 service neutron] For port b0bd939a-1211-4ec1-b074-b2767d087f95, host hv-cinder-81644, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=b0bd939a-1211-4ec1-b074-b2767d087f95,segment=NetworkSegment(10307c97-e214-473b-b760-bb1b770153ec),segment_id=10307c97-e214-473b-b760-bb1b770153ec)] {{(pid=102476) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:00:29.695752 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-83dd2618-ea3d-41cf-9eed-7b03771f0b74 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:29.739479 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-83dd2618-ea3d-41cf-9eed-7b03771f0b74 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:29.740132 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-83dd2618-ea3d-41cf-9eed-7b03771f0b74 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:29.741520 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-83dd2618-ea3d-41cf-9eed-7b03771f0b74 service neutron] 10.222.0.46 "PUT /v2.0/ports/b0bd939a-1211-4ec1-b074-b2767d087f95 HTTP/1.1" status: 200 len: 1094 time: 1.0856080 Dec 24 05:00:29.741967 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cccacaaf-be31-4169-8a5b-13ea806dbd2c', 'tag': 'b0bd939a-1211-4ec1-b074-b2767d087f95'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:00:29.744218 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f786227c-8b6b-4de9-97d5-7bbaefaa8b0e" -d '{"events": [{"name": "network-changed", "server_uuid": "cccacaaf-be31-4169-8a5b-13ea806dbd2c", "tag": "b0bd939a-1211-4ec1-b074-b2767d087f95"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:00:29.763574 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83dd2618-ea3d-41cf-9eed-7b03771f0b74 service neutron] Pushing event updated for resources: {'Port': ['ID=b0bd939a-1211-4ec1-b074-b2767d087f95,revision_number=3']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:29.799779 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:00:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-144e42ad-dee5-477b-bdb7-dd635438ba70 x-openstack-request-id: req-144e42ad-dee5-477b-bdb7-dd635438ba70 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:00:29.800062 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cccacaaf-be31-4169-8a5b-13ea806dbd2c", "tag": "b0bd939a-1211-4ec1-b074-b2767d087f95", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:00:29.800359 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-144e42ad-dee5-477b-bdb7-dd635438ba70 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:00:29.800777 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cccacaaf-be31-4169-8a5b-13ea806dbd2c', 'tag': 'b0bd939a-1211-4ec1-b074-b2767d087f95', 'status': 'completed', 'code': 200} Dec 24 05:00:29.922021 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-1570e938-6ce1-403c-8167-db66814f66c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:29.923161 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-1570e938-6ce1-403c-8167-db66814f66c5 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=8f1c3a94f02049e3a76c4fc01fa7a022&device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 1097 time: 0.0410533 Dec 24 05:00:30.009004 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-deec74db-158f-481e-ace3-97978b8c8287 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=b0bd939a-1211-4ec1-b074-b2767d087f95 HTTP/1.1" status: 200 len: 217 time: 0.0417747 Dec 24 05:00:30.095181 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-6066f394-0fee-4354-ab81-f26e90adee85 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:30.096741 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-6066f394-0fee-4354-ab81-f26e90adee85 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=9b9ff65f-93c8-4cb1-8a99-961ba0d4beaa HTTP/1.1" status: 200 len: 855 time: 0.0757313 Dec 24 05:00:30.116646 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e55ef7c-3a44-4d2a-ac91-c17039743dcc req-29681997-0d5a-4425-9e18-0e857b9ef632 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:30.116646 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6e55ef7c-3a44-4d2a-ac91-c17039743dcc req-29681997-0d5a-4425-9e18-0e857b9ef632 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0681922 Dec 24 05:00:30.147174 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-8a8b217a-b743-45e3-9529-5494ce825ebc service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=b92a87f3-957a-4ccb-9b5b-98ad92aebe6e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0410903 Dec 24 05:00:30.204264 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fed3dbb3-aaa4-43f9-8e1e-c1ebcb012d63 req-29e387c0-87ca-4c13-b380-c9b4aa72c274 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:30.209289 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-fed3dbb3-aaa4-43f9-8e1e-c1ebcb012d63 req-29e387c0-87ca-4c13-b380-c9b4aa72c274 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 945 time: 0.0539343 Dec 24 05:00:30.236715 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6e55ef7c-3a44-4d2a-ac91-c17039743dcc req-5ae82730-7806-4928-bbdf-7a665d810928 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1117818 Dec 24 05:00:30.266491 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-8bc81c1e-a75b-4a3c-b0b2-c08b4f8c1647 service neutron] 10.222.0.46 "GET /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1083157 Dec 24 05:00:30.283030 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-fed3dbb3-aaa4-43f9-8e1e-c1ebcb012d63 req-91b1c601-c0d3-4e2f-af34-6c319b950563 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0710816 Dec 24 05:00:30.371135 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-828559b5-f1af-418e-8517-4d6fb1e5bbfd req-5bc82cf4-3cac-499d-bbaf-5010298dc433 service neutron] 10.222.0.46 "GET /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0908487 Dec 24 05:00:30.524519 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bcc1d8b-5325-421b-980d-1b58e87153a4 req-a1520829-d320-4a79-a671-8a6588d61e76 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:30.526048 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8bcc1d8b-5325-421b-980d-1b58e87153a4 req-a1520829-d320-4a79-a671-8a6588d61e76 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 944 time: 0.0485985 Dec 24 05:00:30.613659 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8bcc1d8b-5325-421b-980d-1b58e87153a4 req-cccb834d-1b9c-4ccd-856a-07ee429ffc56 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0797966 Dec 24 05:00:30.615334 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f786227c-8b6b-4de9-97d5-7bbaefaa8b0e req-13708679-2431-44f6-9650-102acb9f5365 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:30.616748 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f786227c-8b6b-4de9-97d5-7bbaefaa8b0e req-13708679-2431-44f6-9650-102acb9f5365 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=8f1c3a94f02049e3a76c4fc01fa7a022&device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 1097 time: 0.0818453 Dec 24 05:00:30.731692 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f786227c-8b6b-4de9-97d5-7bbaefaa8b0e req-468be93a-7089-4f61-b4af-a8e8688ca559 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:30.733655 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f786227c-8b6b-4de9-97d5-7bbaefaa8b0e req-468be93a-7089-4f61-b4af-a8e8688ca559 service neutron] 10.222.0.46 "GET /v2.0/networks?id=b92a87f3-957a-4ccb-9b5b-98ad92aebe6e HTTP/1.1" status: 200 len: 916 time: 0.1015630 Dec 24 05:00:30.782414 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f786227c-8b6b-4de9-97d5-7bbaefaa8b0e req-8a25dd97-3c07-4387-9c4c-4ad6482bee8a service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=b0bd939a-1211-4ec1-b074-b2767d087f95 HTTP/1.1" status: 200 len: 217 time: 0.0389144 Dec 24 05:00:30.837643 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f786227c-8b6b-4de9-97d5-7bbaefaa8b0e req-9d394c55-e466-4213-b2a1-1b282802d4b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:30.839093 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f786227c-8b6b-4de9-97d5-7bbaefaa8b0e req-9d394c55-e466-4213-b2a1-1b282802d4b8 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=9b9ff65f-93c8-4cb1-8a99-961ba0d4beaa HTTP/1.1" status: 200 len: 855 time: 0.0492611 Dec 24 05:00:30.879132 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f786227c-8b6b-4de9-97d5-7bbaefaa8b0e req-3436cf09-f3f2-4e27-816f-a0d7f92f4ad0 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=b92a87f3-957a-4ccb-9b5b-98ad92aebe6e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0259733 Dec 24 05:00:30.990118 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f786227c-8b6b-4de9-97d5-7bbaefaa8b0e req-854ea476-c52d-4734-ba47-d3054c8e0c9e service neutron] 10.222.0.46 "GET /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1015031 Dec 24 05:00:31.102229 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f786227c-8b6b-4de9-97d5-7bbaefaa8b0e req-ab84bf12-6a33-4eb9-948d-22200488a6be service neutron] 10.222.0.46 "GET /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1004984 Dec 24 05:00:31.323018 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 53674) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:31.383520 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-683e32df-d724-4ee6-8c43-f9fb7d007429 req-d9915512-b352-4bee-b285-88b4ef93b512 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:31.384712 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-683e32df-d724-4ee6-8c43-f9fb7d007429 req-d9915512-b352-4bee-b285-88b4ef93b512 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0554323 Dec 24 05:00:31.421067 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2267e46c-ab53-4b55-9e4b-dc8e0c95b157 req-3716e8a0-dbf7-49ac-965c-3e5eabd21c83 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:31.430056 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-2267e46c-ab53-4b55-9e4b-dc8e0c95b157 req-3716e8a0-dbf7-49ac-965c-3e5eabd21c83 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 945 time: 0.0661020 Dec 24 05:00:31.441630 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-683e32df-d724-4ee6-8c43-f9fb7d007429 req-d617747a-e061-4b9e-8335-e0682cf2d5fc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508165 Dec 24 05:00:31.461013 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-65f2fd22-0104-4f66-8ef9-f51969ba157d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:31.487843 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-2267e46c-ab53-4b55-9e4b-dc8e0c95b157 req-acb45717-c79e-401d-bc6d-97d4b8078209 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0564187 Dec 24 05:00:31.577205 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7545ce5f-76ad-4150-9a3d-ab1f5b64374a req-b7748816-f6c1-4088-a18b-3967f9219572 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:31.578852 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7545ce5f-76ad-4150-9a3d-ab1f5b64374a req-b7748816-f6c1-4088-a18b-3967f9219572 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.46 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 945 time: 0.0813446 Dec 24 05:00:31.589328 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-65f2fd22-0104-4f66-8ef9-f51969ba157d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:31.599461 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-65f2fd22-0104-4f66-8ef9-f51969ba157d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:31.668953 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65f2fd22-0104-4f66-8ef9-f51969ba157d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1d5d4f47-1077-4874-8da1-a1507fcafc3f,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:31.694283 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-65f2fd22-0104-4f66-8ef9-f51969ba157d admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=fa032ffc1c2b4d1eb7b79823490028d2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3701825 Dec 24 05:00:31.697063 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 53682) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:31.746161 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e57792f0-6511-44b2-82e9-b43244ba6f43 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:31.767315 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e57792f0-6511-44b2-82e9-b43244ba6f43 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:31.783369 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a679b569-9c45-4fb5-b499-2346b18029e9 req-5e437cb3-ffc4-4db1-8c98-6095ebca5aad tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:31.784861 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a679b569-9c45-4fb5-b499-2346b18029e9 req-5e437cb3-ffc4-4db1-8c98-6095ebca5aad tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 944 time: 0.0710237 Dec 24 05:00:31.810294 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-7545ce5f-76ad-4150-9a3d-ab1f5b64374a req-1bd9a1eb-ff0e-4fd2-9b96-170bed54d938 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Deleting port 95dbce62-23b4-409c-85a9-e1a32a7eb1bb {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:00:31.810733 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-7545ce5f-76ad-4150-9a3d-ab1f5b64374a req-1bd9a1eb-ff0e-4fd2-9b96-170bed54d938 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:31.814985 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e57792f0-6511-44b2-82e9-b43244ba6f43 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:31.817814 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e57792f0-6511-44b2-82e9-b43244ba6f43 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:31.821002 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-e57792f0-6511-44b2-82e9-b43244ba6f43 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/1d5d4f47-1077-4874-8da1-a1507fcafc3f HTTP/1.1" status: 204 len: 168 time: 0.1227086 Dec 24 05:00:31.829257 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e57792f0-6511-44b2-82e9-b43244ba6f43 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1d5d4f47-1077-4874-8da1-a1507fcafc3f,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:31.904382 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a679b569-9c45-4fb5-b499-2346b18029e9 req-6d2c5dc2-96de-4ccd-bc96-7dabe5ca9001 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1118848 Dec 24 05:00:31.941904 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-7545ce5f-76ad-4150-9a3d-ab1f5b64374a req-1bd9a1eb-ff0e-4fd2-9b96-170bed54d938 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] For port 95dbce62-23b4-409c-85a9-e1a32a7eb1bb, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=95dbce62-23b4-409c-85a9-e1a32a7eb1bb,segment=NetworkSegment(00999af0-b9ae-4a2b-9c30-590dbe00c43a),segment_id=00999af0-b9ae-4a2b-9c30-590dbe00c43a)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:00:31.942266 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-7545ce5f-76ad-4150-9a3d-ab1f5b64374a req-1bd9a1eb-ff0e-4fd2-9b96-170bed54d938 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:31.957355 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-7545ce5f-76ad-4150-9a3d-ab1f5b64374a req-1bd9a1eb-ff0e-4fd2-9b96-170bed54d938 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling delete_port for 95dbce62-23b4-409c-85a9-e1a32a7eb1bb owned by compute:nova {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:00:32.117134 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 53692) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:32.125825 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-7545ce5f-76ad-4150-9a3d-ab1f5b64374a req-1bd9a1eb-ff0e-4fd2-9b96-170bed54d938 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:32.165019 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a95295b5-22c0-4779-8a88-c546cfefea92 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:32.186281 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['95dbce62-23b4-409c-85a9-e1a32a7eb1bb'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:00:32.200456 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bd9a1eb-ff0e-4fd2-9b96-170bed54d938 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Pushing event deleted for resources: {'Port': ['ID=95dbce62-23b4-409c-85a9-e1a32a7eb1bb,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:32.245025 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-7545ce5f-76ad-4150-9a3d-ab1f5b64374a req-1bd9a1eb-ff0e-4fd2-9b96-170bed54d938 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] No DVR routers for this DVR port 95dbce62-23b4-409c-85a9-e1a32a7eb1bb on host hv-cinder-81644 {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:00:32.248671 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-7545ce5f-76ad-4150-9a3d-ab1f5b64374a req-1bd9a1eb-ff0e-4fd2-9b96-170bed54d938 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:32.252337 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7545ce5f-76ad-4150-9a3d-ab1f5b64374a req-1bd9a1eb-ff0e-4fd2-9b96-170bed54d938 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.46 "DELETE /v2.0/ports/95dbce62-23b4-409c-85a9-e1a32a7eb1bb HTTP/1.1" status: 204 len: 173 time: 0.6653066 Dec 24 05:00:32.255953 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1f2eb78b-9eeb-4011-b480-333a74a448a7', 'name': 'network-vif-deleted', 'tag': '95dbce62-23b4-409c-85a9-e1a32a7eb1bb'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:00:32.258578 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-77dc92a6-91cd-440b-b127-5d4bda52ffdc" -d '{"events": [{"server_uuid": "1f2eb78b-9eeb-4011-b480-333a74a448a7", "name": "network-vif-deleted", "tag": "95dbce62-23b4-409c-85a9-e1a32a7eb1bb"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:00:32.297693 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:00:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9b9eb9b4-0aa5-452f-a0e0-7e9622262bd3 x-openstack-request-id: req-9b9eb9b4-0aa5-452f-a0e0-7e9622262bd3 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:00:32.297980 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1f2eb78b-9eeb-4011-b480-333a74a448a7", "name": "network-vif-deleted", "tag": "95dbce62-23b4-409c-85a9-e1a32a7eb1bb", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:00:32.298214 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-9b9eb9b4-0aa5-452f-a0e0-7e9622262bd3 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:00:32.298617 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1f2eb78b-9eeb-4011-b480-333a74a448a7', 'name': 'network-vif-deleted', 'tag': '95dbce62-23b4-409c-85a9-e1a32a7eb1bb', 'status': 'completed', 'code': 200} Dec 24 05:00:32.326328 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a95295b5-22c0-4779-8a88-c546cfefea92 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:32.330795 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a95295b5-22c0-4779-8a88-c546cfefea92 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:32.372344 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-a95295b5-22c0-4779-8a88-c546cfefea92 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=bc922bd3163241709335f896e0fbb543&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2539332 Dec 24 05:00:32.373233 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a95295b5-22c0-4779-8a88-c546cfefea92 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=54ebcc0c-c3d8-4f53-b0a2-986b7617c63f,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:32.375314 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 53698) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:32.430285 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ffb6e23f-55ca-4e8f-95de-9d1ade0ab49c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:32.453653 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ffb6e23f-55ca-4e8f-95de-9d1ade0ab49c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:32.514202 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ffb6e23f-55ca-4e8f-95de-9d1ade0ab49c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:32.518091 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ffb6e23f-55ca-4e8f-95de-9d1ade0ab49c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:32.521063 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-ffb6e23f-55ca-4e8f-95de-9d1ade0ab49c admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/54ebcc0c-c3d8-4f53-b0a2-986b7617c63f HTTP/1.1" status: 204 len: 168 time: 0.1444676 Dec 24 05:00:32.542744 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffb6e23f-55ca-4e8f-95de-9d1ade0ab49c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=54ebcc0c-c3d8-4f53-b0a2-986b7617c63f,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:32.599148 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23952dc0-8540-4444-a30d-b6c5003df463 req-74e58263-458e-4d6e-9444-8a162c3eec7a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:32.600713 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-23952dc0-8540-4444-a30d-b6c5003df463 req-74e58263-458e-4d6e-9444-8a162c3eec7a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0785346 Dec 24 05:00:32.605127 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bc92ebc1-02c1-4e80-b103-0c377013c868 req-681cc1f9-cd9c-45e5-ab17-03516f392ec0 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=1f2eb78b-9eeb-4011-b480-333a74a448a7 HTTP/1.1" status: 200 len: 210 time: 0.0265374 Dec 24 05:00:32.657113 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-23952dc0-8540-4444-a30d-b6c5003df463 req-370bb7e8-9079-4ea2-9429-1b44ecc243e4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496314 Dec 24 05:00:33.053632 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-919da9d9-c5db-4dba-9c9e-e05868c52012 req-f4b89da5-91cf-49ce-867f-3155a29c95f3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:33.055103 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-919da9d9-c5db-4dba-9c9e-e05868c52012 req-f4b89da5-91cf-49ce-867f-3155a29c95f3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 944 time: 0.0652254 Dec 24 05:00:33.102612 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-919da9d9-c5db-4dba-9c9e-e05868c52012 req-4d9ebd8e-a29e-4667-9559-16b924d69dc0 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412123 Dec 24 05:00:33.780361 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716660e7-9ec5-4a69-bb5c-2af9ac3303e6 req-de8e974f-2e42-4de3-b99f-10498fb2b505 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:33.781893 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-716660e7-9ec5-4a69-bb5c-2af9ac3303e6 req-de8e974f-2e42-4de3-b99f-10498fb2b505 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0521884 Dec 24 05:00:33.836370 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-716660e7-9ec5-4a69-bb5c-2af9ac3303e6 req-1bfd908c-0725-4b47-92e7-19d67329d9b2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0487139 Dec 24 05:00:33.934927 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2526d385-dd29-4370-94e5-20f9469bf933 req-6bcc4789-f34f-445b-b2c3-8b7f2cee3705 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:33.937151 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2526d385-dd29-4370-94e5-20f9469bf933 req-6bcc4789-f34f-445b-b2c3-8b7f2cee3705 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/networks?id=c2c27570-f2cd-4dac-9473-e82a4e432501 HTTP/1.1" status: 200 len: 809 time: 0.1051130 Dec 24 05:00:33.953173 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2526d385-dd29-4370-94e5-20f9469bf933 req-f2166aa1-937b-4396-840c-fc48027c4ba2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/quotas/1e014b3683d841968563e0aa0705e862 HTTP/1.1" status: 200 len: 375 time: 0.0100827 Dec 24 05:00:33.993656 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2526d385-dd29-4370-94e5-20f9469bf933 req-87bd5af5-0626-4059-902e-c3927dc76026 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=1e014b3683d841968563e0aa0705e862&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0258775 Dec 24 05:00:34.088319 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2526d385-dd29-4370-94e5-20f9469bf933 req-d597338d-5f2e-47de-b703-d07344ab0fa4 service neutron] 10.222.0.43 "GET /v2.0/networks/c2c27570-f2cd-4dac-9473-e82a4e432501?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0870402 Dec 24 05:00:34.193984 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device b0bd939a-1211-4ec1-b074-b2767d087f95 details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 05:00:34.201544 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2526d385-dd29-4370-94e5-20f9469bf933 req-d7d11d0f-455e-415f-bf68-a3bf3bae4159 service neutron] 10.222.0.43 "GET /v2.0/networks/c2c27570-f2cd-4dac-9473-e82a4e432501?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1062934 Dec 24 05:00:34.246108 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07557151-aea1-4a36-9a00-a6329ccb8561 req-637fcfa9-7d05-437d-be40-74725290b8cb tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:34.247833 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-07557151-aea1-4a36-9a00-a6329ccb8561 req-637fcfa9-7d05-437d-be40-74725290b8cb tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 944 time: 0.0684707 Dec 24 05:00:34.304830 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 95dbce62-23b4-409c-85a9-e1a32a7eb1bb no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:00:34.348025 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-07557151-aea1-4a36-9a00-a6329ccb8561 req-ea107fa7-b727-4870-a94d-1cb7f3ebdf7d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0930207 Dec 24 05:00:34.366231 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] No Port match for: 95dbce62-23b4-409c-85a9-e1a32a7eb1bb {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:00:34.366512 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 95dbce62-23b4-409c-85a9-e1a32a7eb1bb not bound to the agent host hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:00:34.372442 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port b0bd939a-1211-4ec1-b074-b2767d087f95, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=b0bd939a-1211-4ec1-b074-b2767d087f95,segment=NetworkSegment(10307c97-e214-473b-b760-bb1b770153ec),segment_id=10307c97-e214-473b-b760-bb1b770153ec)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:00:34.386603 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': 'b0bd939a-1211-4ec1-b074-b2767d087f95', 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e', 'port_id': 'b0bd939a-1211-4ec1-b074-b2767d087f95', 'mac_address': 'fa:16:3e:36:b1:a7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9b9ff65f-93c8-4cb1-8a99-961ba0d4beaa', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 05:00:34.403481 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2966df46-2ecf-4b10-9d94-b0f2027dcb1e req-52902442-4cad-42cc-ac9d-31f674ab6cf3 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 210 time: 0.0308628 Dec 24 05:00:34.438160 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:34.456163 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b0bd939a-1211-4ec1-b074-b2767d087f95 {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:00:34.476904 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port b0bd939a-1211-4ec1-b074-b2767d087f95, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=b0bd939a-1211-4ec1-b074-b2767d087f95,segment=NetworkSegment(10307c97-e214-473b-b760-bb1b770153ec),segment_id=10307c97-e214-473b-b760-bb1b770153ec)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:00:34.482379 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:34.534464 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=b0bd939a-1211-4ec1-b074-b2767d087f95,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:34.702115 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 53828) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:34.812154 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7ecb6bea-6c21-47c5-a17b-4f08cd38aa54 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:34.885847 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7ecb6bea-6c21-47c5-a17b-4f08cd38aa54 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:34.890473 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7ecb6bea-6c21-47c5-a17b-4f08cd38aa54 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:34.927728 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-7ecb6bea-6c21-47c5-a17b-4f08cd38aa54 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=14841836c56f4877a96f89e317f3dd81&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2242684 Dec 24 05:00:34.928895 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ecb6bea-6c21-47c5-a17b-4f08cd38aa54 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f4a3e904-236b-47c2-b14f-b7c176c521d9,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:34.930914 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 53834) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:34.988128 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-206678eb-6fbf-41b7-8495-71018a7d9439 req-e89f70b9-49af-4b3d-8f4f-9929a926a748 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:34.989589 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-206678eb-6fbf-41b7-8495-71018a7d9439 req-e89f70b9-49af-4b3d-8f4f-9929a926a748 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0831642 Dec 24 05:00:35.014890 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-aaf74b66-742c-4c62-8f78-18e5e3894d5d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:35.047544 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-aaf74b66-742c-4c62-8f78-18e5e3894d5d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:35.066003 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-206678eb-6fbf-41b7-8495-71018a7d9439 req-9790c15d-e611-4c64-8637-22b900941647 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0702226 Dec 24 05:00:35.104037 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-aaf74b66-742c-4c62-8f78-18e5e3894d5d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:35.106863 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-aaf74b66-742c-4c62-8f78-18e5e3894d5d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:35.108007 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-aaf74b66-742c-4c62-8f78-18e5e3894d5d admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/f4a3e904-236b-47c2-b14f-b7c176c521d9 HTTP/1.1" status: 204 len: 168 time: 0.1701045 Dec 24 05:00:35.116191 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaf74b66-742c-4c62-8f78-18e5e3894d5d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f4a3e904-236b-47c2-b14f-b7c176c521d9,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:35.434166 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 53852) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:35.450470 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2d839028-f31d-4388-bdb1-782f18577d9d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:35.484347 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f5d0af7-a3a6-468e-83c5-420623d1e391 req-74caa01b-cfdd-4062-bdfb-b61e1633bd1a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:35.490383 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1f5d0af7-a3a6-468e-83c5-420623d1e391 req-74caa01b-cfdd-4062-bdfb-b61e1633bd1a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 945 time: 0.0888865 Dec 24 05:00:35.528198 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2d839028-f31d-4388-bdb1-782f18577d9d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:35.537607 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2d839028-f31d-4388-bdb1-782f18577d9d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:35.568851 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1f5d0af7-a3a6-468e-83c5-420623d1e391 req-4ed88f10-47a1-41f6-8e97-d6b315cadf61 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0684726 Dec 24 05:00:35.570804 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d839028-f31d-4388-bdb1-782f18577d9d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=458b5508-d372-4f67-9455-b6fafb074cf7,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:35.590942 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-2d839028-f31d-4388-bdb1-782f18577d9d admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=08995413c7934c8ba2d98914246a1bf9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1556802 Dec 24 05:00:35.593768 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 53860) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:35.670885 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9acd05bd-5f35-452b-b635-5e12c1c74c6e req-3befc465-5215-4090-af41-81beaf613ffe tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 210 time: 0.0352163 Dec 24 05:00:35.691917 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-634062b0-41d5-4c65-8378-62056cfc782f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:35.714911 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-634062b0-41d5-4c65-8378-62056cfc782f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:35.761380 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-634062b0-41d5-4c65-8378-62056cfc782f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:35.764026 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-634062b0-41d5-4c65-8378-62056cfc782f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:35.765562 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-634062b0-41d5-4c65-8378-62056cfc782f admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/458b5508-d372-4f67-9455-b6fafb074cf7 HTTP/1.1" status: 204 len: 168 time: 0.1704280 Dec 24 05:00:35.774297 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-634062b0-41d5-4c65-8378-62056cfc782f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=458b5508-d372-4f67-9455-b6fafb074cf7,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:35.916445 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce7df296-34ae-403e-9803-6fa80e4657ea req-79e2bced-4201-4186-9555-53a9e525388a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:35.917959 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ce7df296-34ae-403e-9803-6fa80e4657ea req-79e2bced-4201-4186-9555-53a9e525388a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 945 time: 0.0492020 Dec 24 05:00:35.966885 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ce7df296-34ae-403e-9803-6fa80e4657ea req-ace7bc92-f31f-41fb-b8ed-c82779dd5ef5 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427926 Dec 24 05:00:36.333952 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea7b1992-f81f-4da6-a8ad-99884d53938a req-c2206675-ceb4-4e57-9758-cb0621d65c9d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:36.335818 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ea7b1992-f81f-4da6-a8ad-99884d53938a req-c2206675-ceb4-4e57-9758-cb0621d65c9d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0631983 Dec 24 05:00:36.384239 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ea7b1992-f81f-4da6-a8ad-99884d53938a req-fb3a847f-2af7-4250-ae15-d03da8ca16a5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424399 Dec 24 05:00:36.682535 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-484e9ea9-4cdc-4f93-9218-d557b413725d req-ef764275-9689-4b82-a800-69102505ee27 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:36.684047 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-484e9ea9-4cdc-4f93-9218-d557b413725d req-ef764275-9689-4b82-a800-69102505ee27 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 945 time: 0.0489042 Dec 24 05:00:36.736997 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-484e9ea9-4cdc-4f93-9218-d557b413725d req-54ef8b8c-7d8c-487e-85ff-62f63e993ee1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468900 Dec 24 05:00:36.830089 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-697c24e5-2bdd-49fb-9947-af5efca079af req-f9e27392-24e5-4285-86eb-f1f0980e2a69 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 210 time: 0.0263908 Dec 24 05:00:37.084153 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f33ceb7f-5534-4f9c-b363-8d06f4d0260e req-f652469d-01e3-4217-81c0-837e66463662 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:37.086315 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f33ceb7f-5534-4f9c-b363-8d06f4d0260e req-f652469d-01e3-4217-81c0-837e66463662 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 945 time: 0.0515823 Dec 24 05:00:37.133650 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f33ceb7f-5534-4f9c-b363-8d06f4d0260e req-33c0d4df-ad7e-4752-866c-991d0682085b tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414076 Dec 24 05:00:37.505806 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71acb8ff-cc63-46d7-ae40-eac7481e88e7 req-316e7337-af70-418d-a852-a24eb3f90b7c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:37.507430 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-71acb8ff-cc63-46d7-ae40-eac7481e88e7 req-316e7337-af70-418d-a852-a24eb3f90b7c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0526898 Dec 24 05:00:37.560699 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-71acb8ff-cc63-46d7-ae40-eac7481e88e7 req-9655cbd3-7bb5-4e96-a190-3b3194592cc5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469797 Dec 24 05:00:37.853622 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82431e2e-5a24-4568-82c2-ff21fdff6944 req-76092b5b-0752-44e3-b417-7c4911e45f7c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:37.855290 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-82431e2e-5a24-4568-82c2-ff21fdff6944 req-76092b5b-0752-44e3-b417-7c4911e45f7c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 945 time: 0.0508704 Dec 24 05:00:37.910344 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-82431e2e-5a24-4568-82c2-ff21fdff6944 req-9b950f54-5f7f-493b-906a-df03d4d47bd0 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470715 Dec 24 05:00:37.994989 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ceb1ea4e-1257-44c9-bb0f-501f9efbd644 req-0ae3777b-3098-47c0-ac90-a42c14e4ad6f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 210 time: 0.0315688 Dec 24 05:00:38.262038 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fbd855e-bdc2-4f5a-9858-84dc34f4a364 req-60596a2a-db30-47c9-bc4f-54bbf48cf901 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:38.263488 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8fbd855e-bdc2-4f5a-9858-84dc34f4a364 req-60596a2a-db30-47c9-bc4f-54bbf48cf901 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 945 time: 0.0510390 Dec 24 05:00:38.314028 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8fbd855e-bdc2-4f5a-9858-84dc34f4a364 req-846ea1c4-1e11-4772-bab9-8a0c3fbaffc8 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417862 Dec 24 05:00:38.686098 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42b918a9-39eb-476d-a637-25cda33a9fa3 req-0744aa8d-344c-4f7c-902a-9175ab427e34 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:38.687898 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-42b918a9-39eb-476d-a637-25cda33a9fa3 req-0744aa8d-344c-4f7c-902a-9175ab427e34 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0485001 Dec 24 05:00:38.742748 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-42b918a9-39eb-476d-a637-25cda33a9fa3 req-97c8c76d-b269-41af-aaa2-e345171e2ac5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475752 Dec 24 05:00:39.034931 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75fee885-6051-420f-8f69-3c42e1bed839 req-f701f9ce-9caa-415e-abac-01263a02eb08 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:39.036492 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-75fee885-6051-420f-8f69-3c42e1bed839 req-f701f9ce-9caa-415e-abac-01263a02eb08 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 945 time: 0.0571480 Dec 24 05:00:39.092421 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-75fee885-6051-420f-8f69-3c42e1bed839 req-a56460ba-b9c7-4492-bd44-2e51112d130f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500052 Dec 24 05:00:39.119553 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2ed79332-181c-43e1-a888-00329706b245 req-0c4dd3ac-a7af-45fb-9543-bc41911c213a tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 210 time: 0.0454044 Dec 24 05:00:39.325959 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['b0bd939a-1211-4ec1-b074-b2767d087f95'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:00:39.432648 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c756095f-23c9-4928-98e7-ce7500054ea3 req-afacf9ac-3275-4bab-8ec5-eab10106e21e tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:39.434042 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c756095f-23c9-4928-98e7-ce7500054ea3 req-afacf9ac-3275-4bab-8ec5-eab10106e21e tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 945 time: 0.0521574 Dec 24 05:00:39.481738 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c756095f-23c9-4928-98e7-ce7500054ea3 req-822efb41-f6fb-4915-b89d-d53f0374f902 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417068 Dec 24 05:00:39.790270 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2526d385-dd29-4370-94e5-20f9469bf933 req-91382a6e-0be3-4e25-84bd-13e323fb3984 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:39.792628 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2526d385-dd29-4370-94e5-20f9469bf933 req-91382a6e-0be3-4e25-84bd-13e323fb3984 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.46 "GET /v2.0/networks?id=c2c27570-f2cd-4dac-9473-e82a4e432501 HTTP/1.1" status: 200 len: 809 time: 0.1164851 Dec 24 05:00:39.863771 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-2526d385-dd29-4370-94e5-20f9469bf933 req-cd704840-ff47-462b-ac72-0ab2c84bb939 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Request body: {'port': {'device_id': 'df4a8b5b-4054-465a-81a5-1e3cd5b5997b', 'network_id': 'c2c27570-f2cd-4dac-9473-e82a4e432501', 'admin_state_up': True, 'tenant_id': '1e014b3683d841968563e0aa0705e862'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:00:39.876696 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a4d5427-7e68-4728-8513-2873af94b266 req-ae6d8fc9-6c2e-4630-9150-2c1a7040a020 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:39.878238 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3a4d5427-7e68-4728-8513-2873af94b266 req-ae6d8fc9-6c2e-4630-9150-2c1a7040a020 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0526404 Dec 24 05:00:39.926849 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3a4d5427-7e68-4728-8513-2873af94b266 req-28beb172-7f54-4358-bc63-48374aade1ef tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419588 Dec 24 05:00:39.982406 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2526d385-dd29-4370-94e5-20f9469bf933 req-cd704840-ff47-462b-ac72-0ab2c84bb939 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Made reservation on behalf of 1e014b3683d841968563e0aa0705e862 for: {'port': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:00:39.986678 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-2526d385-dd29-4370-94e5-20f9469bf933 req-cd704840-ff47-462b-ac72-0ab2c84bb939 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:40.122601 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [req-2526d385-dd29-4370-94e5-20f9469bf933 req-cd704840-ff47-462b-ac72-0ab2c84bb939 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Allocated IP 172.20.0.13 (c2c27570-f2cd-4dac-9473-e82a4e432501/b6657dc9-704f-488f-a929-3d0573a04d1f/639654f0-9663-4da1-8410-7e554500497a) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:00:40.229606 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45c08a34-fb37-462a-8e2d-7fca011ea894 req-de651ca4-2978-46a1-8616-ee3b588cb039 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:40.232328 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-45c08a34-fb37-462a-8e2d-7fca011ea894 req-de651ca4-2978-46a1-8616-ee3b588cb039 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 945 time: 0.0516706 Dec 24 05:00:40.243395 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-07507a47-7496-4807-81a7-a6cce5718afb req-1aba964d-a7e9-4542-bf2c-822c7ee6ec3e tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 210 time: 0.0451951 Dec 24 05:00:40.290880 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-45c08a34-fb37-462a-8e2d-7fca011ea894 req-d00be7da-daf5-4218-aff6-5b0f5cbddf0e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0533750 Dec 24 05:00:40.332182 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-2526d385-dd29-4370-94e5-20f9469bf933 req-cd704840-ff47-462b-ac72-0ab2c84bb939 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:40.364435 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-2526d385-dd29-4370-94e5-20f9469bf933 req-cd704840-ff47-462b-ac72-0ab2c84bb939 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:40.408408 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2526d385-dd29-4370-94e5-20f9469bf933 req-cd704840-ff47-462b-ac72-0ab2c84bb939 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Network c2c27570-f2cd-4dac-9473-e82a4e432501 is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:00:40.411673 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [req-2526d385-dd29-4370-94e5-20f9469bf933 req-cd704840-ff47-462b-ac72-0ab2c84bb939 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:00:40.415357 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-2526d385-dd29-4370-94e5-20f9469bf933 req-cd704840-ff47-462b-ac72-0ab2c84bb939 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:00:40.440824 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd704840-ff47-462b-ac72-0ab2c84bb939 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Pushing event updated for resources: {'Port': ['ID=639654f0-9663-4da1-8410-7e554500497a,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:40.466240 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2526d385-dd29-4370-94e5-20f9469bf933 req-cd704840-ff47-462b-ac72-0ab2c84bb939 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:40.466782 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-2526d385-dd29-4370-94e5-20f9469bf933 req-cd704840-ff47-462b-ac72-0ab2c84bb939 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:40.484636 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2526d385-dd29-4370-94e5-20f9469bf933 req-cd704840-ff47-462b-ac72-0ab2c84bb939 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.46 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6274376 Dec 24 05:00:40.506729 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-2526d385-dd29-4370-94e5-20f9469bf933 req-45e19b0c-e3f2-4ad2-81ca-33306780f66c service neutron] Request body: {'port': {'device_id': 'df4a8b5b-4054-465a-81a5-1e3cd5b5997b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81644'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:00:40.588303 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-2526d385-dd29-4370-94e5-20f9469bf933 req-45e19b0c-e3f2-4ad2-81ca-33306780f66c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:40.641485 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6dba0d5-dbd8-4e40-9dde-49895761d340 req-70fa658d-2f89-457b-a0e9-0f61b296210a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:40.642464 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f6dba0d5-dbd8-4e40-9dde-49895761d340 req-70fa658d-2f89-457b-a0e9-0f61b296210a tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 945 time: 0.0853517 Dec 24 05:00:40.769183 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f6dba0d5-dbd8-4e40-9dde-49895761d340 req-d85f9022-cdf5-41ee-bbed-6e8db41335cb tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1203580 Dec 24 05:00:40.909790 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [req-2526d385-dd29-4370-94e5-20f9469bf933 req-45e19b0c-e3f2-4ad2-81ca-33306780f66c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 639654f0-9663-4da1-8410-7e554500497a {{(pid=102476) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:00:40.917345 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-2526d385-dd29-4370-94e5-20f9469bf933 req-45e19b0c-e3f2-4ad2-81ca-33306780f66c service neutron] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:40.929782 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.provisioning_blocks [req-2526d385-dd29-4370-94e5-20f9469bf933 req-45e19b0c-e3f2-4ad2-81ca-33306780f66c service neutron] Transition to ACTIVE for port object 639654f0-9663-4da1-8410-7e554500497a will not be triggered until provisioned by entity L2. {{(pid=102476) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 24 05:00:40.934404 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-2526d385-dd29-4370-94e5-20f9469bf933 req-45e19b0c-e3f2-4ad2-81ca-33306780f66c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:40.988477 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45e19b0c-e3f2-4ad2-81ca-33306780f66c service neutron] Pushing event updated for resources: {'Port': ['ID=639654f0-9663-4da1-8410-7e554500497a,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:41.066441 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-2526d385-dd29-4370-94e5-20f9469bf933 req-45e19b0c-e3f2-4ad2-81ca-33306780f66c service neutron] Attempting to bind port 639654f0-9663-4da1-8410-7e554500497a on host hv-cinder-81644 for vnic_type normal with profile {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:00:41.066786 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-2526d385-dd29-4370-94e5-20f9469bf933 req-45e19b0c-e3f2-4ad2-81ca-33306780f66c service neutron] Attempting to bind port 639654f0-9663-4da1-8410-7e554500497a by drivers openvswitch,hyperv on host hv-cinder-81644 at level 0 using segments [{'id': '00999af0-b9ae-4a2b-9c30-590dbe00c43a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'c2c27570-f2cd-4dac-9473-e82a4e432501'}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:00:41.067225 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2526d385-dd29-4370-94e5-20f9469bf933 req-45e19b0c-e3f2-4ad2-81ca-33306780f66c service neutron] Attempting to bind port 639654f0-9663-4da1-8410-7e554500497a on network c2c27570-f2cd-4dac-9473-e82a4e432501 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:00:41.075637 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2526d385-dd29-4370-94e5-20f9469bf933 req-45e19b0c-e3f2-4ad2-81ca-33306780f66c service neutron] Port 639654f0-9663-4da1-8410-7e554500497a on network c2c27570-f2cd-4dac-9473-e82a4e432501 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81644 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 24 05:00:41.076263 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2526d385-dd29-4370-94e5-20f9469bf933 req-45e19b0c-e3f2-4ad2-81ca-33306780f66c service neutron] Attempting to bind port 639654f0-9663-4da1-8410-7e554500497a on network c2c27570-f2cd-4dac-9473-e82a4e432501 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:00:41.081737 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2526d385-dd29-4370-94e5-20f9469bf933 req-45e19b0c-e3f2-4ad2-81ca-33306780f66c service neutron] Checking agent: {'id': '7a2ffd19-371f-4f7b-a239-eea3b5cfd55b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81644', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'started_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 0, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:00:41.082484 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2526d385-dd29-4370-94e5-20f9469bf933 req-45e19b0c-e3f2-4ad2-81ca-33306780f66c service neutron] Checking segment: {'id': '00999af0-b9ae-4a2b-9c30-590dbe00c43a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'c2c27570-f2cd-4dac-9473-e82a4e432501'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:00:41.083036 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2526d385-dd29-4370-94e5-20f9469bf933 req-45e19b0c-e3f2-4ad2-81ca-33306780f66c service neutron] Bound using segment: {'id': '00999af0-b9ae-4a2b-9c30-590dbe00c43a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'c2c27570-f2cd-4dac-9473-e82a4e432501'} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:00:41.083493 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-2526d385-dd29-4370-94e5-20f9469bf933 req-45e19b0c-e3f2-4ad2-81ca-33306780f66c service neutron] Bound port: 639654f0-9663-4da1-8410-7e554500497a, host: hv-cinder-81644, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '00999af0-b9ae-4a2b-9c30-590dbe00c43a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': 'c2c27570-f2cd-4dac-9473-e82a4e432501'}}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:00:41.083815 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-2526d385-dd29-4370-94e5-20f9469bf933 req-45e19b0c-e3f2-4ad2-81ca-33306780f66c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:41.104179 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d1a54ab-49ed-4668-89e3-2ddadd6dd702 req-c40d61e7-602f-40d5-9b40-a42427888edf tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:41.105781 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5d1a54ab-49ed-4668-89e3-2ddadd6dd702 req-c40d61e7-602f-40d5-9b40-a42427888edf tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0844097 Dec 24 05:00:41.155593 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5d1a54ab-49ed-4668-89e3-2ddadd6dd702 req-fe9dc9b4-c5fb-4e6b-b3c8-3e8bb9e27003 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429256 Dec 24 05:00:41.164737 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-2526d385-dd29-4370-94e5-20f9469bf933 req-45e19b0c-e3f2-4ad2-81ca-33306780f66c service neutron] For port 639654f0-9663-4da1-8410-7e554500497a, host hv-cinder-81644, cleared binding levels {{(pid=102476) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:00:41.175464 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-2526d385-dd29-4370-94e5-20f9469bf933 req-45e19b0c-e3f2-4ad2-81ca-33306780f66c service neutron] For port 639654f0-9663-4da1-8410-7e554500497a, host hv-cinder-81644, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=639654f0-9663-4da1-8410-7e554500497a,segment=NetworkSegment(00999af0-b9ae-4a2b-9c30-590dbe00c43a),segment_id=00999af0-b9ae-4a2b-9c30-590dbe00c43a)] {{(pid=102476) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:00:41.175464 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-2526d385-dd29-4370-94e5-20f9469bf933 req-45e19b0c-e3f2-4ad2-81ca-33306780f66c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:41.191807 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2526d385-dd29-4370-94e5-20f9469bf933 req-45e19b0c-e3f2-4ad2-81ca-33306780f66c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:41.192444 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-2526d385-dd29-4370-94e5-20f9469bf933 req-45e19b0c-e3f2-4ad2-81ca-33306780f66c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:41.194252 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2526d385-dd29-4370-94e5-20f9469bf933 req-45e19b0c-e3f2-4ad2-81ca-33306780f66c service neutron] 10.222.0.46 "PUT /v2.0/ports/639654f0-9663-4da1-8410-7e554500497a HTTP/1.1" status: 200 len: 1094 time: 0.6918046 Dec 24 05:00:41.207018 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 54038) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:41.211225 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'df4a8b5b-4054-465a-81a5-1e3cd5b5997b', 'tag': '639654f0-9663-4da1-8410-7e554500497a'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:00:41.214001 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-270faf28-2b4e-417c-a36b-0d54b0a9412a" -d '{"events": [{"name": "network-changed", "server_uuid": "df4a8b5b-4054-465a-81a5-1e3cd5b5997b", "tag": "639654f0-9663-4da1-8410-7e554500497a"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:00:41.251196 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45e19b0c-e3f2-4ad2-81ca-33306780f66c service neutron] Pushing event updated for resources: {'Port': ['ID=639654f0-9663-4da1-8410-7e554500497a,revision_number=3']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:41.255813 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:00:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-75e0b2d6-77fa-40ab-9319-a32ad24fdd7c x-openstack-request-id: req-75e0b2d6-77fa-40ab-9319-a32ad24fdd7c {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:00:41.256104 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "df4a8b5b-4054-465a-81a5-1e3cd5b5997b", "tag": "639654f0-9663-4da1-8410-7e554500497a", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:00:41.256360 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-75e0b2d6-77fa-40ab-9319-a32ad24fdd7c {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:00:41.256768 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'df4a8b5b-4054-465a-81a5-1e3cd5b5997b', 'tag': '639654f0-9663-4da1-8410-7e554500497a', 'status': 'completed', 'code': 200} Dec 24 05:00:41.340152 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a06fd56f-9a57-4a10-b188-0ddc0fa2b83d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:41.344678 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2526d385-dd29-4370-94e5-20f9469bf933 req-9b8c00a2-be83-4b4b-8429-d27c89e8df94 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:41.346254 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2526d385-dd29-4370-94e5-20f9469bf933 req-9b8c00a2-be83-4b4b-8429-d27c89e8df94 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=1e014b3683d841968563e0aa0705e862&device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 1097 time: 0.0430121 Dec 24 05:00:41.375945 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b778c014-264c-434e-8530-309914609e51 req-337e1a83-0ecd-4491-8443-ace0d7e7abc5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:41.377429 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b778c014-264c-434e-8530-309914609e51 req-337e1a83-0ecd-4491-8443-ace0d7e7abc5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 944 time: 0.0672357 Dec 24 05:00:41.412151 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:00:41.456288 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b778c014-264c-434e-8530-309914609e51 req-242c9b88-98e1-4875-b215-72f77b842a55 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0680041 Dec 24 05:00:41.480731 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a06fd56f-9a57-4a10-b188-0ddc0fa2b83d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:41.486528 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a06fd56f-9a57-4a10-b188-0ddc0fa2b83d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:41.527463 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-a06fd56f-9a57-4a10-b188-0ddc0fa2b83d admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=7d2eec5f9bc8467da13c92d8b94c95da&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3191121 Dec 24 05:00:41.528028 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a06fd56f-9a57-4a10-b188-0ddc0fa2b83d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2f5383ee-3c0e-471e-93ee-19df690c4beb,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:41.531639 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 54048) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:41.591078 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-6d74a643-b602-4fff-a8e2-04ff6dc4126f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:41.614157 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-6d74a643-b602-4fff-a8e2-04ff6dc4126f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:41.662271 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-6d74a643-b602-4fff-a8e2-04ff6dc4126f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:41.665051 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-6d74a643-b602-4fff-a8e2-04ff6dc4126f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:41.665220 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2526d385-dd29-4370-94e5-20f9469bf933 req-9c39502d-1b34-498f-86fe-58b924e27f8c service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=639654f0-9663-4da1-8410-7e554500497a HTTP/1.1" status: 200 len: 217 time: 0.2888656 Dec 24 05:00:41.667038 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-6d74a643-b602-4fff-a8e2-04ff6dc4126f admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/2f5383ee-3c0e-471e-93ee-19df690c4beb HTTP/1.1" status: 204 len: 168 time: 0.1344950 Dec 24 05:00:41.676141 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d74a643-b602-4fff-a8e2-04ff6dc4126f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f5383ee-3c0e-471e-93ee-19df690c4beb,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:41.709215 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a8379a0-e503-40d2-ac6d-bade4b3ec2fe req-66a6a5af-0f2e-4d41-8a36-ebff168b0469 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:41.711150 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2a8379a0-e503-40d2-ac6d-bade4b3ec2fe req-66a6a5af-0f2e-4d41-8a36-ebff168b0469 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 945 time: 0.3438835 Dec 24 05:00:41.745818 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2526d385-dd29-4370-94e5-20f9469bf933 req-0eecdda8-bb7d-45e5-8c60-b8c76ba3035b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:41.747247 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2526d385-dd29-4370-94e5-20f9469bf933 req-0eecdda8-bb7d-45e5-8c60-b8c76ba3035b service neutron] 10.222.0.46 "GET /v2.0/subnets?id=b6657dc9-704f-488f-a929-3d0573a04d1f HTTP/1.1" status: 200 len: 849 time: 0.0739403 Dec 24 05:00:41.789780 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2526d385-dd29-4370-94e5-20f9469bf933 req-0441c539-19b4-4c98-b673-6bdd80778552 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=c2c27570-f2cd-4dac-9473-e82a4e432501&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0306349 Dec 24 05:00:41.794258 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2a8379a0-e503-40d2-ac6d-bade4b3ec2fe req-9c82e483-94f5-4c53-a26e-688cc0121249 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0741210 Dec 24 05:00:41.889655 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b1a609a-30ec-49c3-8678-ab442039cccf req-9f4d656e-9632-4d17-944c-01086dcd7db9 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:41.892008 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5b1a609a-30ec-49c3-8678-ab442039cccf req-9f4d656e-9632-4d17-944c-01086dcd7db9 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 945 time: 0.0527141 Dec 24 05:00:41.892269 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2526d385-dd29-4370-94e5-20f9469bf933 req-44929609-f1d5-4cd7-baed-14b02df74886 service neutron] 10.222.0.46 "GET /v2.0/networks/c2c27570-f2cd-4dac-9473-e82a4e432501?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0926459 Dec 24 05:00:41.948840 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5b1a609a-30ec-49c3-8678-ab442039cccf req-928930bf-8703-430e-8938-69169c9cf951 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479970 Dec 24 05:00:41.980714 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 54058) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:41.992401 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1e0661cf-399a-443d-82d2-10d04cf37a78 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:42.011491 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2526d385-dd29-4370-94e5-20f9469bf933 req-a3061071-e6c1-41e7-b6bd-8e9871ab4658 service neutron] 10.222.0.46 "GET /v2.0/networks/c2c27570-f2cd-4dac-9473-e82a4e432501?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1070793 Dec 24 05:00:42.069837 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1e0661cf-399a-443d-82d2-10d04cf37a78 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:42.074909 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1e0661cf-399a-443d-82d2-10d04cf37a78 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:42.114008 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-1e0661cf-399a-443d-82d2-10d04cf37a78 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=84b4911a56a34406b7d23c62a9503d1f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1335638 Dec 24 05:00:42.114834 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e0661cf-399a-443d-82d2-10d04cf37a78 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=12304976-eeef-4965-baa4-57b1b27cfd58,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:42.117828 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 54062) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:42.166137 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4b8fc572-0a8c-43d5-9ec3-cc0a11ba8be0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:42.192043 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4b8fc572-0a8c-43d5-9ec3-cc0a11ba8be0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:42.249577 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4b8fc572-0a8c-43d5-9ec3-cc0a11ba8be0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:42.252271 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4b8fc572-0a8c-43d5-9ec3-cc0a11ba8be0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:42.255741 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-4b8fc572-0a8c-43d5-9ec3-cc0a11ba8be0 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/12304976-eeef-4965-baa4-57b1b27cfd58 HTTP/1.1" status: 204 len: 168 time: 0.1347442 Dec 24 05:00:42.268970 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b8fc572-0a8c-43d5-9ec3-cc0a11ba8be0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=12304976-eeef-4965-baa4-57b1b27cfd58,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:42.284326 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ee900a2-4586-4572-9926-d6cd084d8117 req-f606a6b7-a50f-4ae3-aca4-a707d1451e3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:42.285850 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3ee900a2-4586-4572-9926-d6cd084d8117 req-f606a6b7-a50f-4ae3-aca4-a707d1451e3e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0518486 Dec 24 05:00:42.336855 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3ee900a2-4586-4572-9926-d6cd084d8117 req-8568b239-1c89-4ad9-b13a-943ec5a1fb1f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441253 Dec 24 05:00:42.572783 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ccc9abb-4253-4469-84a6-15b387b8f496 req-2e6b2d29-15a7-475b-ac24-20d0a5f7efa9 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:42.574255 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6ccc9abb-4253-4469-84a6-15b387b8f496 req-2e6b2d29-15a7-475b-ac24-20d0a5f7efa9 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 944 time: 0.0506220 Dec 24 05:00:42.624027 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6ccc9abb-4253-4469-84a6-15b387b8f496 req-f1261de8-5a81-4a39-a281-872bdbd4a442 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413043 Dec 24 05:00:42.912566 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1717b2db-f6da-469d-bd64-835ca1cb1280 req-c655ff3a-f85a-44c8-8ce1-bfe8af911a22 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:42.914198 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1717b2db-f6da-469d-bd64-835ca1cb1280 req-c655ff3a-f85a-44c8-8ce1-bfe8af911a22 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 945 time: 0.0476420 Dec 24 05:00:42.962246 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1717b2db-f6da-469d-bd64-835ca1cb1280 req-0fced8fc-36c7-452a-b8f6-059cee80cd02 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419788 Dec 24 05:00:43.072666 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-155247fc-bf60-4215-9a9f-fc19bfe8a729 req-9d3eb57b-2f48-4cbf-aab7-a913b9d9aff4 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:43.074268 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-155247fc-bf60-4215-9a9f-fc19bfe8a729 req-9d3eb57b-2f48-4cbf-aab7-a913b9d9aff4 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 945 time: 0.0513809 Dec 24 05:00:43.124429 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-155247fc-bf60-4215-9a9f-fc19bfe8a729 req-f4cc8673-480d-419e-8a85-dee2bf4df01c tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416756 Dec 24 05:00:43.451906 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbc8e1c7-a450-4c36-b57d-7788cd66b40d req-6b812c2d-8fd5-44f8-8967-748c8b09ca2e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:43.453695 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-bbc8e1c7-a450-4c36-b57d-7788cd66b40d req-6b812c2d-8fd5-44f8-8967-748c8b09ca2e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0497050 Dec 24 05:00:43.505295 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-bbc8e1c7-a450-4c36-b57d-7788cd66b40d req-ae779ed9-e03c-4790-b049-fabb85b15e97 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456502 Dec 24 05:00:43.742730 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e49c02b0-4f84-4134-9798-86769f6dd30c req-2710f209-8243-47ab-8e0e-e50eac6a2571 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:43.744212 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e49c02b0-4f84-4134-9798-86769f6dd30c req-2710f209-8243-47ab-8e0e-e50eac6a2571 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 944 time: 0.0516865 Dec 24 05:00:43.798794 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e49c02b0-4f84-4134-9798-86769f6dd30c req-26b33c26-d71a-414b-8f33-a82b8b7fc073 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482743 Dec 24 05:00:44.077335 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3425b878-9fc2-4894-a16c-2d8448978142 req-86177ade-f636-47bb-ad6a-adadd80e62e6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:44.079183 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3425b878-9fc2-4894-a16c-2d8448978142 req-86177ade-f636-47bb-ad6a-adadd80e62e6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 945 time: 0.0484231 Dec 24 05:00:44.135666 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3425b878-9fc2-4894-a16c-2d8448978142 req-21228536-6a33-4957-87eb-7ad028ce05ac tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460148 Dec 24 05:00:44.238712 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7674582-a7dc-404c-95bc-d73dfeb9a175 req-503eb4e6-fac1-4b2b-9fbe-9ff15764aa48 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:44.240087 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a7674582-a7dc-404c-95bc-d73dfeb9a175 req-503eb4e6-fac1-4b2b-9fbe-9ff15764aa48 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 945 time: 0.0480509 Dec 24 05:00:44.290322 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a7674582-a7dc-404c-95bc-d73dfeb9a175 req-c631773e-4ca8-42d3-83cd-19b606e50fe2 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441480 Dec 24 05:00:44.624547 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38f49ad3-706a-442d-b4ad-f826084ae032 req-b4eae910-a15b-47bb-b0fd-7e6aa71db638 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:44.626100 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-38f49ad3-706a-442d-b4ad-f826084ae032 req-b4eae910-a15b-47bb-b0fd-7e6aa71db638 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0508258 Dec 24 05:00:44.673336 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-38f49ad3-706a-442d-b4ad-f826084ae032 req-fa334933-e01b-454b-88e0-57e591b21550 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407784 Dec 24 05:00:44.739485 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 54164) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:44.865653 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-41b9a967-aeaa-4d59-bd0c-39ef3e8872ec admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:44.915901 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66f24304-9662-4418-a918-38cfaaf8f9b7 req-3ce964fe-fde1-4fd0-bb97-4dbcf7f15115 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:44.917481 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-66f24304-9662-4418-a918-38cfaaf8f9b7 req-3ce964fe-fde1-4fd0-bb97-4dbcf7f15115 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 944 time: 0.0469656 Dec 24 05:00:44.940232 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-41b9a967-aeaa-4d59-bd0c-39ef3e8872ec admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:44.944774 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-41b9a967-aeaa-4d59-bd0c-39ef3e8872ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:44.964372 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-66f24304-9662-4418-a918-38cfaaf8f9b7 req-235e09cd-f03e-4def-820e-cae17505adaf tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403490 Dec 24 05:00:44.983735 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41b9a967-aeaa-4d59-bd0c-39ef3e8872ec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a352c158-82eb-42ea-b268-1da34120b977,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:44.990487 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-41b9a967-aeaa-4d59-bd0c-39ef3e8872ec admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=ad65d8b82a234c3b9f8770c4f978252e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2483282 Dec 24 05:00:44.993539 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 54170) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:45.042158 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-bfba4898-1282-4630-8bdd-a6903ef4c859 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:45.062578 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-bfba4898-1282-4630-8bdd-a6903ef4c859 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:45.111027 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-bfba4898-1282-4630-8bdd-a6903ef4c859 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:45.113725 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-bfba4898-1282-4630-8bdd-a6903ef4c859 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:45.114927 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-bfba4898-1282-4630-8bdd-a6903ef4c859 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/a352c158-82eb-42ea-b268-1da34120b977 HTTP/1.1" status: 204 len: 168 time: 0.1204393 Dec 24 05:00:45.123111 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfba4898-1282-4630-8bdd-a6903ef4c859 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a352c158-82eb-42ea-b268-1da34120b977,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:45.252197 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bbdf4a2-8e7e-456a-86ad-9d5e791fdd6e req-d915a526-1bfa-43cc-8e13-cf6b92c0511a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:45.253704 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5bbdf4a2-8e7e-456a-86ad-9d5e791fdd6e req-d915a526-1bfa-43cc-8e13-cf6b92c0511a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 945 time: 0.0497253 Dec 24 05:00:45.304701 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5bbdf4a2-8e7e-456a-86ad-9d5e791fdd6e req-38b98878-cf2c-4a8d-ac92-43c269b0120d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450304 Dec 24 05:00:45.403372 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 54186) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:45.416627 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0699c65c-6672-43ed-92d1-b93fcac70ab7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:45.431361 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9951644-4be3-431c-b50a-c4a9b86f3d27 req-b99849e9-6ada-4732-bb2d-e055cf1633a4 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:45.432854 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b9951644-4be3-431c-b50a-c4a9b86f3d27 req-b99849e9-6ada-4732-bb2d-e055cf1633a4 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 945 time: 0.0589521 Dec 24 05:00:45.483227 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b9951644-4be3-431c-b50a-c4a9b86f3d27 req-620aae8f-0fe3-490b-a031-5092fef2bbb0 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428534 Dec 24 05:00:45.492002 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0699c65c-6672-43ed-92d1-b93fcac70ab7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:45.496273 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0699c65c-6672-43ed-92d1-b93fcac70ab7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:45.538043 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-0699c65c-6672-43ed-92d1-b93fcac70ab7 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=6ea90368b99d403da7e517abd9cac9aa&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1335642 Dec 24 05:00:45.539175 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0699c65c-6672-43ed-92d1-b93fcac70ab7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7ee67613-d0b0-4e3d-8fdc-0d64861d1b61,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:45.540913 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 54188) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:45.591444 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-12cedbcb-a965-4983-83cb-4158066ffd32 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:45.613992 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-12cedbcb-a965-4983-83cb-4158066ffd32 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:45.663397 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-12cedbcb-a965-4983-83cb-4158066ffd32 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:45.666565 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-12cedbcb-a965-4983-83cb-4158066ffd32 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:45.667753 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-12cedbcb-a965-4983-83cb-4158066ffd32 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/7ee67613-d0b0-4e3d-8fdc-0d64861d1b61 HTTP/1.1" status: 204 len: 168 time: 0.1258233 Dec 24 05:00:45.675812 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12cedbcb-a965-4983-83cb-4158066ffd32 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7ee67613-d0b0-4e3d-8fdc-0d64861d1b61,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:45.788363 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31f85a2c-d105-4290-87da-bc122e62847f req-cb2b9be8-e2a2-4d98-afce-b15a10901b3a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:45.789861 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-31f85a2c-d105-4290-87da-bc122e62847f req-cb2b9be8-e2a2-4d98-afce-b15a10901b3a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0507987 Dec 24 05:00:45.843170 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-31f85a2c-d105-4290-87da-bc122e62847f req-bb9ee19f-4f28-4067-9f3b-cbb028cd27f7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0466866 Dec 24 05:00:46.079275 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffcfe2ce-acf9-455c-8515-c75077682c41 req-98d28376-791c-4708-a4db-f7b9c9946b93 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:46.080898 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ffcfe2ce-acf9-455c-8515-c75077682c41 req-98d28376-791c-4708-a4db-f7b9c9946b93 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 944 time: 0.0486860 Dec 24 05:00:46.129642 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ffcfe2ce-acf9-455c-8515-c75077682c41 req-105f8e51-d494-4493-afd6-cf53e20da80e tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421693 Dec 24 05:00:46.439322 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef35607e-96a6-4c9f-bd11-1887532a7f41 req-0fb76cda-7045-4b93-8db7-17a3c36cd3ce tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:46.440947 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ef35607e-96a6-4c9f-bd11-1887532a7f41 req-0fb76cda-7045-4b93-8db7-17a3c36cd3ce tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 945 time: 0.0602045 Dec 24 05:00:46.496142 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ef35607e-96a6-4c9f-bd11-1887532a7f41 req-09d23e85-6480-4b09-8d55-3ebf992ab82a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486946 Dec 24 05:00:46.612329 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afffb87d-44d2-482e-9eaa-738b098d10dc req-d81f9c1a-d4ee-4dff-94ae-d4d04b1362a8 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:46.614097 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-afffb87d-44d2-482e-9eaa-738b098d10dc req-d81f9c1a-d4ee-4dff-94ae-d4d04b1362a8 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 945 time: 0.0566986 Dec 24 05:00:46.669089 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-afffb87d-44d2-482e-9eaa-738b098d10dc req-9831a98e-e028-46a9-88fa-37e6385492e4 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0483222 Dec 24 05:00:46.973834 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-180da05c-008f-43cd-bace-a89cbef0be27 req-99e4dfef-ba46-476f-b144-212eae444c7b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:46.975762 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-180da05c-008f-43cd-bace-a89cbef0be27 req-99e4dfef-ba46-476f-b144-212eae444c7b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0529380 Dec 24 05:00:47.034109 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-180da05c-008f-43cd-bace-a89cbef0be27 req-dfaa6ee8-ea8a-4b0c-9a0f-ceceb93ad188 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499256 Dec 24 05:00:47.269694 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7caca8f8-2358-4ae0-8f50-aba103824c98 req-1612b707-8e09-4cce-9311-d24d8e2ae4ee tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:47.271248 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7caca8f8-2358-4ae0-8f50-aba103824c98 req-1612b707-8e09-4cce-9311-d24d8e2ae4ee tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 944 time: 0.0635729 Dec 24 05:00:47.325089 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7caca8f8-2358-4ae0-8f50-aba103824c98 req-500601de-0f0a-4e56-9380-f9a377bce305 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464015 Dec 24 05:00:47.539805 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 54268) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:47.614157 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fa4bcc9-910c-4469-874c-1416e56580b9 req-39fa8a00-88af-473d-84e2-29afc51a699b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:47.615650 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1fa4bcc9-910c-4469-874c-1416e56580b9 req-39fa8a00-88af-473d-84e2-29afc51a699b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 945 time: 0.0479712 Dec 24 05:00:47.651097 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b5add047-b9f5-4a71-9808-ec537b1e3726 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:47.686640 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1fa4bcc9-910c-4469-874c-1416e56580b9 req-08cc7239-88ff-49ba-83f4-7f75f0d7216a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0650532 Dec 24 05:00:47.758383 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b5add047-b9f5-4a71-9808-ec537b1e3726 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:47.777363 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b5add047-b9f5-4a71-9808-ec537b1e3726 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:47.822817 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-b5add047-b9f5-4a71-9808-ec537b1e3726 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=bafc35c85a7a49a68ec6d701e29f2db6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2819066 Dec 24 05:00:47.825736 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 54274) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:47.826326 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5add047-b9f5-4a71-9808-ec537b1e3726 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=77a546ed-9225-4579-af55-8c6e3b2f4bea,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:47.840797 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0f3062e-bed4-4e57-8abc-0178dae70612 req-12fd79c8-5e23-4743-8e14-0a8a1bc894e5 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:47.842285 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e0f3062e-bed4-4e57-8abc-0178dae70612 req-12fd79c8-5e23-4743-8e14-0a8a1bc894e5 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 945 time: 0.0958424 Dec 24 05:00:47.877378 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6589c505-32e2-467e-87fa-085d9682e10f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:47.893448 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e0f3062e-bed4-4e57-8abc-0178dae70612 req-15f9e6c1-1556-4f36-9468-8f28d2ddfc4c tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449903 Dec 24 05:00:47.898053 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6589c505-32e2-467e-87fa-085d9682e10f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:47.956292 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6589c505-32e2-467e-87fa-085d9682e10f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:47.958865 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6589c505-32e2-467e-87fa-085d9682e10f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:47.960317 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-6589c505-32e2-467e-87fa-085d9682e10f admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/77a546ed-9225-4579-af55-8c6e3b2f4bea HTTP/1.1" status: 204 len: 168 time: 0.1332493 Dec 24 05:00:47.968046 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6589c505-32e2-467e-87fa-085d9682e10f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=77a546ed-9225-4579-af55-8c6e3b2f4bea,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:48.150260 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-930e43ef-162f-4d10-b77d-2fdcf8838333 req-b58b9103-39e4-4d1c-a59e-776c0e5d3e88 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:48.151864 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-930e43ef-162f-4d10-b77d-2fdcf8838333 req-b58b9103-39e4-4d1c-a59e-776c0e5d3e88 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0486338 Dec 24 05:00:48.205505 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device b0bd939a-1211-4ec1-b074-b2767d087f95 up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:00:48.206072 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-930e43ef-162f-4d10-b77d-2fdcf8838333 req-8c15e44c-57b0-4e15-81b1-6f75588dc6e2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473065 Dec 24 05:00:48.243824 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 54282) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:48.257180 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d1b0d861-47a7-43a1-a86c-361aafd1a4fd admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:48.260899 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning for port b0bd939a-1211-4ec1-b074-b2767d087f95 completed by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 24 05:00:48.265251 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port b0bd939a-1211-4ec1-b074-b2767d087f95 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:00:48.265615 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:48.338705 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-270faf28-2b4e-417c-a36b-0d54b0a9412a req-dca2d53d-139e-470b-96a5-19df18804a3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:48.340596 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-270faf28-2b4e-417c-a36b-0d54b0a9412a req-dca2d53d-139e-470b-96a5-19df18804a3e service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=1e014b3683d841968563e0aa0705e862&device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 1097 time: 0.0819230 Dec 24 05:00:48.358376 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d1b0d861-47a7-43a1-a86c-361aafd1a4fd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:48.363871 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d1b0d861-47a7-43a1-a86c-361aafd1a4fd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:48.414313 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-d1b0d861-47a7-43a1-a86c-361aafd1a4fd admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=4fbe98a4f34d458294c3c18dcc42013e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1693435 Dec 24 05:00:48.416822 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 54288) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:48.428255 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1b0d861-47a7-43a1-a86c-361aafd1a4fd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1f247a94-a1da-41d9-b3ce-c3fa81c91bb9,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:48.455683 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72bfc324-92a9-4156-aaf4-d5f1eee9d112 req-a245bf7f-d058-49c1-b4b3-0e5ddd09ebf0 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:48.457436 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-72bfc324-92a9-4156-aaf4-d5f1eee9d112 req-a245bf7f-d058-49c1-b4b3-0e5ddd09ebf0 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 944 time: 0.0583560 Dec 24 05:00:48.478552 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:48.505881 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cccacaaf-be31-4169-8a5b-13ea806dbd2c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b0bd939a-1211-4ec1-b074-b2767d087f95'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:00:48.506721 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-72bfc324-92a9-4156-aaf4-d5f1eee9d112 req-5180cbec-2884-4b57-b78b-93491cae9f51 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427392 Dec 24 05:00:48.508153 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-31adbe7c-ae75-4641-abf9-010f3c7d15af" -d '{"events": [{"server_uuid": "cccacaaf-be31-4169-8a5b-13ea806dbd2c", "name": "network-vif-plugged", "status": "completed", "tag": "b0bd939a-1211-4ec1-b074-b2767d087f95"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:00:48.520484 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-90ceb215-63cb-4656-af4e-721e2badea1d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:48.529646 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port b0bd939a-1211-4ec1-b074-b2767d087f95, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=b0bd939a-1211-4ec1-b074-b2767d087f95,segment=NetworkSegment(10307c97-e214-473b-b760-bb1b770153ec),segment_id=10307c97-e214-473b-b760-bb1b770153ec)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:00:48.534545 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:48.559846 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device c20bf82b-830b-4f29-b2bf-97f490cf78c9 no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:00:48.563169 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:00:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8229214a-a733-4dbb-8ded-64cddec377aa x-openstack-request-id: req-8229214a-a733-4dbb-8ded-64cddec377aa {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:00:48.563469 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cccacaaf-be31-4169-8a5b-13ea806dbd2c", "name": "network-vif-plugged", "status": "completed", "tag": "b0bd939a-1211-4ec1-b074-b2767d087f95", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:00:48.563713 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-8229214a-a733-4dbb-8ded-64cddec377aa {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:00:48.564232 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cccacaaf-be31-4169-8a5b-13ea806dbd2c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b0bd939a-1211-4ec1-b074-b2767d087f95', 'code': 200} Dec 24 05:00:48.596875 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-90ceb215-63cb-4656-af4e-721e2badea1d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:48.606075 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29674495-0ad5-41d1-a961-d7410c83adc9 req-d01b414b-c6d8-4837-a50e-d3e5ad8a4e9b tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:48.607618 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-29674495-0ad5-41d1-a961-d7410c83adc9 req-d01b414b-c6d8-4837-a50e-d3e5ad8a4e9b tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.46 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 945 time: 0.1505783 Dec 24 05:00:48.631840 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=b0bd939a-1211-4ec1-b074-b2767d087f95,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:48.673045 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:48.679065 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-270faf28-2b4e-417c-a36b-0d54b0a9412a req-14e61501-264e-49e2-9cab-6a68f0f3ab84 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:48.680652 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-270faf28-2b4e-417c-a36b-0d54b0a9412a req-14e61501-264e-49e2-9cab-6a68f0f3ab84 service neutron] 10.222.0.46 "GET /v2.0/networks?id=c2c27570-f2cd-4dac-9473-e82a4e432501 HTTP/1.1" status: 200 len: 910 time: 0.2259409 Dec 24 05:00:48.707125 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port c20bf82b-830b-4f29-b2bf-97f490cf78c9, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=c20bf82b-830b-4f29-b2bf-97f490cf78c9,segment=NetworkSegment(3203d346-5464-46d2-aeaa-9836964b7a28),segment_id=3203d346-5464-46d2-aeaa-9836964b7a28)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:00:48.713959 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:48.765620 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=c20bf82b-830b-4f29-b2bf-97f490cf78c9,revision_number=6']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:48.765858 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-270faf28-2b4e-417c-a36b-0d54b0a9412a req-63bd99ac-5204-4a9e-964d-e798474aca7d service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=639654f0-9663-4da1-8410-7e554500497a HTTP/1.1" status: 200 len: 217 time: 0.0755384 Dec 24 05:00:48.791547 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-90ceb215-63cb-4656-af4e-721e2badea1d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:48.794195 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-90ceb215-63cb-4656-af4e-721e2badea1d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:48.795333 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-90ceb215-63cb-4656-af4e-721e2badea1d admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/1f247a94-a1da-41d9-b3ce-c3fa81c91bb9 HTTP/1.1" status: 204 len: 168 time: 0.3775301 Dec 24 05:00:48.809891 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90ceb215-63cb-4656-af4e-721e2badea1d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1f247a94-a1da-41d9-b3ce-c3fa81c91bb9,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:48.814012 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52444fcc-b86d-4b78-b394-4040aa66ab55 req-4214453a-8e2d-458d-9f59-4433f66e906d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:48.816197 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-52444fcc-b86d-4b78-b394-4040aa66ab55 req-4214453a-8e2d-458d-9f59-4433f66e906d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 946 time: 0.0561314 Dec 24 05:00:48.818306 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-29674495-0ad5-41d1-a961-d7410c83adc9 req-801c64fd-06f0-469a-93a9-5541648af4b8 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Deleting port c20bf82b-830b-4f29-b2bf-97f490cf78c9 {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:00:48.818645 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-29674495-0ad5-41d1-a961-d7410c83adc9 req-801c64fd-06f0-469a-93a9-5541648af4b8 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:48.885653 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-52444fcc-b86d-4b78-b394-4040aa66ab55 req-7adbb53d-7d7a-4cb0-a849-48d5a9ac435d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0619688 Dec 24 05:00:48.927916 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-29674495-0ad5-41d1-a961-d7410c83adc9 req-801c64fd-06f0-469a-93a9-5541648af4b8 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] For port c20bf82b-830b-4f29-b2bf-97f490cf78c9, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=c20bf82b-830b-4f29-b2bf-97f490cf78c9,segment=NetworkSegment(3203d346-5464-46d2-aeaa-9836964b7a28),segment_id=3203d346-5464-46d2-aeaa-9836964b7a28)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:00:48.928927 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-29674495-0ad5-41d1-a961-d7410c83adc9 req-801c64fd-06f0-469a-93a9-5541648af4b8 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:48.944582 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-29674495-0ad5-41d1-a961-d7410c83adc9 req-801c64fd-06f0-469a-93a9-5541648af4b8 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Calling delete_port for c20bf82b-830b-4f29-b2bf-97f490cf78c9 owned by compute:nova {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:00:49.069979 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80a06034-4dba-4e28-a1f8-4cc592075da3 req-b5cd50ec-59b9-43c6-b5f7-378cf468d29d tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:49.071581 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-80a06034-4dba-4e28-a1f8-4cc592075da3 req-b5cd50ec-59b9-43c6-b5f7-378cf468d29d tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 943 time: 0.0796974 Dec 24 05:00:49.214318 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-270faf28-2b4e-417c-a36b-0d54b0a9412a req-3234f89d-136a-4505-8e50-d4e6534bb444 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:49.215868 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-270faf28-2b4e-417c-a36b-0d54b0a9412a req-3234f89d-136a-4505-8e50-d4e6534bb444 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=b6657dc9-704f-488f-a929-3d0573a04d1f HTTP/1.1" status: 200 len: 849 time: 0.1433163 Dec 24 05:00:49.227048 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-80a06034-4dba-4e28-a1f8-4cc592075da3 req-555dfca9-aa39-4ce5-acf3-841a76041fb9 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/security-groups?id=08dd9559-4a5c-4df9-a435-24a371a63d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1444283 Dec 24 05:00:49.232806 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68f91e3d-153c-473d-91ad-aee750c9a243 req-d30ed436-1e75-48bd-9352-9eb77d914622 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:49.234406 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-68f91e3d-153c-473d-91ad-aee750c9a243 req-d30ed436-1e75-48bd-9352-9eb77d914622 service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 1099 time: 0.1537676 Dec 24 05:00:49.265085 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-270faf28-2b4e-417c-a36b-0d54b0a9412a req-7a2d68d8-5a5d-48d5-aaa7-73bef1a7ad37 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=c2c27570-f2cd-4dac-9473-e82a4e432501&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0370505 Dec 24 05:00:49.290208 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-29674495-0ad5-41d1-a961-d7410c83adc9 req-801c64fd-06f0-469a-93a9-5541648af4b8 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:49.356157 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93647224-77e5-44c7-b191-27f2b8a2706c req-f30a7c99-4c6f-44ce-92f0-062e69275a64 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:49.364725 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-93647224-77e5-44c7-b191-27f2b8a2706c req-f30a7c99-4c6f-44ce-92f0-062e69275a64 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0755644 Dec 24 05:00:49.385520 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-801c64fd-06f0-469a-93a9-5541648af4b8 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Pushing event deleted for resources: {'Port': ['ID=c20bf82b-830b-4f29-b2bf-97f490cf78c9,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:49.402558 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:49.428898 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-93647224-77e5-44c7-b191-27f2b8a2706c req-63f2f60f-d038-4690-b246-6c9e45407934 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0631859 Dec 24 05:00:49.439664 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-68f91e3d-153c-473d-91ad-aee750c9a243 req-465e1054-090c-4231-92e4-a22df5d9d469 service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1723232 Dec 24 05:00:49.466066 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-29674495-0ad5-41d1-a961-d7410c83adc9 req-801c64fd-06f0-469a-93a9-5541648af4b8 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] No DVR routers for this DVR port c20bf82b-830b-4f29-b2bf-97f490cf78c9 on host hv-cinder-81644 {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:00:49.469795 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-29674495-0ad5-41d1-a961-d7410c83adc9 req-801c64fd-06f0-469a-93a9-5541648af4b8 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:49.473155 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-29674495-0ad5-41d1-a961-d7410c83adc9 req-801c64fd-06f0-469a-93a9-5541648af4b8 tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.46 "DELETE /v2.0/ports/c20bf82b-830b-4f29-b2bf-97f490cf78c9 HTTP/1.1" status: 204 len: 173 time: 0.8575139 Dec 24 05:00:49.473623 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'de66f13f-d7ee-49ab-b071-e5b7acd3b2fe', 'name': 'network-vif-deleted', 'tag': 'c20bf82b-830b-4f29-b2bf-97f490cf78c9'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:00:49.475947 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-00fe5fb2-7a99-424c-a303-2e82399a45e5" -d '{"events": [{"server_uuid": "de66f13f-d7ee-49ab-b071-e5b7acd3b2fe", "name": "network-vif-deleted", "tag": "c20bf82b-830b-4f29-b2bf-97f490cf78c9"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:00:49.503980 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-270faf28-2b4e-417c-a36b-0d54b0a9412a req-0719cec5-955f-4d77-978e-006aefb60c43 service neutron] 10.222.0.46 "GET /v2.0/networks/c2c27570-f2cd-4dac-9473-e82a4e432501?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2292092 Dec 24 05:00:49.512714 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:00:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cbee967e-680a-40ac-801d-1db065935526 x-openstack-request-id: req-cbee967e-680a-40ac-801d-1db065935526 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:00:49.512991 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "de66f13f-d7ee-49ab-b071-e5b7acd3b2fe", "name": "network-vif-deleted", "tag": "c20bf82b-830b-4f29-b2bf-97f490cf78c9", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:00:49.513247 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-cbee967e-680a-40ac-801d-1db065935526 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:00:49.513639 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'de66f13f-d7ee-49ab-b071-e5b7acd3b2fe', 'name': 'network-vif-deleted', 'tag': 'c20bf82b-830b-4f29-b2bf-97f490cf78c9', 'status': 'completed', 'code': 200} Dec 24 05:00:49.621727 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f636a01-51f8-4149-a1b6-aab4a7e56cd1 req-bf383261-d40d-4367-a477-312361b8f80d tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:49.623200 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6f636a01-51f8-4149-a1b6-aab4a7e56cd1 req-bf383261-d40d-4367-a477-312361b8f80d tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 944 time: 0.0492823 Dec 24 05:00:49.682246 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6f636a01-51f8-4149-a1b6-aab4a7e56cd1 req-4a5e7d5e-1baf-4219-9ec9-b74dafd91cd5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0521467 Dec 24 05:00:50.004629 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c892605f-87ba-4b37-a277-2d8580a2afd5 req-5451dcea-b2c4-4122-aef7-ac055f739f12 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:50.006091 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c892605f-87ba-4b37-a277-2d8580a2afd5 req-5451dcea-b2c4-4122-aef7-ac055f739f12 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 946 time: 0.0487807 Dec 24 05:00:50.053929 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c892605f-87ba-4b37-a277-2d8580a2afd5 req-63e481dd-544a-49f9-a296-0e9206188ce6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417769 Dec 24 05:00:50.267019 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-270faf28-2b4e-417c-a36b-0d54b0a9412a req-5965d983-f7ba-4dec-8b32-14e90432d22e service neutron] 10.222.0.46 "GET /v2.0/networks/c2c27570-f2cd-4dac-9473-e82a4e432501?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0943758 Dec 24 05:00:50.329937 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7f68fb23-5472-465e-aed9-0fad7c0b7aee req-5bf12ecd-cca2-4984-a656-a1626b51628c tempest-DeleteServersTestJSON-1271844982 tempest-DeleteServersTestJSON-1271844982-project] 10.222.0.43 "GET /v2.0/ports?device_id=de66f13f-d7ee-49ab-b071-e5b7acd3b2fe HTTP/1.1" status: 200 len: 210 time: 0.0277691 Dec 24 05:00:50.548986 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-405de2c0-8b76-4a82-99b6-9d979e637b80 req-41c2e837-c001-4113-8af2-d1c742272970 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:50.550470 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-405de2c0-8b76-4a82-99b6-9d979e637b80 req-41c2e837-c001-4113-8af2-d1c742272970 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0495567 Dec 24 05:00:50.565936 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'de66f13f-d7ee-49ab-b071-e5b7acd3b2fe', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c20bf82b-830b-4f29-b2bf-97f490cf78c9'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:00:50.568925 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-59d7e9cd-59e3-49c2-aa4c-ade26d6a7c2a" -d '{"events": [{"server_uuid": "de66f13f-d7ee-49ab-b071-e5b7acd3b2fe", "name": "network-vif-unplugged", "status": "completed", "tag": "c20bf82b-830b-4f29-b2bf-97f490cf78c9"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:00:50.602825 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-405de2c0-8b76-4a82-99b6-9d979e637b80 req-e44a4c54-2789-4c80-99dc-79318364c5a9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461023 Dec 24 05:00:50.627410 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Fri, 24 Dec 2021 05:00:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5379eabe-7fb2-4983-99f5-82985ffac04f x-openstack-request-id: req-5379eabe-7fb2-4983-99f5-82985ffac04f {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:00:50.627769 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "de66f13f-d7ee-49ab-b071-e5b7acd3b2fe", "name": "network-vif-unplugged", "status": "completed", "tag": "c20bf82b-830b-4f29-b2bf-97f490cf78c9", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:00:50.628101 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-5379eabe-7fb2-4983-99f5-82985ffac04f {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:00:50.628588 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'de66f13f-d7ee-49ab-b071-e5b7acd3b2fe', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'c20bf82b-830b-4f29-b2bf-97f490cf78c9', 'code': 200} Dec 24 05:00:50.820905 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2d2b296-1593-44d2-95cf-42603b86121f req-487c55aa-552f-446a-b6fc-bd465bf665c3 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:50.823158 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a2d2b296-1593-44d2-95cf-42603b86121f req-487c55aa-552f-446a-b6fc-bd465bf665c3 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 944 time: 0.0630901 Dec 24 05:00:50.883012 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a2d2b296-1593-44d2-95cf-42603b86121f req-f98086fa-4735-4be8-b66c-be50ce2c7fb8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0527506 Dec 24 05:00:51.179151 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-884d4ff6-2858-4c3f-a866-967fda36334f req-bfd633d2-7250-4f25-b86f-70c97d4fe86b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:51.180835 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-884d4ff6-2858-4c3f-a866-967fda36334f req-bfd633d2-7250-4f25-b86f-70c97d4fe86b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 946 time: 0.0554218 Dec 24 05:00:51.252214 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-884d4ff6-2858-4c3f-a866-967fda36334f req-7e067640-022e-4f60-9722-a171def1228d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467229 Dec 24 05:00:51.724457 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f5a8031-4258-4542-9e71-38d38c9de096 req-56bc200d-eb40-411b-8357-56786204da39 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:51.725962 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-9f5a8031-4258-4542-9e71-38d38c9de096 req-56bc200d-eb40-411b-8357-56786204da39 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0541070 Dec 24 05:00:51.773286 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-9f5a8031-4258-4542-9e71-38d38c9de096 req-ed12ad33-7943-4f5e-82b4-73578c6bb461 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411601 Dec 24 05:00:52.024350 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36e26996-2d5b-4d6e-97d0-5852b6c68d23 req-6fac5c03-8cf3-4f28-87ef-50c78ce94ae3 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:52.025923 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-36e26996-2d5b-4d6e-97d0-5852b6c68d23 req-6fac5c03-8cf3-4f28-87ef-50c78ce94ae3 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 944 time: 0.0548651 Dec 24 05:00:52.082341 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-36e26996-2d5b-4d6e-97d0-5852b6c68d23 req-242e1294-6eeb-453c-9ae1-9d5c6441d504 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0481684 Dec 24 05:00:52.193068 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 639654f0-9663-4da1-8410-7e554500497a details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 05:00:52.290829 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 639654f0-9663-4da1-8410-7e554500497a, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=639654f0-9663-4da1-8410-7e554500497a,segment=NetworkSegment(00999af0-b9ae-4a2b-9c30-590dbe00c43a),segment_id=00999af0-b9ae-4a2b-9c30-590dbe00c43a)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:00:52.305649 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': '639654f0-9663-4da1-8410-7e554500497a', 'network_id': 'c2c27570-f2cd-4dac-9473-e82a4e432501', 'port_id': '639654f0-9663-4da1-8410-7e554500497a', 'mac_address': 'fa:16:3e:76:fa:28', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 103, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b6657dc9-704f-488f-a929-3d0573a04d1f', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 05:00:52.346188 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:52.358872 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 639654f0-9663-4da1-8410-7e554500497a {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:00:52.379769 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab519bc4-ecf8-4988-a2f0-175c43542e6e req-ad2f3757-d565-4e9e-aea0-f28f3c3eda43 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:52.381309 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ab519bc4-ecf8-4988-a2f0-175c43542e6e req-ad2f3757-d565-4e9e-aea0-f28f3c3eda43 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 946 time: 0.0536087 Dec 24 05:00:52.384254 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 639654f0-9663-4da1-8410-7e554500497a, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=639654f0-9663-4da1-8410-7e554500497a,segment=NetworkSegment(00999af0-b9ae-4a2b-9c30-590dbe00c43a),segment_id=00999af0-b9ae-4a2b-9c30-590dbe00c43a)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:00:52.390186 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:52.432843 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ab519bc4-ecf8-4988-a2f0-175c43542e6e req-a95d20b8-a2ac-4421-8571-56bea5f9a7f2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437615 Dec 24 05:00:52.440491 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=639654f0-9663-4da1-8410-7e554500497a,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:52.898104 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ffcdd32-aa85-4298-b033-feef5431a6af req-8db9771f-a1ac-47da-8ac9-29947697192a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:52.899600 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4ffcdd32-aa85-4298-b033-feef5431a6af req-8db9771f-a1ac-47da-8ac9-29947697192a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0535674 Dec 24 05:00:52.950062 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4ffcdd32-aa85-4298-b033-feef5431a6af req-09bfaff0-439a-4ccd-937d-09fb8682fe6c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432365 Dec 24 05:00:53.035175 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['639654f0-9663-4da1-8410-7e554500497a'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:00:53.204348 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-965c4f05-9180-4752-84b8-7c5c156ea041 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:53.235301 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a1ca54d-502a-4caf-9699-6989077cf21f req-442b8798-fb9f-4f49-9624-700d5483d165 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:53.237092 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1a1ca54d-502a-4caf-9699-6989077cf21f req-442b8798-fb9f-4f49-9624-700d5483d165 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 945 time: 0.0780423 Dec 24 05:00:53.288834 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1a1ca54d-502a-4caf-9699-6989077cf21f req-66bab1fb-b6e5-4985-a3de-034ab9170e6a tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447655 Dec 24 05:00:53.858973 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 54524) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:53.906934 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_v2 [None req-e82e9250-4eba-43ea-b46e-e3b50a8dd9a3 admin admin] Deleting subnet 32199feb-6f3a-4642-a10b-5d278d90a9e5 {{(pid=102476) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Dec 24 05:00:53.910026 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e82e9250-4eba-43ea-b46e-e3b50a8dd9a3 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:53.946440 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e82e9250-4eba-43ea-b46e-e3b50a8dd9a3 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-32509714'] for subnet, precommit_delete_associations {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:53.989002 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e82e9250-4eba-43ea-b46e-e3b50a8dd9a3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3590439'] for subnet, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:54.052846 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e82e9250-4eba-43ea-b46e-e3b50a8dd9a3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3590440', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-32528482', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-32970397'] for subnet, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:54.079615 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0777c2c-71d6-401b-bba3-878707a376d1 req-7f0a6aca-1fc6-48fa-9bcc-500274cc131a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:54.084346 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e82e9250-4eba-43ea-b46e-e3b50a8dd9a3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=32199feb-6f3a-4642-a10b-5d278d90a9e5,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:54.087226 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e82e9250-4eba-43ea-b46e-e3b50a8dd9a3 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:54.088479 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b0777c2c-71d6-401b-bba3-878707a376d1 req-7f0a6aca-1fc6-48fa-9bcc-500274cc131a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0624025 Dec 24 05:00:54.090635 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-e82e9250-4eba-43ea-b46e-e3b50a8dd9a3 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/32199feb-6f3a-4642-a10b-5d278d90a9e5 HTTP/1.1" status: 204 len: 168 time: 0.2304561 Dec 24 05:00:54.093311 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 54542) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:54.135775 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b0777c2c-71d6-401b-bba3-878707a376d1 req-0de5f40f-497c-4dca-ba06-88794ddc4500 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463128 Dec 24 05:00:54.174686 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-026c832a-99bb-4f6e-98b8-87e4498d420d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3741433'] for network, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:54.252406 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-026c832a-99bb-4f6e-98b8-87e4498d420d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3595960', 'neutron.services.segments.db._delete_segments_for_network-8750577966942'] for network, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:54.274861 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-026c832a-99bb-4f6e-98b8-87e4498d420d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['598b6cd9-9673-4e27-b33e-451cd98b5f1c']}} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:00:54.284501 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-026c832a-99bb-4f6e-98b8-87e4498d420d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3203d346-5464-46d2-aeaa-9836964b7a28') {'for_net_delete': True} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:00:54.284821 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-026c832a-99bb-4f6e-98b8-87e4498d420d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3203d346-5464-46d2-aeaa-9836964b7a28') {} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:00:54.294649 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-026c832a-99bb-4f6e-98b8-87e4498d420d admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750577970535', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-32509733'] for segment, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:54.308718 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-026c832a-99bb-4f6e-98b8-87e4498d420d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:54.315745 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-026c832a-99bb-4f6e-98b8-87e4498d420d admin admin] Releasing vlan 115 on physical network physnet1 to pool {{(pid=102476) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 24 05:00:54.316119 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-026c832a-99bb-4f6e-98b8-87e4498d420d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-32528320'] for segment, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:00:54.317787 dv-cinder-816443-2-iscsi neutron-server[102476]: Traceback (most recent call last): Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: timer() Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: cb(*args, **kw) Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: return func(*args, **kwargs) Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: self._notify() Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: self.callback(batched_events) Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: event.method(event) Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: aggregate_uuid = self.p_client.list_aggregates( Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: return f(self, *a, **k) Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: return self._get(url).json() Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: return self.request(url, 'GET', **kwargs) Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: base_url = self.get_endpoint(auth, allow=allow, Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 24 05:00:54.320016 dv-cinder-816443-2-iscsi neutron-server[102476]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 24 05:00:54.392207 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-026c832a-99bb-4f6e-98b8-87e4498d420d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3595937', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-546046'] for network, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:54.399636 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-026c832a-99bb-4f6e-98b8-87e4498d420d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:54.402768 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-026c832a-99bb-4f6e-98b8-87e4498d420d admin admin] 10.222.0.43 "DELETE /v2.0/networks/598b6cd9-9673-4e27-b33e-451cd98b5f1c HTTP/1.1" status: 204 len: 168 time: 0.3085520 Dec 24 05:00:54.419149 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-026c832a-99bb-4f6e-98b8-87e4498d420d admin admin] Pushing event deleted for resources: {'Network': ['ID=598b6cd9-9673-4e27-b33e-451cd98b5f1c,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:54.444325 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1bacea7-f762-46d7-ac65-b157939761cb req-036adacb-2b62-4bc8-8346-c273d9934a94 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:54.445869 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c1bacea7-f762-46d7-ac65-b157939761cb req-036adacb-2b62-4bc8-8346-c273d9934a94 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 945 time: 0.0841532 Dec 24 05:00:54.496004 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c1bacea7-f762-46d7-ac65-b157939761cb req-e4fdb742-9a5b-4be0-8c7d-af50320432c3 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443089 Dec 24 05:00:54.568537 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 54554) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:54.609599 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-b7abc5f6-da64-4208-94c1-ff29a1eeedd3 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=14dbe9b1ff9041858e25c4fafebc1a51&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0397758 Dec 24 05:00:54.613166 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 54556) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:00:54.662275 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-9be99d85-0c11-46dc-85f2-5ffb5067e58a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:54.684984 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-9be99d85-0c11-46dc-85f2-5ffb5067e58a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:54.742812 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-9be99d85-0c11-46dc-85f2-5ffb5067e58a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:54.745442 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-9be99d85-0c11-46dc-85f2-5ffb5067e58a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:54.746604 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-9be99d85-0c11-46dc-85f2-5ffb5067e58a admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/08dd9559-4a5c-4df9-a435-24a371a63d3e HTTP/1.1" status: 204 len: 168 time: 0.1323769 Dec 24 05:00:54.754309 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9be99d85-0c11-46dc-85f2-5ffb5067e58a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=08dd9559-4a5c-4df9-a435-24a371a63d3e,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:55.263717 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-a5d2ea6a-6190-40e7-8728-a994406d3d90 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:55.264795 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d4aa035-a5cb-4e6f-900f-ab1a776267ae req-07fc71f0-6e02-4ff6-a4db-d60ad9593b51 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:55.268431 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0d4aa035-a5cb-4e6f-900f-ab1a776267ae req-07fc71f0-6e02-4ff6-a4db-d60ad9593b51 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0652885 Dec 24 05:00:55.321316 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0d4aa035-a5cb-4e6f-900f-ab1a776267ae req-0902266e-458d-4bf8-9df2-4aa603998d7a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469689 Dec 24 05:00:56.065476 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d482cdf-a6fb-4461-b688-ea0b9fa068d7 req-a2b2c2d0-320a-46a0-ab6f-d77f44b21f02 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:56.066928 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1d482cdf-a6fb-4461-b688-ea0b9fa068d7 req-a2b2c2d0-320a-46a0-ab6f-d77f44b21f02 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 945 time: 0.0635109 Dec 24 05:00:56.116144 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1d482cdf-a6fb-4461-b688-ea0b9fa068d7 req-986b720a-6f63-44ba-9f1d-80dfb4dfa205 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431132 Dec 24 05:00:56.436658 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4904c72e-17d1-4e2a-88ce-62fda7be913d req-8b4779b3-19be-4ce7-88d7-cd99cb4b1829 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:56.438288 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4904c72e-17d1-4e2a-88ce-62fda7be913d req-8b4779b3-19be-4ce7-88d7-cd99cb4b1829 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0497816 Dec 24 05:00:56.441218 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:56.489199 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4904c72e-17d1-4e2a-88ce-62fda7be913d req-0dcc818d-237f-47ab-9f84-4b2ddeaa378b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435576 Dec 24 05:00:57.246213 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4ad37d3-16c1-495a-b2b0-155f5f648fba req-dd4e12d3-cee9-4761-abf3-0d479b8fa7f4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:57.247695 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a4ad37d3-16c1-495a-b2b0-155f5f648fba req-dd4e12d3-cee9-4761-abf3-0d479b8fa7f4 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 945 time: 0.0487769 Dec 24 05:00:57.297711 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a4ad37d3-16c1-495a-b2b0-155f5f648fba req-340defd3-b03b-42b2-9328-513ff2ec1a53 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440474 Dec 24 05:00:57.608802 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-130f2090-bb99-490d-a5ac-9bd87e3b07ea req-bda7d63b-3b15-4de8-9ade-733a699645d4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:57.610344 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-130f2090-bb99-490d-a5ac-9bd87e3b07ea req-bda7d63b-3b15-4de8-9ade-733a699645d4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0500748 Dec 24 05:00:57.656438 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-130f2090-bb99-490d-a5ac-9bd87e3b07ea req-b0b52aea-8fc3-484e-8f8a-ed9ba7f822d2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400565 Dec 24 05:00:57.889642 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:58.423281 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acbbaeb1-e9aa-4863-9000-b213a6e615ea req-8ca3362d-60cf-4024-8e8a-552aea794fe9 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:58.424784 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-acbbaeb1-e9aa-4863-9000-b213a6e615ea req-8ca3362d-60cf-4024-8e8a-552aea794fe9 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 945 time: 0.0504456 Dec 24 05:00:58.485772 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-acbbaeb1-e9aa-4863-9000-b213a6e615ea req-b1be9b68-23bb-49a5-8a59-cbe5c0d124c2 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0527360 Dec 24 05:00:58.570229 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 639654f0-9663-4da1-8410-7e554500497a up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:00:58.600627 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:58.624589 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning for port 639654f0-9663-4da1-8410-7e554500497a completed by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 24 05:00:58.628812 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port 639654f0-9663-4da1-8410-7e554500497a triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:00:58.629192 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:58.706242 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:58.728918 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'df4a8b5b-4054-465a-81a5-1e3cd5b5997b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '639654f0-9663-4da1-8410-7e554500497a'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:00:58.731134 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2ff3fa09-173d-42a0-a327-46b22985e965" -d '{"events": [{"server_uuid": "df4a8b5b-4054-465a-81a5-1e3cd5b5997b", "name": "network-vif-plugged", "status": "completed", "tag": "639654f0-9663-4da1-8410-7e554500497a"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:00:58.747169 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 639654f0-9663-4da1-8410-7e554500497a, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=639654f0-9663-4da1-8410-7e554500497a,segment=NetworkSegment(00999af0-b9ae-4a2b-9c30-590dbe00c43a),segment_id=00999af0-b9ae-4a2b-9c30-590dbe00c43a)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:00:58.753215 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:00:58.776604 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:00:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c4b45aea-7774-4c71-a100-e3be5706f8e5 x-openstack-request-id: req-c4b45aea-7774-4c71-a100-e3be5706f8e5 {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:00:58.776924 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "df4a8b5b-4054-465a-81a5-1e3cd5b5997b", "name": "network-vif-plugged", "status": "completed", "tag": "639654f0-9663-4da1-8410-7e554500497a", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:00:58.777178 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-c4b45aea-7774-4c71-a100-e3be5706f8e5 {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:00:58.777562 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'df4a8b5b-4054-465a-81a5-1e3cd5b5997b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '639654f0-9663-4da1-8410-7e554500497a', 'code': 200} Dec 24 05:00:58.787676 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94c1b2f7-2200-434a-88f9-615962bc6ab1 req-c7cc1e41-52da-48d7-b31c-171a5fc1540f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:58.789203 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-94c1b2f7-2200-434a-88f9-615962bc6ab1 req-c7cc1e41-52da-48d7-b31c-171a5fc1540f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0522940 Dec 24 05:00:58.803095 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=639654f0-9663-4da1-8410-7e554500497a,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:00:58.840455 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-94c1b2f7-2200-434a-88f9-615962bc6ab1 req-cb458db1-77fc-483f-9a33-4189e1daceac tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448387 Dec 24 05:00:59.054471 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c107fc9c-8ba8-47d4-9df5-5fa5d3cd9876 req-3db6f808-c282-49ef-95da-6ecd127a8c17 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:59.055970 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c107fc9c-8ba8-47d4-9df5-5fa5d3cd9876 req-3db6f808-c282-49ef-95da-6ecd127a8c17 service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 1099 time: 0.0442967 Dec 24 05:00:59.104127 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c107fc9c-8ba8-47d4-9df5-5fa5d3cd9876 req-584cbc60-9417-4f6e-8d2a-685c5fd8d50c service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387876 Dec 24 05:00:59.617704 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69d86828-3bf4-4abe-8061-df8e9dee5772 req-a058681a-7d98-412b-8a67-01ee8c7d7a0b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:59.619310 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-69d86828-3bf4-4abe-8061-df8e9dee5772 req-a058681a-7d98-412b-8a67-01ee8c7d7a0b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 946 time: 0.0513356 Dec 24 05:00:59.668370 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-69d86828-3bf4-4abe-8061-df8e9dee5772 req-90f94699-4da8-4211-a4b6-9562482cd6a3 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423288 Dec 24 05:00:59.956745 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-872463e1-7c15-415c-a6bb-8321a32793c1 req-ce67ed3a-6df6-44af-be15-87eff27d9260 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:00:59.958363 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-872463e1-7c15-415c-a6bb-8321a32793c1 req-ce67ed3a-6df6-44af-be15-87eff27d9260 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0505817 Dec 24 05:01:00.011674 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-872463e1-7c15-415c-a6bb-8321a32793c1 req-e581cd94-1709-41d6-bfa8-451f6eb70dfd tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467243 Dec 24 05:01:00.800312 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a75d17e1-e943-40ed-9f5c-54d9b1a3bc31 req-8e73b152-ab69-45da-bd95-ef12429ee67d tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:00.811181 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a75d17e1-e943-40ed-9f5c-54d9b1a3bc31 req-8e73b152-ab69-45da-bd95-ef12429ee67d tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 946 time: 0.0676651 Dec 24 05:01:00.883807 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a75d17e1-e943-40ed-9f5c-54d9b1a3bc31 req-17f1941d-071c-472a-b80e-dcc6a80cea37 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0661097 Dec 24 05:01:01.033725 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 54726) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:01.176736 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-672ae40f-0c35-4f0e-b0ec-0c60a3771052 req-eddb1ba4-2372-4d57-95fc-e7e7952890f6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:01.178532 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-672ae40f-0c35-4f0e-b0ec-0c60a3771052 req-eddb1ba4-2372-4d57-95fc-e7e7952890f6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0698144 Dec 24 05:01:01.185238 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f561e4ff-50fb-43b0-902c-2e5094c093c2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:01.228418 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-672ae40f-0c35-4f0e-b0ec-0c60a3771052 req-47013da0-9d48-4912-a811-269e804b120f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437603 Dec 24 05:01:01.307299 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f561e4ff-50fb-43b0-902c-2e5094c093c2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:01.317532 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f561e4ff-50fb-43b0-902c-2e5094c093c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:01.395950 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f561e4ff-50fb-43b0-902c-2e5094c093c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2921c29a-4f84-4a6e-8723-988847e7bbe0,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:01.403503 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 54762) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:01.403902 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-f561e4ff-50fb-43b0-902c-2e5094c093c2 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=3ff32c7bdcb04a629a7d97a982644d6a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3683031 Dec 24 05:01:01.426856 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-6948d8b9-a423-4386-bb5d-608a8570cc5d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:01.428366 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-6948d8b9-a423-4386-bb5d-608a8570cc5d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/networks?id=b92a87f3-957a-4ccb-9b5b-98ad92aebe6e HTTP/1.1" status: 200 len: 815 time: 0.1670613 Dec 24 05:01:01.445556 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-94664da3-e94a-4c35-ae98-cdfc83200090 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/quotas/8f1c3a94f02049e3a76c4fc01fa7a022 HTTP/1.1" status: 200 len: 375 time: 0.0102985 Dec 24 05:01:01.460510 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7d6b19ab-cbc2-4bc2-a191-0bd270877e9c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:01.482515 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7d6b19ab-cbc2-4bc2-a191-0bd270877e9c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:01.499819 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-57d1db54-72ad-4301-9f67-809d70822f1d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=8f1c3a94f02049e3a76c4fc01fa7a022&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0481596 Dec 24 05:01:01.536355 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7d6b19ab-cbc2-4bc2-a191-0bd270877e9c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:01.539104 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7d6b19ab-cbc2-4bc2-a191-0bd270877e9c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:01.540792 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-7d6b19ab-cbc2-4bc2-a191-0bd270877e9c admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/2921c29a-4f84-4a6e-8723-988847e7bbe0 HTTP/1.1" status: 204 len: 168 time: 0.1362317 Dec 24 05:01:01.549596 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d6b19ab-cbc2-4bc2-a191-0bd270877e9c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2921c29a-4f84-4a6e-8723-988847e7bbe0,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:01.607527 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-1637a4c4-9f53-4e8e-8110-5655b7e0820e service neutron] 10.222.0.43 "GET /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1000743 Dec 24 05:01:01.695193 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 54774) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:01.827437 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9f63a5cf-ca1c-4ab3-8b8b-bb8b2575982f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:01.875353 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 54778) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:01.892490 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d303f923-50ed-4c79-be8b-b8da12280b15 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:01.912309 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9f63a5cf-ca1c-4ab3-8b8b-bb8b2575982f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:01.917906 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9f63a5cf-ca1c-4ab3-8b8b-bb8b2575982f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:01.929425 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-e3d41694-652a-4e9a-b606-4b06ce02f560 service neutron] 10.222.0.43 "GET /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3207552 Dec 24 05:01:01.971649 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-9f63a5cf-ca1c-4ab3-8b8b-bb8b2575982f admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=067ad4d8c47c45c8ba2cd170e83c321c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2752354 Dec 24 05:01:01.974485 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 54782) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:01.986508 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f63a5cf-ca1c-4ab3-8b8b-bb8b2575982f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cc2362b4-b8e7-4e2b-b2fb-29ad4bec58ce,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:02.014582 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac046637-3c8b-4596-a7f4-b8252981d7e2 req-5247c451-9745-43e7-afe5-a324d35deda3 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:02.016906 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ac046637-3c8b-4596-a7f4-b8252981d7e2 req-5247c451-9745-43e7-afe5-a324d35deda3 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 946 time: 0.0656540 Dec 24 05:01:02.018532 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d303f923-50ed-4c79-be8b-b8da12280b15 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:02.027420 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d303f923-50ed-4c79-be8b-b8da12280b15 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:02.083133 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ac046637-3c8b-4596-a7f4-b8252981d7e2 req-0a378748-3eb0-46cf-ae8e-cc25b0f48657 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0527060 Dec 24 05:01:02.143807 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d303f923-50ed-4c79-be8b-b8da12280b15 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=43b2d54f-0d00-44dd-be6d-c40246ad097d,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:02.148061 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-d303f923-50ed-4c79-be8b-b8da12280b15 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=563ade72768c4762a48c7004a0285942&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2710948 Dec 24 05:01:02.150887 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 54796) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:02.165361 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e7fb4f40-e585-4c63-8f39-41260dd04c2d req-c2dd9f8e-b8a7-48a0-a609-eaee38d5d560 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 210 time: 0.0612190 Dec 24 05:01:02.169596 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e635510f-2f8f-4aa9-b907-990ff7ac4960 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:02.205101 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e635510f-2f8f-4aa9-b907-990ff7ac4960 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:02.232456 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9f201512-5987-43e5-9773-b2c8dfe0bd51 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:02.255828 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9f201512-5987-43e5-9773-b2c8dfe0bd51 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:02.268094 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e635510f-2f8f-4aa9-b907-990ff7ac4960 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:02.274546 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e635510f-2f8f-4aa9-b907-990ff7ac4960 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:02.278319 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-e635510f-2f8f-4aa9-b907-990ff7ac4960 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/cc2362b4-b8e7-4e2b-b2fb-29ad4bec58ce HTTP/1.1" status: 204 len: 168 time: 0.2991087 Dec 24 05:01:02.295969 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e635510f-2f8f-4aa9-b907-990ff7ac4960 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cc2362b4-b8e7-4e2b-b2fb-29ad4bec58ce,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:02.324715 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9f201512-5987-43e5-9773-b2c8dfe0bd51 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:02.336107 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9f201512-5987-43e5-9773-b2c8dfe0bd51 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:02.337320 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-9f201512-5987-43e5-9773-b2c8dfe0bd51 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/43b2d54f-0d00-44dd-be6d-c40246ad097d HTTP/1.1" status: 204 len: 168 time: 0.1853497 Dec 24 05:01:02.358583 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f201512-5987-43e5-9773-b2c8dfe0bd51 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=43b2d54f-0d00-44dd-be6d-c40246ad097d,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:02.396769 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94e1d030-a63b-47d1-87b8-f851a61d5319 req-7f030929-36ed-4caf-9a7e-aa873f28eb6d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:02.398601 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-94e1d030-a63b-47d1-87b8-f851a61d5319 req-7f030929-36ed-4caf-9a7e-aa873f28eb6d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0822673 Dec 24 05:01:02.460141 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-94e1d030-a63b-47d1-87b8-f851a61d5319 req-3c2211b7-5d46-4fb9-b030-66e3bb686496 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547020 Dec 24 05:01:02.704000 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 54824) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:02.717239 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-dc9f005e-4161-4182-b638-b2b846d553fe admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:02.789622 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-dc9f005e-4161-4182-b638-b2b846d553fe admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:02.794900 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-dc9f005e-4161-4182-b638-b2b846d553fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:02.832576 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-dc9f005e-4161-4182-b638-b2b846d553fe admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=8bb79799c4bf4d1c9ce969806e73435a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1274197 Dec 24 05:01:02.833746 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc9f005e-4161-4182-b638-b2b846d553fe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=02955c82-3d1b-4963-88a8-d86aefdc2904,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:02.835930 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 54830) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:02.886883 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-da2f9fb5-1abd-4d19-9717-bb6368f8c5f7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:02.912448 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-da2f9fb5-1abd-4d19-9717-bb6368f8c5f7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:02.959394 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-da2f9fb5-1abd-4d19-9717-bb6368f8c5f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:02.962478 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-da2f9fb5-1abd-4d19-9717-bb6368f8c5f7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:02.963667 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-da2f9fb5-1abd-4d19-9717-bb6368f8c5f7 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/02955c82-3d1b-4963-88a8-d86aefdc2904 HTTP/1.1" status: 204 len: 168 time: 0.1264522 Dec 24 05:01:02.973546 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da2f9fb5-1abd-4d19-9717-bb6368f8c5f7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=02955c82-3d1b-4963-88a8-d86aefdc2904,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:03.273358 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c0fd6f33-cb47-4730-b084-d0e72f63c8ad req-200a365b-bc7d-4418-8dbc-b537a85d8236 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 210 time: 0.0279565 Dec 24 05:01:03.598820 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9834d725-9a90-4c2d-a2e1-46db6ce6c070 req-669bac29-625d-45d9-ba66-564d6db26a7e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:03.605028 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-9834d725-9a90-4c2d-a2e1-46db6ce6c070 req-669bac29-625d-45d9-ba66-564d6db26a7e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0626767 Dec 24 05:01:03.649751 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-9834d725-9a90-4c2d-a2e1-46db6ce6c070 req-979a0f72-017c-48e3-ab02-9563b01d10dc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428960 Dec 24 05:01:04.366912 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b74b302c-98b2-405f-9dc7-2eb5cb71c87d req-1ca43f36-a8e1-4884-8eda-65fd50d0c16e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 210 time: 0.0255394 Dec 24 05:01:04.779063 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1daf8df3-bdf0-4d99-872a-257477d15e3c req-92ee5227-89e0-4bd6-bfd4-897c2f878459 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:04.780481 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1daf8df3-bdf0-4d99-872a-257477d15e3c req-92ee5227-89e0-4bd6-bfd4-897c2f878459 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0554368 Dec 24 05:01:04.831328 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1daf8df3-bdf0-4d99-872a-257477d15e3c req-bd2b1c99-6e02-4d20-ae79-af7794278dce tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419714 Dec 24 05:01:05.476003 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ee8337da-eee0-4011-8407-195da9a13364 req-075f25b4-f642-416e-bcdf-afded83d897a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 210 time: 0.0303442 Dec 24 05:01:05.968838 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44a4d5d3-60de-432b-94f7-cb3394089a11 req-3e44651c-d2a0-47d0-a8e2-f0e58308efc8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:05.970954 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-44a4d5d3-60de-432b-94f7-cb3394089a11 req-3e44651c-d2a0-47d0-a8e2-f0e58308efc8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0605521 Dec 24 05:01:06.028487 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-44a4d5d3-60de-432b-94f7-cb3394089a11 req-1bb66a43-ae71-4d91-b2f8-0e6b2b1cec75 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0487502 Dec 24 05:01:06.581013 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c2aa40ce-a58d-4c3d-8d54-db611dc76cc7 req-ed5f05de-be4d-47fb-8da2-f50b860dd83c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 210 time: 0.0382142 Dec 24 05:01:06.959582 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-8a11f3f4-9e29-44d2-91de-2287939d9a35 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:06.961365 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-8a11f3f4-9e29-44d2-91de-2287939d9a35 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.46 "GET /v2.0/networks?id=b92a87f3-957a-4ccb-9b5b-98ad92aebe6e HTTP/1.1" status: 200 len: 815 time: 0.1228571 Dec 24 05:01:06.997327 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-3743fd17-7866-4db5-a30d-c6e1eadb2845 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Request body: {'port': {'device_id': 'e93dfa9e-7d0c-4922-9108-dd3b9c6265e2', 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e', 'admin_state_up': True, 'tenant_id': '8f1c3a94f02049e3a76c4fc01fa7a022'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:01:07.118734 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-3743fd17-7866-4db5-a30d-c6e1eadb2845 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Made reservation on behalf of 8f1c3a94f02049e3a76c4fc01fa7a022 for: {'port': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:01:07.122015 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-3743fd17-7866-4db5-a30d-c6e1eadb2845 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:07.216380 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5580d2f-e3c4-405a-9036-21d84d9ebd2d req-151e61a0-df01-4495-b262-60f4e13c0578 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:07.218190 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d5580d2f-e3c4-405a-9036-21d84d9ebd2d req-151e61a0-df01-4495-b262-60f4e13c0578 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.1111355 Dec 24 05:01:07.307554 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d5580d2f-e3c4-405a-9036-21d84d9ebd2d req-6d4a6f30-9f85-404d-8617-5e5d9bb2dc2a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0810711 Dec 24 05:01:07.319940 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-3743fd17-7866-4db5-a30d-c6e1eadb2845 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Allocated IP 172.20.0.9 (b92a87f3-957a-4ccb-9b5b-98ad92aebe6e/9b9ff65f-93c8-4cb1-8a99-961ba0d4beaa/13f44c71-4981-48aa-bff5-6222de8d0cc1) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:01:07.480972 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-3743fd17-7866-4db5-a30d-c6e1eadb2845 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:07.516418 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-3743fd17-7866-4db5-a30d-c6e1eadb2845 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:07.571976 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-3743fd17-7866-4db5-a30d-c6e1eadb2845 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Network b92a87f3-957a-4ccb-9b5b-98ad92aebe6e is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:01:07.579557 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['50d50f46-e761-4fb1-9761-fa48778aa8aa', 'b0bd939a-1211-4ec1-b074-b2767d087f95'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:01:07.580264 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3743fd17-7866-4db5-a30d-c6e1eadb2845 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Pushing event updated for resources: {'Port': ['ID=13f44c71-4981-48aa-bff5-6222de8d0cc1,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:07.583064 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-3743fd17-7866-4db5-a30d-c6e1eadb2845 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:01:07.585489 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-3743fd17-7866-4db5-a30d-c6e1eadb2845 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:01:07.653493 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-3743fd17-7866-4db5-a30d-c6e1eadb2845 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:07.654471 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-3743fd17-7866-4db5-a30d-c6e1eadb2845 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:07.679853 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-3743fd17-7866-4db5-a30d-c6e1eadb2845 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.46 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6878972 Dec 24 05:01:07.721912 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b206b19-1b84-4d67-9c4a-07528b6349c9 req-5d85fdcb-df94-4ce7-aa82-7e3d97dead7c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:07.723475 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1b206b19-1b84-4d67-9c4a-07528b6349c9 req-5d85fdcb-df94-4ce7-aa82-7e3d97dead7c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 931 time: 0.0587602 Dec 24 05:01:07.782899 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1b206b19-1b84-4d67-9c4a-07528b6349c9 req-09a74cc5-4382-434e-b7da-e24cc7e0a4a3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511234 Dec 24 05:01:07.797561 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c822c1b7-1bc1-4c27-b02f-9f4c55dd3577 req-97e41492-8150-40e5-942b-e55f6d518157 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:07.799226 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c822c1b7-1bc1-4c27-b02f-9f4c55dd3577 req-97e41492-8150-40e5-942b-e55f6d518157 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 946 time: 0.0882618 Dec 24 05:01:07.818734 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-fc3f90a5-76f9-46e9-a463-6b09bfec1f2d service neutron] Request body: {'port': {'device_id': 'e93dfa9e-7d0c-4922-9108-dd3b9c6265e2', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81644'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:01:07.877630 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c822c1b7-1bc1-4c27-b02f-9f4c55dd3577 req-827f583c-2ecb-4426-9876-75ab7d699d2e tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0702710 Dec 24 05:01:07.902456 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-fc3f90a5-76f9-46e9-a463-6b09bfec1f2d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:08.412924 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-fc3f90a5-76f9-46e9-a463-6b09bfec1f2d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 13f44c71-4981-48aa-bff5-6222de8d0cc1 {{(pid=102476) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:01:08.421201 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-fc3f90a5-76f9-46e9-a463-6b09bfec1f2d service neutron] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:08.435254 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.provisioning_blocks [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-fc3f90a5-76f9-46e9-a463-6b09bfec1f2d service neutron] Transition to ACTIVE for port object 13f44c71-4981-48aa-bff5-6222de8d0cc1 will not be triggered until provisioned by entity L2. {{(pid=102476) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 24 05:01:08.436015 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77e66ecf-f1ae-4d5c-8d3a-3bab9e1be01d req-b8b54b6c-896b-485f-a612-df454344145e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:08.437587 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-77e66ecf-f1ae-4d5c-8d3a-3bab9e1be01d req-b8b54b6c-896b-485f-a612-df454344145e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0543036 Dec 24 05:01:08.441760 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-fc3f90a5-76f9-46e9-a463-6b09bfec1f2d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:08.489555 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc3f90a5-76f9-46e9-a463-6b09bfec1f2d service neutron] Pushing event updated for resources: {'Port': ['ID=13f44c71-4981-48aa-bff5-6222de8d0cc1,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:08.518061 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-77e66ecf-f1ae-4d5c-8d3a-3bab9e1be01d req-ea3db798-ca81-4ce7-afce-887d2ce88ba7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0613306 Dec 24 05:01:08.586058 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-fc3f90a5-76f9-46e9-a463-6b09bfec1f2d service neutron] Attempting to bind port 13f44c71-4981-48aa-bff5-6222de8d0cc1 on host hv-cinder-81644 for vnic_type normal with profile {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:01:08.586391 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-fc3f90a5-76f9-46e9-a463-6b09bfec1f2d service neutron] Attempting to bind port 13f44c71-4981-48aa-bff5-6222de8d0cc1 by drivers openvswitch,hyperv on host hv-cinder-81644 at level 0 using segments [{'id': '10307c97-e214-473b-b760-bb1b770153ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e'}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:01:08.586714 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-fc3f90a5-76f9-46e9-a463-6b09bfec1f2d service neutron] Attempting to bind port 13f44c71-4981-48aa-bff5-6222de8d0cc1 on network b92a87f3-957a-4ccb-9b5b-98ad92aebe6e {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:01:08.590923 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-fc3f90a5-76f9-46e9-a463-6b09bfec1f2d service neutron] Port 13f44c71-4981-48aa-bff5-6222de8d0cc1 on network b92a87f3-957a-4ccb-9b5b-98ad92aebe6e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81644 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 24 05:01:08.591242 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-fc3f90a5-76f9-46e9-a463-6b09bfec1f2d service neutron] Attempting to bind port 13f44c71-4981-48aa-bff5-6222de8d0cc1 on network b92a87f3-957a-4ccb-9b5b-98ad92aebe6e {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:01:08.596026 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-fc3f90a5-76f9-46e9-a463-6b09bfec1f2d service neutron] Checking agent: {'id': '7a2ffd19-371f-4f7b-a239-eea3b5cfd55b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81644', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'started_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 0, 49), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:01:08.596359 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-fc3f90a5-76f9-46e9-a463-6b09bfec1f2d service neutron] Checking segment: {'id': '10307c97-e214-473b-b760-bb1b770153ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:01:08.596763 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-fc3f90a5-76f9-46e9-a463-6b09bfec1f2d service neutron] Bound using segment: {'id': '10307c97-e214-473b-b760-bb1b770153ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e'} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:01:08.597183 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-fc3f90a5-76f9-46e9-a463-6b09bfec1f2d service neutron] Bound port: 13f44c71-4981-48aa-bff5-6222de8d0cc1, host: hv-cinder-81644, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '10307c97-e214-473b-b760-bb1b770153ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e'}}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:01:08.597534 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-fc3f90a5-76f9-46e9-a463-6b09bfec1f2d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:08.611409 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 55036) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:08.677160 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-fc3f90a5-76f9-46e9-a463-6b09bfec1f2d service neutron] For port 13f44c71-4981-48aa-bff5-6222de8d0cc1, host hv-cinder-81644, cleared binding levels {{(pid=102476) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:01:08.680705 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-fc3f90a5-76f9-46e9-a463-6b09bfec1f2d service neutron] For port 13f44c71-4981-48aa-bff5-6222de8d0cc1, host hv-cinder-81644, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=13f44c71-4981-48aa-bff5-6222de8d0cc1,segment=NetworkSegment(10307c97-e214-473b-b760-bb1b770153ec),segment_id=10307c97-e214-473b-b760-bb1b770153ec)] {{(pid=102476) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:01:08.686351 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-fc3f90a5-76f9-46e9-a463-6b09bfec1f2d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:08.720099 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-fc3f90a5-76f9-46e9-a463-6b09bfec1f2d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:08.720745 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-fc3f90a5-76f9-46e9-a463-6b09bfec1f2d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:08.722473 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-fc3f90a5-76f9-46e9-a463-6b09bfec1f2d service neutron] 10.222.0.46 "PUT /v2.0/ports/13f44c71-4981-48aa-bff5-6222de8d0cc1 HTTP/1.1" status: 200 len: 1093 time: 0.9083445 Dec 24 05:01:08.726736 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e93dfa9e-7d0c-4922-9108-dd3b9c6265e2', 'tag': '13f44c71-4981-48aa-bff5-6222de8d0cc1'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:01:08.729010 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-98c4e352-05b5-4d07-8189-9a4cc30f6316" -d '{"events": [{"name": "network-changed", "server_uuid": "e93dfa9e-7d0c-4922-9108-dd3b9c6265e2", "tag": "13f44c71-4981-48aa-bff5-6222de8d0cc1"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:01:08.733654 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-58b5878e-ef96-4aa0-ad56-a3bbcad0b7d4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:08.755346 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc3f90a5-76f9-46e9-a463-6b09bfec1f2d service neutron] Pushing event updated for resources: {'Port': ['ID=13f44c71-4981-48aa-bff5-6222de8d0cc1,revision_number=3']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:08.764949 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:01:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0f29cbbd-e049-4b00-9cb6-9c551ae58fb2 x-openstack-request-id: req-0f29cbbd-e049-4b00-9cb6-9c551ae58fb2 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:01:08.765336 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e93dfa9e-7d0c-4922-9108-dd3b9c6265e2", "tag": "13f44c71-4981-48aa-bff5-6222de8d0cc1", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:01:08.765742 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-0f29cbbd-e049-4b00-9cb6-9c551ae58fb2 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:01:08.766342 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e93dfa9e-7d0c-4922-9108-dd3b9c6265e2', 'tag': '13f44c71-4981-48aa-bff5-6222de8d0cc1', 'status': 'completed', 'code': 200} Dec 24 05:01:08.811972 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-58b5878e-ef96-4aa0-ad56-a3bbcad0b7d4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:08.816737 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-58b5878e-ef96-4aa0-ad56-a3bbcad0b7d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:08.855345 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-58b5878e-ef96-4aa0-ad56-a3bbcad0b7d4 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=f9ab9739d1554353a42853bbb50dfd54&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2423267 Dec 24 05:01:08.856253 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58b5878e-ef96-4aa0-ad56-a3bbcad0b7d4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3b454b4e-ca5a-41d9-8c16-58017de55b83,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:08.860960 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 55048) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:08.903600 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-381e45e6-85d0-4c60-a55c-8a785d5a7779 req-a3772f79-c313-4987-a1da-ffd77e3103a6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:08.905199 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-381e45e6-85d0-4c60-a55c-8a785d5a7779 req-a3772f79-c313-4987-a1da-ffd77e3103a6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 943 time: 0.0517409 Dec 24 05:01:08.908023 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d0e6ca97-54af-4f48-9e7f-ba488b152d5b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:08.933758 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d0e6ca97-54af-4f48-9e7f-ba488b152d5b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:08.983803 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-381e45e6-85d0-4c60-a55c-8a785d5a7779 req-7c5a656e-d5aa-49cb-87fb-a4e6482fc519 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712054 Dec 24 05:01:09.017678 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d0e6ca97-54af-4f48-9e7f-ba488b152d5b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:09.020401 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d0e6ca97-54af-4f48-9e7f-ba488b152d5b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:09.024601 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-d0e6ca97-54af-4f48-9e7f-ba488b152d5b admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/3b454b4e-ca5a-41d9-8c16-58017de55b83 HTTP/1.1" status: 204 len: 168 time: 0.1625445 Dec 24 05:01:09.042975 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0e6ca97-54af-4f48-9e7f-ba488b152d5b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b454b4e-ca5a-41d9-8c16-58017de55b83,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:09.063892 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24f59b7c-53de-4000-b667-ac189d82fad4 req-e6b5d84e-6e98-455e-a80d-f9a1ae26d517 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:09.063892 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-24f59b7c-53de-4000-b667-ac189d82fad4 req-e6b5d84e-6e98-455e-a80d-f9a1ae26d517 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 946 time: 0.0748608 Dec 24 05:01:09.108197 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c4e352-05b5-4d07-8189-9a4cc30f6316 req-710f66f6-dcd5-4c6d-95ab-485fbd1a75ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:09.109892 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-98c4e352-05b5-4d07-8189-9a4cc30f6316 req-710f66f6-dcd5-4c6d-95ab-485fbd1a75ac service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=8f1c3a94f02049e3a76c4fc01fa7a022&device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 1096 time: 0.0742896 Dec 24 05:01:09.112820 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-24f59b7c-53de-4000-b667-ac189d82fad4 req-11e9160b-282a-46d9-90d1-b0f8e7696668 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496161 Dec 24 05:01:09.229502 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c4e352-05b5-4d07-8189-9a4cc30f6316 req-529ba739-ae9e-4b53-8189-a043a3d76b07 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:09.230960 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-98c4e352-05b5-4d07-8189-9a4cc30f6316 req-529ba739-ae9e-4b53-8189-a043a3d76b07 service neutron] 10.222.0.46 "GET /v2.0/networks?tenant_id=8f1c3a94f02049e3a76c4fc01fa7a022&shared=False HTTP/1.1" status: 200 len: 916 time: 0.1008701 Dec 24 05:01:09.344209 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 55064) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:09.357365 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ce9568b0-ec26-46ac-a7ed-abd754347f39 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:09.436181 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ce9568b0-ec26-46ac-a7ed-abd754347f39 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:09.442634 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ce9568b0-ec26-46ac-a7ed-abd754347f39 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:09.480689 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-ce9568b0-ec26-46ac-a7ed-abd754347f39 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=77e96adc90b34eb3b1a7fa92ccfb2d0d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1353316 Dec 24 05:01:09.481575 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce9568b0-ec26-46ac-a7ed-abd754347f39 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0ff0fcb3-c4be-4afc-8bfd-56169dc1abb4,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:09.483921 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 55066) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:09.532920 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-fa2c9401-d2d3-425d-b31f-41d45f00f097 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:09.555167 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-fa2c9401-d2d3-425d-b31f-41d45f00f097 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:09.602974 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-fa2c9401-d2d3-425d-b31f-41d45f00f097 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:09.605842 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-fa2c9401-d2d3-425d-b31f-41d45f00f097 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:09.609723 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-fa2c9401-d2d3-425d-b31f-41d45f00f097 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/0ff0fcb3-c4be-4afc-8bfd-56169dc1abb4 HTTP/1.1" status: 204 len: 168 time: 0.1219697 Dec 24 05:01:09.615773 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa2c9401-d2d3-425d-b31f-41d45f00f097 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0ff0fcb3-c4be-4afc-8bfd-56169dc1abb4,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:09.626210 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a163650d-624a-4a9e-87fe-9e9c61cc7dce req-25026ff2-700f-4602-86a7-09cff6eeb341 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:09.627710 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a163650d-624a-4a9e-87fe-9e9c61cc7dce req-25026ff2-700f-4602-86a7-09cff6eeb341 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0510638 Dec 24 05:01:09.679089 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a163650d-624a-4a9e-87fe-9e9c61cc7dce req-f889182e-6e62-44cb-8d18-979b03259131 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449593 Dec 24 05:01:10.120276 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2d2f5b0-dd00-465b-a855-939486dcf060 req-0b306d88-306f-44bd-9d49-a222203db41b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:10.121806 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e2d2f5b0-dd00-465b-a855-939486dcf060 req-0b306d88-306f-44bd-9d49-a222203db41b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 943 time: 0.0591245 Dec 24 05:01:10.169514 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e2d2f5b0-dd00-465b-a855-939486dcf060 req-9810a2ad-ebbc-432b-bf14-50c5ebd7180b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417259 Dec 24 05:01:10.271760 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7e17f2a-eb87-4965-b486-286db86ce773 req-7f2dbafe-c73e-4add-bdee-d5ead1a05132 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:10.273380 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c7e17f2a-eb87-4965-b486-286db86ce773 req-7f2dbafe-c73e-4add-bdee-d5ead1a05132 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 946 time: 0.0491428 Dec 24 05:01:10.320626 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c7e17f2a-eb87-4965-b486-286db86ce773 req-80a5494c-a95e-4dba-9edb-b2b16d7da24d tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411751 Dec 24 05:01:10.740544 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 55118) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:10.802830 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1efa1500-6b87-4460-aae7-5cb9bb7f857c req-6fa22391-c72f-4fe8-82c6-6b90b8e55cac tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:10.804207 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1efa1500-6b87-4460-aae7-5cb9bb7f857c req-6fa22391-c72f-4fe8-82c6-6b90b8e55cac tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0519326 Dec 24 05:01:10.849275 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-410fb826-24a5-4f56-b7b6-1d81215eacd3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:10.852922 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1efa1500-6b87-4460-aae7-5cb9bb7f857c req-1390958c-deda-4ff7-9f86-3205d100d551 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424449 Dec 24 05:01:10.926739 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-410fb826-24a5-4f56-b7b6-1d81215eacd3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:10.931663 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-410fb826-24a5-4f56-b7b6-1d81215eacd3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:10.969842 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-410fb826-24a5-4f56-b7b6-1d81215eacd3 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=3d6cb4e1721a417ea95ef38bb3ee1d10&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2282135 Dec 24 05:01:10.970660 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-410fb826-24a5-4f56-b7b6-1d81215eacd3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c9ac3e3c-a40c-46fa-840a-2f6c7191eb4b,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:10.972771 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 55126) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:11.027474 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c8390df1-5748-46a2-b5c6-c371d4e2910d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:11.049549 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c8390df1-5748-46a2-b5c6-c371d4e2910d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:11.099958 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c8390df1-5748-46a2-b5c6-c371d4e2910d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:11.103133 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c8390df1-5748-46a2-b5c6-c371d4e2910d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:11.104729 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-c8390df1-5748-46a2-b5c6-c371d4e2910d admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/c9ac3e3c-a40c-46fa-840a-2f6c7191eb4b HTTP/1.1" status: 204 len: 168 time: 0.1308563 Dec 24 05:01:11.112950 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8390df1-5748-46a2-b5c6-c371d4e2910d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c9ac3e3c-a40c-46fa-840a-2f6c7191eb4b,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:11.295519 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c17183a7-9872-4f94-ab1c-0cd3fc403525 req-fa6446c1-ed26-459f-ad21-21d7ce373cc0 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:11.297204 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c17183a7-9872-4f94-ab1c-0cd3fc403525 req-fa6446c1-ed26-459f-ad21-21d7ce373cc0 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 943 time: 0.0509095 Dec 24 05:01:11.353726 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c17183a7-9872-4f94-ab1c-0cd3fc403525 req-91d166bc-3f8a-4452-b430-d53194e3836e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496590 Dec 24 05:01:11.457755 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e7e7ec-0e31-460e-adf5-ab998055d024 req-29896417-3107-44d4-ac63-24c3ae1a90f7 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:11.459261 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d2e7e7ec-0e31-460e-adf5-ab998055d024 req-29896417-3107-44d4-ac63-24c3ae1a90f7 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 946 time: 0.0523608 Dec 24 05:01:11.508093 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d2e7e7ec-0e31-460e-adf5-ab998055d024 req-86fc5118-b68d-43bd-bf27-eee603030aa7 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420802 Dec 24 05:01:11.976784 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dfe755f-0ec2-4032-8a45-9322c3d2aff8 req-0170070e-2d5e-4482-bb27-a3ab9c326132 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:11.979003 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3dfe755f-0ec2-4032-8a45-9322c3d2aff8 req-0170070e-2d5e-4482-bb27-a3ab9c326132 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0561090 Dec 24 05:01:12.028428 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3dfe755f-0ec2-4032-8a45-9322c3d2aff8 req-2d40f097-97b7-41bf-ab3c-7067e5fd517f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432224 Dec 24 05:01:12.488119 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f2447d8-8a23-461a-be44-61a50a8f3405 req-db2d938f-f7fd-4da5-b998-b1122aebe781 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:12.489618 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5f2447d8-8a23-461a-be44-61a50a8f3405 req-db2d938f-f7fd-4da5-b998-b1122aebe781 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 943 time: 0.0640931 Dec 24 05:01:12.539910 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5f2447d8-8a23-461a-be44-61a50a8f3405 req-dca80fa1-8480-40c0-90f0-e9e03dbe1c69 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407701 Dec 24 05:01:12.646112 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2c1b254-7d38-49ad-a336-cfcae556852a req-584cc67a-fb9f-4384-a1c4-01091a53ed9d tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:12.647497 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d2c1b254-7d38-49ad-a336-cfcae556852a req-584cc67a-fb9f-4384-a1c4-01091a53ed9d tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 946 time: 0.0513959 Dec 24 05:01:12.698543 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d2c1b254-7d38-49ad-a336-cfcae556852a req-c5353540-e6a6-4472-b5de-f970db8d6462 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421531 Dec 24 05:01:12.826690 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c4e352-05b5-4d07-8189-9a4cc30f6316 req-d94f76dd-5f89-403c-8d0b-6c426bd357bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:12.828439 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-98c4e352-05b5-4d07-8189-9a4cc30f6316 req-d94f76dd-5f89-403c-8d0b-6c426bd357bd service neutron] 10.222.0.46 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0937486 Dec 24 05:01:13.155640 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d555bcd1-1b46-4806-8608-48e4dfd56244 req-f72b8d91-70f7-4238-8885-14b803979341 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:13.157299 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d555bcd1-1b46-4806-8608-48e4dfd56244 req-f72b8d91-70f7-4238-8885-14b803979341 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0565641 Dec 24 05:01:13.224261 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0167f625-a01f-4950-a1cc-e3dd0667a33d req-00fa00cb-c320-417a-8993-01c7461177f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:13.224261 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0167f625-a01f-4950-a1cc-e3dd0667a33d req-00fa00cb-c320-417a-8993-01c7461177f1 service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 1099 time: 0.0697148 Dec 24 05:01:13.226052 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d555bcd1-1b46-4806-8608-48e4dfd56244 req-83f0a76c-1d1f-4dc1-91f2-f7db819da764 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0622718 Dec 24 05:01:13.226555 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-15de8635-94e5-4a58-a7f0-60791f3a8531 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:13.227999 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-15de8635-94e5-4a58-a7f0-60791f3a8531 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=8f1c3a94f02049e3a76c4fc01fa7a022&device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 1096 time: 0.0860837 Dec 24 05:01:13.294964 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-13b27026-7775-4761-8265-93537f415e60 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=13f44c71-4981-48aa-bff5-6222de8d0cc1 HTTP/1.1" status: 200 len: 217 time: 0.0430260 Dec 24 05:01:13.350240 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0167f625-a01f-4950-a1cc-e3dd0667a33d req-fc1906dd-f5e8-46f6-b2b4-2da07a3f7025 service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1046510 Dec 24 05:01:13.361457 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-af746b5e-9d08-45fd-8354-3bd095fad68f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:13.363546 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-af746b5e-9d08-45fd-8354-3bd095fad68f service neutron] 10.222.0.46 "GET /v2.0/subnets?id=9b9ff65f-93c8-4cb1-8a99-961ba0d4beaa HTTP/1.1" status: 200 len: 855 time: 0.0588174 Dec 24 05:01:13.659878 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-101d4d96-d2f1-406f-b900-3385badc09b4 req-e54a5f0a-3820-4018-8fca-f2cca8467061 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:13.661496 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-101d4d96-d2f1-406f-b900-3385badc09b4 req-e54a5f0a-3820-4018-8fca-f2cca8467061 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 943 time: 0.0538502 Dec 24 05:01:13.715051 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-101d4d96-d2f1-406f-b900-3385badc09b4 req-fe66d987-3ec3-4f76-904e-430637c0dd86 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475030 Dec 24 05:01:13.825081 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28b87017-4780-4438-836f-63851f59d11f req-95ac0007-ef55-43a2-8902-9180a525b230 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:13.826606 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-28b87017-4780-4438-836f-63851f59d11f req-95ac0007-ef55-43a2-8902-9180a525b230 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 946 time: 0.0526378 Dec 24 05:01:13.877425 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-28b87017-4780-4438-836f-63851f59d11f req-f7712b94-3075-4c3b-849c-25575639f703 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441084 Dec 24 05:01:13.996438 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-a9b79e54-87bd-49c4-9383-660cbe2fe6e0 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=b92a87f3-957a-4ccb-9b5b-98ad92aebe6e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0320361 Dec 24 05:01:14.108183 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-1e2a40f4-e45d-4463-ac0f-d98e18214dc2 service neutron] 10.222.0.46 "GET /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0899460 Dec 24 05:01:14.342898 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce64a35b-d985-4154-9342-f5b5b877898f req-ab7d989e-6ae4-414e-bdc7-26536e7884ea tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:14.344418 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ce64a35b-d985-4154-9342-f5b5b877898f req-ab7d989e-6ae4-414e-bdc7-26536e7884ea tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0508235 Dec 24 05:01:14.396356 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ce64a35b-d985-4154-9342-f5b5b877898f req-7f27ff00-6a6b-449e-86ac-87c0e831f328 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454650 Dec 24 05:01:14.812110 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1237762b-b812-4bd7-b20d-619afe3e3f0c req-f9c7e696-246e-431f-87d9-d3b46911e1b2 service neutron] 10.222.0.46 "GET /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0963619 Dec 24 05:01:14.837269 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb098bac-f3a4-4e08-8f7c-09056239cd38 req-ef5a4f5c-e023-4ecd-bfa7-65f5e8f660a0 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:14.839420 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-fb098bac-f3a4-4e08-8f7c-09056239cd38 req-ef5a4f5c-e023-4ecd-bfa7-65f5e8f660a0 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 943 time: 0.0507553 Dec 24 05:01:14.892542 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-fb098bac-f3a4-4e08-8f7c-09056239cd38 req-430d4902-a3ac-42d5-a5cf-44f20eaf20af tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446799 Dec 24 05:01:15.006643 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fedf13a1-22ac-4fff-a819-ba214a11e8d6 req-0a2d1250-636a-4ec8-8f42-b149d5b12608 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:15.008025 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-fedf13a1-22ac-4fff-a819-ba214a11e8d6 req-0a2d1250-636a-4ec8-8f42-b149d5b12608 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 946 time: 0.0559094 Dec 24 05:01:15.061145 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-fedf13a1-22ac-4fff-a819-ba214a11e8d6 req-e1d21dc5-9144-4093-aaec-b6141572ac38 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461559 Dec 24 05:01:15.518600 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fd4ac01-0160-4a9d-b435-a3a057905753 req-fa39665b-dc7a-49a5-9966-afe86a8c2678 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:15.525684 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9fd4ac01-0160-4a9d-b435-a3a057905753 req-fa39665b-dc7a-49a5-9966-afe86a8c2678 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0596375 Dec 24 05:01:15.568893 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9fd4ac01-0160-4a9d-b435-a3a057905753 req-3a3760ed-b2db-463a-9b20-fcde3fc6c495 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423245 Dec 24 05:01:15.621809 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 55272) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:15.621956 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 55274) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:15.737388 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-558ad274-1d72-4b5d-8536-19cac0e7d5c4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:15.739436 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7e2bbab2-eaab-4b3c-86d9-87a256e490fe admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:15.814947 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7e2bbab2-eaab-4b3c-86d9-87a256e490fe admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:15.815157 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-558ad274-1d72-4b5d-8536-19cac0e7d5c4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:15.820837 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7e2bbab2-eaab-4b3c-86d9-87a256e490fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:15.822034 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-558ad274-1d72-4b5d-8536-19cac0e7d5c4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:15.859574 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e2bbab2-eaab-4b3c-86d9-87a256e490fe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b637c47-e70f-440b-ac4f-fc57fe4710d6,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:15.862768 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-558ad274-1d72-4b5d-8536-19cac0e7d5c4 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=9ef3eae52dae493e8ecc57504836d7f0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2396472 Dec 24 05:01:15.864357 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-558ad274-1d72-4b5d-8536-19cac0e7d5c4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a04e7733-6276-4aab-8ae9-42521f6cea3c,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:15.866622 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 55282) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:15.866870 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-7e2bbab2-eaab-4b3c-86d9-87a256e490fe admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=ba66883669904fcb843534f93dfdb65e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2436020 Dec 24 05:01:15.869410 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 55284) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:15.926714 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-08203465-4f99-4f04-bd0b-914c6a88661f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:15.935795 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-5d5441dc-07d0-46f0-a1eb-f85c8639a390 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:15.963953 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-5d5441dc-07d0-46f0-a1eb-f85c8639a390 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:15.965477 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-08203465-4f99-4f04-bd0b-914c6a88661f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:16.015815 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-5d5441dc-07d0-46f0-a1eb-f85c8639a390 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:16.019067 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-5d5441dc-07d0-46f0-a1eb-f85c8639a390 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:16.023335 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-5d5441dc-07d0-46f0-a1eb-f85c8639a390 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/1b637c47-e70f-440b-ac4f-fc57fe4710d6 HTTP/1.1" status: 204 len: 168 time: 0.1505525 Dec 24 05:01:16.042334 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d5441dc-07d0-46f0-a1eb-f85c8639a390 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b637c47-e70f-440b-ac4f-fc57fe4710d6,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:16.061307 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53b87163-d88f-4b53-81c9-bbafb6cb9368 req-02dd0aa8-17a5-467d-aa93-49cdfcbc953d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:16.062800 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-53b87163-d88f-4b53-81c9-bbafb6cb9368 req-02dd0aa8-17a5-467d-aa93-49cdfcbc953d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 943 time: 0.0956318 Dec 24 05:01:16.088420 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-08203465-4f99-4f04-bd0b-914c6a88661f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:16.090966 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-08203465-4f99-4f04-bd0b-914c6a88661f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:16.092084 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-08203465-4f99-4f04-bd0b-914c6a88661f admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/a04e7733-6276-4aab-8ae9-42521f6cea3c HTTP/1.1" status: 204 len: 168 time: 0.2245626 Dec 24 05:01:16.105813 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08203465-4f99-4f04-bd0b-914c6a88661f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a04e7733-6276-4aab-8ae9-42521f6cea3c,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:16.130741 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-53b87163-d88f-4b53-81c9-bbafb6cb9368 req-dbe9a243-2e35-4b2c-af50-00b9ecd59ffc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0557904 Dec 24 05:01:16.251761 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e9fa5cc-e80a-4a16-be92-1c24a6c2b8f8 req-49e215b3-6ae2-42b1-8dd3-71ffd10e1da8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:16.253360 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9e9fa5cc-e80a-4a16-be92-1c24a6c2b8f8 req-49e215b3-6ae2-42b1-8dd3-71ffd10e1da8 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 946 time: 0.0567091 Dec 24 05:01:16.307806 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9e9fa5cc-e80a-4a16-be92-1c24a6c2b8f8 req-3ad82130-9e94-4494-992a-026a086ff6bd tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469019 Dec 24 05:01:16.692168 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d17a773-85b1-447c-8d89-73fcf5057de7 req-b75800c4-2431-4795-8d6b-680f3a6a4ef3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:16.693749 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1d17a773-85b1-447c-8d89-73fcf5057de7 req-b75800c4-2431-4795-8d6b-680f3a6a4ef3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0527477 Dec 24 05:01:16.745250 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1d17a773-85b1-447c-8d89-73fcf5057de7 req-0455ca96-0cc3-4028-87e1-b405415a6cc0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443349 Dec 24 05:01:17.268645 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90e0d264-3b08-4160-a461-fa56246e320b req-508e679c-5b80-472b-b90d-de794a0b8eeb tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:17.270744 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-90e0d264-3b08-4160-a461-fa56246e320b req-508e679c-5b80-472b-b90d-de794a0b8eeb tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 943 time: 0.0589721 Dec 24 05:01:17.324087 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-90e0d264-3b08-4160-a461-fa56246e320b req-23366b70-1dd7-4f42-8f86-406414677156 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475333 Dec 24 05:01:17.444075 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4fcfb7d-2f17-44a9-b121-8bfbc61fcecc req-63487c4e-5d8a-4c8b-98c9-5abc3218f66d tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:17.445730 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c4fcfb7d-2f17-44a9-b121-8bfbc61fcecc req-63487c4e-5d8a-4c8b-98c9-5abc3218f66d tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 946 time: 0.0549650 Dec 24 05:01:17.495067 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c4fcfb7d-2f17-44a9-b121-8bfbc61fcecc req-c42be832-13cd-43ae-a7e8-74d9d98dbda5 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424378 Dec 24 05:01:17.860921 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0094f68c-c059-4ee1-8919-1c8849a413e2 req-a6aa307f-df41-4324-9635-45776cb0c72c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:17.862569 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0094f68c-c059-4ee1-8919-1c8849a413e2 req-a6aa307f-df41-4324-9635-45776cb0c72c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0505450 Dec 24 05:01:17.909791 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0094f68c-c059-4ee1-8919-1c8849a413e2 req-2422bd3c-ddb4-4871-a860-277691caf1f8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411468 Dec 24 05:01:18.413396 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:01:18.458031 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cf84114-5aae-4c20-82da-326dc8584632 req-613e232a-6656-4c94-8fc0-fabde7cf5de3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:18.459499 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7cf84114-5aae-4c20-82da-326dc8584632 req-613e232a-6656-4c94-8fc0-fabde7cf5de3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 943 time: 0.0636673 Dec 24 05:01:18.505950 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7cf84114-5aae-4c20-82da-326dc8584632 req-6f11ba40-2429-4ee2-9f2c-6b34f5e8f976 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400553 Dec 24 05:01:18.613413 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0e30e9c-57ba-487d-bcb7-1629221b2dce req-e4a879b9-a6c5-475e-8eac-c976be62d0a7 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:18.614807 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c0e30e9c-57ba-487d-bcb7-1629221b2dce req-e4a879b9-a6c5-475e-8eac-c976be62d0a7 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 946 time: 0.0501995 Dec 24 05:01:18.664272 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c0e30e9c-57ba-487d-bcb7-1629221b2dce req-e24c10cc-c949-4bf9-8c48-d8b715fbc68f tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432308 Dec 24 05:01:19.054076 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f7dff89-a773-40cc-abce-0af7d6412610 req-cb1bb734-3e0a-4c16-9c34-1681628f6c82 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:19.055546 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8f7dff89-a773-40cc-abce-0af7d6412610 req-cb1bb734-3e0a-4c16-9c34-1681628f6c82 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0665977 Dec 24 05:01:19.112002 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8f7dff89-a773-40cc-abce-0af7d6412610 req-bb0024a1-aff7-4891-9f9c-64ba5a3f56a8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499589 Dec 24 05:01:19.419336 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:19.460567 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3efb3510-bb89-438d-a524-d49acc71c124 req-bf0b02a8-fe66-4271-926b-d6d131bf740e service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0670972 Dec 24 05:01:19.472221 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35f6715f-17db-4fc4-8c3c-bed4c90729b5 req-8610f66d-f373-4c17-a020-c581a32e5f01 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:19.473647 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-35f6715f-17db-4fc4-8c3c-bed4c90729b5 req-8610f66d-f373-4c17-a020-c581a32e5f01 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.46 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 946 time: 0.0795388 Dec 24 05:01:19.622045 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ef17832-7255-4a2c-96c8-45c5eb7590e1 req-ded6786a-7737-4ad2-b5c1-f210669bab7d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:19.623625 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0ef17832-7255-4a2c-96c8-45c5eb7590e1 req-ded6786a-7737-4ad2-b5c1-f210669bab7d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 943 time: 0.0507503 Dec 24 05:01:19.673710 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0ef17832-7255-4a2c-96c8-45c5eb7590e1 req-88c3a5cc-857a-434c-b0d2-24152b30f9d8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435700 Dec 24 05:01:19.786430 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45c8a83c-7e80-446a-af52-39eb282d4521 req-4b4cd85f-b4c2-49ad-a9f1-4dcf2f494eae tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:19.788175 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-45c8a83c-7e80-446a-af52-39eb282d4521 req-4b4cd85f-b4c2-49ad-a9f1-4dcf2f494eae tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 946 time: 0.0521407 Dec 24 05:01:19.801764 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3efb3510-bb89-438d-a524-d49acc71c124 req-a6b30c06-cd2d-4800-8e2c-a2856c651806 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:19.803232 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3efb3510-bb89-438d-a524-d49acc71c124 req-a6b30c06-cd2d-4800-8e2c-a2856c651806 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=8f1c3a94f02049e3a76c4fc01fa7a022&device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 1099 time: 0.0741119 Dec 24 05:01:19.822385 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-35f6715f-17db-4fc4-8c3c-bed4c90729b5 req-29334070-37bd-45b9-8f40-c54f72752bff tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Deleting port 639654f0-9663-4da1-8410-7e554500497a {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:01:19.822845 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-35f6715f-17db-4fc4-8c3c-bed4c90729b5 req-29334070-37bd-45b9-8f40-c54f72752bff tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:19.836500 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-45c8a83c-7e80-446a-af52-39eb282d4521 req-fbfa27b1-2fec-44c9-aa3d-6449d244388b tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/security-groups?id=4e2bef2c-8155-47f6-8213-b403361d85dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419865 Dec 24 05:01:19.979696 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-35f6715f-17db-4fc4-8c3c-bed4c90729b5 req-29334070-37bd-45b9-8f40-c54f72752bff tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] For port 639654f0-9663-4da1-8410-7e554500497a, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=639654f0-9663-4da1-8410-7e554500497a,segment=NetworkSegment(00999af0-b9ae-4a2b-9c30-590dbe00c43a),segment_id=00999af0-b9ae-4a2b-9c30-590dbe00c43a)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:01:19.980069 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-35f6715f-17db-4fc4-8c3c-bed4c90729b5 req-29334070-37bd-45b9-8f40-c54f72752bff tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:19.989925 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3efb3510-bb89-438d-a524-d49acc71c124 req-a2339225-1136-45fe-be97-660a948626fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:19.991424 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3efb3510-bb89-438d-a524-d49acc71c124 req-a2339225-1136-45fe-be97-660a948626fd service neutron] 10.222.0.46 "GET /v2.0/networks?id=b92a87f3-957a-4ccb-9b5b-98ad92aebe6e HTTP/1.1" status: 200 len: 916 time: 0.1641672 Dec 24 05:01:19.995787 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-35f6715f-17db-4fc4-8c3c-bed4c90729b5 req-29334070-37bd-45b9-8f40-c54f72752bff tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Calling delete_port for 639654f0-9663-4da1-8410-7e554500497a owned by compute:nova {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:01:20.042128 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3efb3510-bb89-438d-a524-d49acc71c124 req-69915aee-30ee-4164-8e58-8ee79416dd9a service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=50d50f46-e761-4fb1-9761-fa48778aa8aa HTTP/1.1" status: 200 len: 217 time: 0.0404055 Dec 24 05:01:20.131677 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3efb3510-bb89-438d-a524-d49acc71c124 req-82f23f98-d390-4b43-a4c6-1e10bd4e34f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:20.133182 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3efb3510-bb89-438d-a524-d49acc71c124 req-82f23f98-d390-4b43-a4c6-1e10bd4e34f9 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=9b9ff65f-93c8-4cb1-8a99-961ba0d4beaa HTTP/1.1" status: 200 len: 855 time: 0.0651531 Dec 24 05:01:20.174785 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3efb3510-bb89-438d-a524-d49acc71c124 req-fa15a7d2-fbea-4833-a92a-7882ca64c7bd service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=b92a87f3-957a-4ccb-9b5b-98ad92aebe6e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0284340 Dec 24 05:01:20.300605 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-35f6715f-17db-4fc4-8c3c-bed4c90729b5 req-29334070-37bd-45b9-8f40-c54f72752bff tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:20.345432 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3aaf5ce-3fdc-43de-951a-c78f2b35ead5 req-98513862-7118-418f-b50d-bd051e2c6291 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:20.346080 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['639654f0-9663-4da1-8410-7e554500497a'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:01:20.347065 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a3aaf5ce-3fdc-43de-951a-c78f2b35ead5 req-98513862-7118-418f-b50d-bd051e2c6291 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.1511004 Dec 24 05:01:20.353592 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29334070-37bd-45b9-8f40-c54f72752bff tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Pushing event deleted for resources: {'Port': ['ID=639654f0-9663-4da1-8410-7e554500497a,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:20.377566 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3efb3510-bb89-438d-a524-d49acc71c124 req-1c320faf-295b-4970-9683-c351a19c80b6 service neutron] 10.222.0.46 "GET /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1827836 Dec 24 05:01:20.438552 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-35f6715f-17db-4fc4-8c3c-bed4c90729b5 req-29334070-37bd-45b9-8f40-c54f72752bff tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] No DVR routers for this DVR port 639654f0-9663-4da1-8410-7e554500497a on host hv-cinder-81644 {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:01:20.465845 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-35f6715f-17db-4fc4-8c3c-bed4c90729b5 req-29334070-37bd-45b9-8f40-c54f72752bff tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:20.469562 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-35f6715f-17db-4fc4-8c3c-bed4c90729b5 req-29334070-37bd-45b9-8f40-c54f72752bff tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.46 "DELETE /v2.0/ports/639654f0-9663-4da1-8410-7e554500497a HTTP/1.1" status: 204 len: 173 time: 0.7650669 Dec 24 05:01:20.470179 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'df4a8b5b-4054-465a-81a5-1e3cd5b5997b', 'name': 'network-vif-deleted', 'tag': '639654f0-9663-4da1-8410-7e554500497a'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:01:20.472821 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d39888f8-583c-44fb-84bf-1698e5b72d7e" -d '{"events": [{"server_uuid": "df4a8b5b-4054-465a-81a5-1e3cd5b5997b", "name": "network-vif-deleted", "tag": "639654f0-9663-4da1-8410-7e554500497a"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:01:20.509632 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a3aaf5ce-3fdc-43de-951a-c78f2b35ead5 req-9b818444-8179-4a72-bc92-f21e87fcd7ec tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1538763 Dec 24 05:01:20.536383 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3efb3510-bb89-438d-a524-d49acc71c124 req-67ad6360-a585-46b6-9aec-28726b00d474 service neutron] 10.222.0.46 "GET /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1372375 Dec 24 05:01:20.558874 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:01:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4c33d76a-8292-4390-8f52-fec3dcc7bdb0 x-openstack-request-id: req-4c33d76a-8292-4390-8f52-fec3dcc7bdb0 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:01:20.559176 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "df4a8b5b-4054-465a-81a5-1e3cd5b5997b", "name": "network-vif-deleted", "tag": "639654f0-9663-4da1-8410-7e554500497a", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:01:20.559440 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-4c33d76a-8292-4390-8f52-fec3dcc7bdb0 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:01:20.559832 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'df4a8b5b-4054-465a-81a5-1e3cd5b5997b', 'name': 'network-vif-deleted', 'tag': '639654f0-9663-4da1-8410-7e554500497a', 'status': 'completed', 'code': 200} Dec 24 05:01:20.837803 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19ba8e58-0ebd-41bd-9263-3c929a207a1f req-150781ee-1bb7-4315-b8de-ddfcc3a3dac2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:20.839332 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-19ba8e58-0ebd-41bd-9263-3c929a207a1f req-150781ee-1bb7-4315-b8de-ddfcc3a3dac2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 943 time: 0.0595679 Dec 24 05:01:20.886415 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-19ba8e58-0ebd-41bd-9263-3c929a207a1f req-4a3ca874-8d83-4542-9156-d328668c7214 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410433 Dec 24 05:01:20.946821 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-37670cdb-ac95-4db1-8b8e-8e456f36fe3c req-5a4e1683-7ec1-4f6a-8b68-19ecb5700150 tempest-VolumesActionsTest-686724975 tempest-VolumesActionsTest-686724975-project] 10.222.0.43 "GET /v2.0/ports?device_id=df4a8b5b-4054-465a-81a5-1e3cd5b5997b HTTP/1.1" status: 200 len: 210 time: 0.0266120 Dec 24 05:01:21.632612 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fdd9e17-44f6-4472-835c-beeb9e8816d1 req-e7dea7be-5d95-40b2-aa4e-ff4092583625 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:21.634364 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3fdd9e17-44f6-4472-835c-beeb9e8816d1 req-e7dea7be-5d95-40b2-aa4e-ff4092583625 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0551004 Dec 24 05:01:21.690333 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3fdd9e17-44f6-4472-835c-beeb9e8816d1 req-6f54c28e-d066-4281-9336-13ee3b06c3fd tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0490344 Dec 24 05:01:21.816461 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fbea9ac-8957-4970-8116-7502b8d91e3a req-3715d3cd-8674-4f32-bb2b-13aebdcf4516 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:21.818044 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8fbea9ac-8957-4970-8116-7502b8d91e3a req-3715d3cd-8674-4f32-bb2b-13aebdcf4516 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0546327 Dec 24 05:01:21.865943 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8fbea9ac-8957-4970-8116-7502b8d91e3a req-33e9b61e-6b42-4b6e-9c39-799597c824e6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420356 Dec 24 05:01:22.003344 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c27b0c03-2a31-4924-ac72-6119dd86f55b req-da3e5e8a-dfaa-4045-b8d5-87413417d539 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:22.004795 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c27b0c03-2a31-4924-ac72-6119dd86f55b req-da3e5e8a-dfaa-4045-b8d5-87413417d539 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 943 time: 0.0494766 Dec 24 05:01:22.057067 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c27b0c03-2a31-4924-ac72-6119dd86f55b req-9a341f8e-4bf6-41a5-b0f1-6a00637e85a4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452027 Dec 24 05:01:22.620309 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 55506) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:22.737667 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-044f193e-568d-43eb-8f63-892ed90575aa admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:22.812419 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-044f193e-568d-43eb-8f63-892ed90575aa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:22.820589 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-044f193e-568d-43eb-8f63-892ed90575aa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:22.869449 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-044f193e-568d-43eb-8f63-892ed90575aa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fa1bb773-b224-4263-94b3-29cef321f55a,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:22.874719 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-044f193e-568d-43eb-8f63-892ed90575aa admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=b6021dab557e4689b5974aca588777dd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2523310 Dec 24 05:01:22.877730 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 55534) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:22.923228 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-3cd7db51-371a-4c2a-9aa2-51eb156564bf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:22.949760 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-3cd7db51-371a-4c2a-9aa2-51eb156564bf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:23.008089 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-3cd7db51-371a-4c2a-9aa2-51eb156564bf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:23.010682 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-3cd7db51-371a-4c2a-9aa2-51eb156564bf admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:23.011843 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-3cd7db51-371a-4c2a-9aa2-51eb156564bf admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/fa1bb773-b224-4263-94b3-29cef321f55a HTTP/1.1" status: 204 len: 168 time: 0.1333272 Dec 24 05:01:23.019875 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cd7db51-371a-4c2a-9aa2-51eb156564bf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fa1bb773-b224-4263-94b3-29cef321f55a,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:23.180932 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e7c0763-2e4f-4c7f-b7db-2bec34e3efbd req-5dbb5b3b-149c-4a98-843c-8cedc4a40e52 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:23.182505 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1e7c0763-2e4f-4c7f-b7db-2bec34e3efbd req-5dbb5b3b-149c-4a98-843c-8cedc4a40e52 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 943 time: 0.0593054 Dec 24 05:01:23.193389 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3d606b9a-cd41-41f3-94f7-adf98a1f955c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:23.244229 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1e7c0763-2e4f-4c7f-b7db-2bec34e3efbd req-6752d1bc-cad1-4c1f-8f14-6d1b5980391a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0543747 Dec 24 05:01:24.364449 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a114c092-da98-42f7-a6ec-3323fcba1e45 req-3474fb60-0241-4958-bf89-d8b133bbb140 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:24.365843 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a114c092-da98-42f7-a6ec-3323fcba1e45 req-3474fb60-0241-4958-bf89-d8b133bbb140 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 943 time: 0.0527587 Dec 24 05:01:24.415838 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a114c092-da98-42f7-a6ec-3323fcba1e45 req-f06640e1-bf4e-4fdb-b6f7-eb00e113fc56 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415571 Dec 24 05:01:25.116228 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 639654f0-9663-4da1-8410-7e554500497a no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:01:25.147155 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] No Port match for: 639654f0-9663-4da1-8410-7e554500497a {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:01:25.147515 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 639654f0-9663-4da1-8410-7e554500497a not bound to the agent host hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:01:25.261180 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-101cdaed-fbeb-4d36-9832-9897745311d2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:25.537970 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19b8ba60-2c5c-4884-8163-00d41bc32dbc req-fee7a8fa-1b2d-4287-9fae-cc76d1f85f45 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:25.539433 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-19b8ba60-2c5c-4884-8163-00d41bc32dbc req-fee7a8fa-1b2d-4287-9fae-cc76d1f85f45 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 943 time: 0.0495255 Dec 24 05:01:25.595223 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-19b8ba60-2c5c-4884-8163-00d41bc32dbc req-e61ed5d6-aef8-4007-ba3a-6fd669564833 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496037 Dec 24 05:01:26.454370 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:26.724877 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d85647d-69a2-44f1-b146-fb91a3cfcfb4 req-231ad485-2864-4173-bbbd-bcd49b706a3f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:26.726370 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1d85647d-69a2-44f1-b146-fb91a3cfcfb4 req-231ad485-2864-4173-bbbd-bcd49b706a3f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 943 time: 0.0553324 Dec 24 05:01:26.774776 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1d85647d-69a2-44f1-b146-fb91a3cfcfb4 req-a52d4f19-1344-4e3f-a128-236a31a14175 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413566 Dec 24 05:01:27.136090 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 13f44c71-4981-48aa-bff5-6222de8d0cc1 details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 05:01:27.234985 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 13f44c71-4981-48aa-bff5-6222de8d0cc1, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=13f44c71-4981-48aa-bff5-6222de8d0cc1,segment=NetworkSegment(10307c97-e214-473b-b760-bb1b770153ec),segment_id=10307c97-e214-473b-b760-bb1b770153ec)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:01:27.246261 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': '13f44c71-4981-48aa-bff5-6222de8d0cc1', 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e', 'port_id': '13f44c71-4981-48aa-bff5-6222de8d0cc1', 'mac_address': 'fa:16:3e:95:00:c1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9b9ff65f-93c8-4cb1-8a99-961ba0d4beaa', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 05:01:27.288368 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:27.304472 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 13f44c71-4981-48aa-bff5-6222de8d0cc1 {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:01:27.325603 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 13f44c71-4981-48aa-bff5-6222de8d0cc1, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=13f44c71-4981-48aa-bff5-6222de8d0cc1,segment=NetworkSegment(10307c97-e214-473b-b760-bb1b770153ec),segment_id=10307c97-e214-473b-b760-bb1b770153ec)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:01:27.331406 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:27.378926 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=13f44c71-4981-48aa-bff5-6222de8d0cc1,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:27.386843 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:27.387256 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:27.387665 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:27.388032 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:27.388355 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:27.388718 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:27.389093 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:27.389486 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:27.389837 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:27.390180 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:27.390523 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:27.390846 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:27.391172 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:27.889914 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:27.906519 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a59b18dc-0ce5-4420-967f-20a3b779a2f7 req-f295fdc6-cd9f-4b1f-a2c7-9a197b4e4987 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:27.908312 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a59b18dc-0ce5-4420-967f-20a3b779a2f7 req-f295fdc6-cd9f-4b1f-a2c7-9a197b4e4987 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 944 time: 0.0499754 Dec 24 05:01:27.956380 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a59b18dc-0ce5-4420-967f-20a3b779a2f7 req-17b5001f-e693-4502-800d-2d47b6db3595 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420001 Dec 24 05:01:28.586681 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:29.086124 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-868bdc57-89f8-4ec8-9457-390432c4c317 req-4334f148-a3f4-4543-a923-a23d484c37c6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:29.087638 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-868bdc57-89f8-4ec8-9457-390432c4c317 req-4334f148-a3f4-4543-a923-a23d484c37c6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 944 time: 0.0494213 Dec 24 05:01:29.140958 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-868bdc57-89f8-4ec8-9457-390432c4c317 req-8dcddc0d-9434-4795-8303-445a2ecfa578 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444751 Dec 24 05:01:30.264465 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0c08ce9-6f45-41f8-ac99-be3dd5d5b417 req-3213ba79-e205-424e-9b95-728950c882ed tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:30.265974 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f0c08ce9-6f45-41f8-ac99-be3dd5d5b417 req-3213ba79-e205-424e-9b95-728950c882ed tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 944 time: 0.0510073 Dec 24 05:01:30.312487 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f0c08ce9-6f45-41f8-ac99-be3dd5d5b417 req-228a5093-f628-40a6-819d-2f6d78e8be3a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403852 Dec 24 05:01:31.438391 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1d60ba5-1e6a-45de-87c1-d116bbce6ad9 req-4e9f6dbb-0585-43e6-ab73-83b92fbd2ff1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:31.439847 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f1d60ba5-1e6a-45de-87c1-d116bbce6ad9 req-4e9f6dbb-0585-43e6-ab73-83b92fbd2ff1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 944 time: 0.0490980 Dec 24 05:01:31.489970 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f1d60ba5-1e6a-45de-87c1-d116bbce6ad9 req-0788cb96-8f21-45c8-934a-61e2cf7e0b7e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437207 Dec 24 05:01:32.616881 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6f0b9f3-d462-4934-88c7-9f80019fdfbf req-6b7ff139-37c4-4770-a600-ed05241f75a8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:32.618321 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d6f0b9f3-d462-4934-88c7-9f80019fdfbf req-6b7ff139-37c4-4770-a600-ed05241f75a8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 944 time: 0.0581210 Dec 24 05:01:32.667951 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d6f0b9f3-d462-4934-88c7-9f80019fdfbf req-164c4511-fe08-4841-8e5c-7bcb1713d6d1 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407748 Dec 24 05:01:32.695357 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['13f44c71-4981-48aa-bff5-6222de8d0cc1'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:01:33.783907 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6e0114e-bb7b-45a9-a114-6a05edf1894d req-551e674a-dfd4-455a-aa5e-50027de434be tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:33.785534 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c6e0114e-bb7b-45a9-a114-6a05edf1894d req-551e674a-dfd4-455a-aa5e-50027de434be tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 944 time: 0.0487578 Dec 24 05:01:33.832833 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c6e0114e-bb7b-45a9-a114-6a05edf1894d req-15d22654-988d-4f64-97a5-0831995b34e8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409479 Dec 24 05:01:34.023830 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b7760fe-192f-4d18-9f55-e4f45c5f36b1 req-68af0135-9911-4908-bb3f-11962ff6f5dd tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:34.025352 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7b7760fe-192f-4d18-9f55-e4f45c5f36b1 req-68af0135-9911-4908-bb3f-11962ff6f5dd tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0467317 Dec 24 05:01:34.077306 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7b7760fe-192f-4d18-9f55-e4f45c5f36b1 req-c01a84c4-58e7-4519-acd1-ac0e782fdae1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460353 Dec 24 05:01:34.963196 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3d06457-dd06-4af4-a010-4c97eda5f1fa req-5003c10c-d6e8-4f8e-9e9e-efdef68f3080 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:34.964693 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f3d06457-dd06-4af4-a010-4c97eda5f1fa req-5003c10c-d6e8-4f8e-9e9e-efdef68f3080 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 944 time: 0.0535927 Dec 24 05:01:35.015353 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f3d06457-dd06-4af4-a010-4c97eda5f1fa req-b336f507-f641-4423-aa2d-dc6e001944b9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424564 Dec 24 05:01:35.195750 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14c2c38a-d635-453f-aaa9-85830ade1d06 req-c0774e8e-76e4-4efc-b4bf-03d9ea43873a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:35.197315 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-14c2c38a-d635-453f-aaa9-85830ade1d06 req-c0774e8e-76e4-4efc-b4bf-03d9ea43873a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0521941 Dec 24 05:01:35.245849 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-14c2c38a-d635-453f-aaa9-85830ade1d06 req-7bea7ca5-ab83-40de-9906-68784361eb8f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422165 Dec 24 05:01:36.148484 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a5aa92a-5918-408c-b131-a45525cd9440 req-d90ee354-ff0f-46b3-94d9-9e5098b8c856 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:36.150647 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3a5aa92a-5918-408c-b131-a45525cd9440 req-d90ee354-ff0f-46b3-94d9-9e5098b8c856 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 944 time: 0.0528967 Dec 24 05:01:36.197534 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3a5aa92a-5918-408c-b131-a45525cd9440 req-2e51a44e-522c-4e26-8ea2-f80a40310be5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420525 Dec 24 05:01:36.254292 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 13f44c71-4981-48aa-bff5-6222de8d0cc1 up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:01:36.305861 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning for port 13f44c71-4981-48aa-bff5-6222de8d0cc1 completed by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 24 05:01:36.310255 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port 13f44c71-4981-48aa-bff5-6222de8d0cc1 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:01:36.310640 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:36.365260 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-033d9da7-9b5f-4e1a-be77-4f024692aafa req-2ea85d8a-07e6-404c-beb7-e88bb27d785b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:36.366797 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-033d9da7-9b5f-4e1a-be77-4f024692aafa req-2ea85d8a-07e6-404c-beb7-e88bb27d785b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0510259 Dec 24 05:01:36.390496 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:36.412688 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e93dfa9e-7d0c-4922-9108-dd3b9c6265e2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '13f44c71-4981-48aa-bff5-6222de8d0cc1'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:01:36.414823 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-033d9da7-9b5f-4e1a-be77-4f024692aafa req-e5d7cf2e-2a2e-4af6-b873-7217c4c2d420 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419333 Dec 24 05:01:36.415212 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2a7336a1-a513-41ba-8dbc-9218a0925e1f" -d '{"events": [{"server_uuid": "e93dfa9e-7d0c-4922-9108-dd3b9c6265e2", "name": "network-vif-plugged", "status": "completed", "tag": "13f44c71-4981-48aa-bff5-6222de8d0cc1"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:01:36.427471 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 13f44c71-4981-48aa-bff5-6222de8d0cc1, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=13f44c71-4981-48aa-bff5-6222de8d0cc1,segment=NetworkSegment(10307c97-e214-473b-b760-bb1b770153ec),segment_id=10307c97-e214-473b-b760-bb1b770153ec)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:01:36.431945 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:36.460776 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:01:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-82cad4c0-40f4-4b09-a922-20fc488a81d3 x-openstack-request-id: req-82cad4c0-40f4-4b09-a922-20fc488a81d3 {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:01:36.461169 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e93dfa9e-7d0c-4922-9108-dd3b9c6265e2", "name": "network-vif-plugged", "status": "completed", "tag": "13f44c71-4981-48aa-bff5-6222de8d0cc1", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:01:36.461427 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-82cad4c0-40f4-4b09-a922-20fc488a81d3 {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:01:36.461812 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e93dfa9e-7d0c-4922-9108-dd3b9c6265e2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '13f44c71-4981-48aa-bff5-6222de8d0cc1', 'code': 200} Dec 24 05:01:36.480608 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=13f44c71-4981-48aa-bff5-6222de8d0cc1,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:37.324207 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-544859da-9d79-40cb-bc87-c7ac2e8ce1f0 req-49bf9407-bda6-406d-aa0a-91a0929f6045 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:37.325702 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-544859da-9d79-40cb-bc87-c7ac2e8ce1f0 req-49bf9407-bda6-406d-aa0a-91a0929f6045 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 945 time: 0.0541961 Dec 24 05:01:37.376592 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-544859da-9d79-40cb-bc87-c7ac2e8ce1f0 req-726d248c-56e3-4222-a51c-0c27d4b62b3d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445709 Dec 24 05:01:37.537916 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9843abd-9863-4f3d-86bb-49fd860292c5 req-15fe491f-fcd1-4676-bd07-405ab4ae0eb8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:37.539483 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b9843abd-9863-4f3d-86bb-49fd860292c5 req-15fe491f-fcd1-4676-bd07-405ab4ae0eb8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0526199 Dec 24 05:01:37.587161 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b9843abd-9863-4f3d-86bb-49fd860292c5 req-22896364-f313-44b1-b058-701ff961721e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415089 Dec 24 05:01:37.852501 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-074ea690-6e52-432f-9ca3-b52a2dcb8261 req-d1e5d160-92f8-4399-96a7-9137e39152a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:37.854017 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-074ea690-6e52-432f-9ca3-b52a2dcb8261 req-d1e5d160-92f8-4399-96a7-9137e39152a9 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=1b651e55b1a349a0b9582c526d3b5d67&device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 1098 time: 0.0494211 Dec 24 05:01:37.947124 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-074ea690-6e52-432f-9ca3-b52a2dcb8261 req-c10f92ca-a5f0-4311-9d01-809b2d067910 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:37.948664 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-074ea690-6e52-432f-9ca3-b52a2dcb8261 req-c10f92ca-a5f0-4311-9d01-809b2d067910 service neutron] 10.222.0.46 "GET /v2.0/networks?id=0d368baa-5733-40a7-b836-139a541f4ebb HTTP/1.1" status: 200 len: 919 time: 0.0860906 Dec 24 05:01:38.020508 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-074ea690-6e52-432f-9ca3-b52a2dcb8261 req-4fe517e2-bfc9-412d-80d6-f44cd00b234f service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ea61b5c0-ffb7-42bf-9289-095515c125a2 HTTP/1.1" status: 200 len: 217 time: 0.0407629 Dec 24 05:01:38.087794 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-478b5b3e-d378-45f6-93e9-83c3d843d177 req-a766c6dc-349b-4c6a-b2f6-459447f5ef6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:38.089221 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-478b5b3e-d378-45f6-93e9-83c3d843d177 req-a766c6dc-349b-4c6a-b2f6-459447f5ef6c service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 1098 time: 0.0774090 Dec 24 05:01:38.090600 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-074ea690-6e52-432f-9ca3-b52a2dcb8261 req-73a58c55-19d3-4d36-9291-3fe29c2b8837 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:38.091858 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-074ea690-6e52-432f-9ca3-b52a2dcb8261 req-73a58c55-19d3-4d36-9291-3fe29c2b8837 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=88f274d6-bcf0-47e8-9f0a-783a53214be4 HTTP/1.1" status: 200 len: 858 time: 0.0579693 Dec 24 05:01:38.138521 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-074ea690-6e52-432f-9ca3-b52a2dcb8261 req-3a8dd9e5-3b8f-4fa2-91a2-234581ac726b service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=0d368baa-5733-40a7-b836-139a541f4ebb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0355980 Dec 24 05:01:38.183923 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-478b5b3e-d378-45f6-93e9-83c3d843d177 req-8be6d025-6a6e-4ef6-94bc-9b130d6339fe service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0820670 Dec 24 05:01:38.244053 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-074ea690-6e52-432f-9ca3-b52a2dcb8261 req-86149a97-8b07-4acd-9f41-0b118ff892c6 service neutron] 10.222.0.46 "GET /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0959668 Dec 24 05:01:38.498782 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58672d58-983f-4ed8-b2dc-8a700e3f25e3 req-1c9169a6-237d-4328-a004-d8ab968f9b1a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:38.500252 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-58672d58-983f-4ed8-b2dc-8a700e3f25e3 req-1c9169a6-237d-4328-a004-d8ab968f9b1a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 945 time: 0.0494416 Dec 24 05:01:38.552380 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-58672d58-983f-4ed8-b2dc-8a700e3f25e3 req-ff856d11-129f-4a22-a056-977d403d3125 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437000 Dec 24 05:01:38.705915 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac32b6a9-aeab-4d7a-8cc5-d166c5dd6ad1 req-ce682107-e1d8-4e81-88bb-9d446eefa063 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:38.707325 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ac32b6a9-aeab-4d7a-8cc5-d166c5dd6ad1 req-ce682107-e1d8-4e81-88bb-9d446eefa063 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0501909 Dec 24 05:01:38.763232 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ac32b6a9-aeab-4d7a-8cc5-d166c5dd6ad1 req-862ba7b5-9a31-431c-b510-7944b50d25a0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462537 Dec 24 05:01:39.244308 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-074ea690-6e52-432f-9ca3-b52a2dcb8261 req-079f889a-971e-4717-8faf-89a8883fe11b service neutron] 10.222.0.46 "GET /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0983253 Dec 24 05:01:39.679982 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9124be-74a7-4221-ac1d-6790fe3924e1 req-5f253881-387c-452a-b569-51b7e97f1e3f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:39.681509 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-fa9124be-74a7-4221-ac1d-6790fe3924e1 req-5f253881-387c-452a-b569-51b7e97f1e3f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 945 time: 0.0509405 Dec 24 05:01:39.727644 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-fa9124be-74a7-4221-ac1d-6790fe3924e1 req-833f0129-dd3c-4d5e-a907-edb94ae227cf tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402868 Dec 24 05:01:39.896278 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-518da218-6de0-4090-a519-1e8649d6c3fc req-b0004ff2-2437-4e36-a9f1-0b11bc687698 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:39.897684 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-518da218-6de0-4090-a519-1e8649d6c3fc req-b0004ff2-2437-4e36-a9f1-0b11bc687698 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0578818 Dec 24 05:01:39.950801 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-518da218-6de0-4090-a519-1e8649d6c3fc req-e7018add-4f82-41ac-a7ad-398d1e517a88 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469263 Dec 24 05:01:40.858632 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e8488c9-ba5c-4974-be69-a31db61502cc req-9b908e4c-91f3-4321-87ad-6ecfac527163 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:40.860237 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7e8488c9-ba5c-4974-be69-a31db61502cc req-9b908e4c-91f3-4321-87ad-6ecfac527163 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 945 time: 0.0632679 Dec 24 05:01:40.908720 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7e8488c9-ba5c-4974-be69-a31db61502cc req-0e281683-173d-4b8f-ad9b-187cc4f35584 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423019 Dec 24 05:01:41.076550 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-968640f6-c54b-46b4-bc78-0bf447cb9a93 req-7510b564-eba3-49b8-bd98-13935bde5b56 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:41.078085 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-968640f6-c54b-46b4-bc78-0bf447cb9a93 req-7510b564-eba3-49b8-bd98-13935bde5b56 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0516720 Dec 24 05:01:41.128063 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-968640f6-c54b-46b4-bc78-0bf447cb9a93 req-30b9bf11-1b35-4f69-94ee-6f0232e6c235 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437799 Dec 24 05:01:42.039437 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67e08cd6-65cf-4651-a8e5-1bdd96d77d8a req-f5d35fd2-36d8-4239-8370-ab9767dbab89 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:42.040975 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-67e08cd6-65cf-4651-a8e5-1bdd96d77d8a req-f5d35fd2-36d8-4239-8370-ab9767dbab89 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 945 time: 0.0509901 Dec 24 05:01:42.090234 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-67e08cd6-65cf-4651-a8e5-1bdd96d77d8a req-003334db-7ce6-4d94-aaf8-76d0a071f290 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432553 Dec 24 05:01:42.262077 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb7ae1c5-d792-449d-886a-5d64725f8164 req-2d972a99-e7db-40d3-9928-606434a4a7f1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:42.263574 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-eb7ae1c5-d792-449d-886a-5d64725f8164 req-2d972a99-e7db-40d3-9928-606434a4a7f1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0525286 Dec 24 05:01:42.316603 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-eb7ae1c5-d792-449d-886a-5d64725f8164 req-b9720cd0-0043-4e64-b5b8-04931154fb9b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467536 Dec 24 05:01:43.231910 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-876d0371-f407-45a5-99a3-03508aa2bef1 req-d51e65af-1eb1-4b1f-85ce-b6ab8e36d2d9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:43.233425 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-876d0371-f407-45a5-99a3-03508aa2bef1 req-d51e65af-1eb1-4b1f-85ce-b6ab8e36d2d9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 945 time: 0.0660453 Dec 24 05:01:43.283197 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-876d0371-f407-45a5-99a3-03508aa2bef1 req-87a918a1-a315-4b28-9987-c51a5172feea tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437107 Dec 24 05:01:43.450031 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dea7e973-5148-440c-a23f-e5dbd77661ca req-ff979da8-3a32-4f3f-bf2d-01e117cf95ea tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:43.451585 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-dea7e973-5148-440c-a23f-e5dbd77661ca req-ff979da8-3a32-4f3f-bf2d-01e117cf95ea tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0518444 Dec 24 05:01:43.504044 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-dea7e973-5148-440c-a23f-e5dbd77661ca req-df29f506-9284-4eb6-a80d-16e79b1f3549 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439684 Dec 24 05:01:44.419765 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fd8fa2d-a372-4edc-9bdd-a057ab26bc13 req-0a87b586-975c-4dba-9b10-504a63bdb5cd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:44.421267 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-9fd8fa2d-a372-4edc-9bdd-a057ab26bc13 req-0a87b586-975c-4dba-9b10-504a63bdb5cd tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 945 time: 0.0556433 Dec 24 05:01:44.470264 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-9fd8fa2d-a372-4edc-9bdd-a057ab26bc13 req-c005acd4-b092-4652-b65a-15861148fa7a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425444 Dec 24 05:01:44.630791 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14e1f496-4946-4fde-9aae-4422b8662046 req-30cb661a-9593-434f-86b0-f781eb5552dc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:44.632253 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-14e1f496-4946-4fde-9aae-4422b8662046 req-30cb661a-9593-434f-86b0-f781eb5552dc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0497735 Dec 24 05:01:44.680997 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-14e1f496-4946-4fde-9aae-4422b8662046 req-b908d47e-c6c9-4861-8920-a2f54e0d0bdf tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422156 Dec 24 05:01:45.595524 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a5c857-fb02-4b94-934d-ff58fb7e8f80 req-f70cdf70-58f9-4fde-afcd-99b3775b65f2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:45.597511 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a7a5c857-fb02-4b94-934d-ff58fb7e8f80 req-f70cdf70-58f9-4fde-afcd-99b3775b65f2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 945 time: 0.0544398 Dec 24 05:01:45.654900 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a7a5c857-fb02-4b94-934d-ff58fb7e8f80 req-82d1f7e1-fcc3-4060-a625-dabb248f7fea tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508025 Dec 24 05:01:45.804928 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b37185e-51e2-4ad0-afcf-43f156456595 req-d0a2561e-4014-4ef6-bfee-0e056fd0e2a4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:45.806816 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0b37185e-51e2-4ad0-afcf-43f156456595 req-d0a2561e-4014-4ef6-bfee-0e056fd0e2a4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0520699 Dec 24 05:01:45.855724 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0b37185e-51e2-4ad0-afcf-43f156456595 req-06024bea-7da2-43b2-8f15-c12964568c73 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425968 Dec 24 05:01:46.775376 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f54a48c4-725a-4762-9383-506d1a3f6fef req-7d45cb6e-cd1c-4dff-ad77-92331ee3b3a5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:46.777004 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f54a48c4-725a-4762-9383-506d1a3f6fef req-7d45cb6e-cd1c-4dff-ad77-92331ee3b3a5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 945 time: 0.0534196 Dec 24 05:01:46.826861 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f54a48c4-725a-4762-9383-506d1a3f6fef req-928409ab-3d33-431d-befc-9965111f3a2b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436785 Dec 24 05:01:46.980478 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32150eab-fb8d-42e5-a386-f17d7e8a3499 req-a4250fe6-3174-42ef-9444-3bdd146233f0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:46.982008 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-32150eab-fb8d-42e5-a386-f17d7e8a3499 req-a4250fe6-3174-42ef-9444-3bdd146233f0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0527880 Dec 24 05:01:46.984009 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 55896) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:47.035684 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-32150eab-fb8d-42e5-a386-f17d7e8a3499 req-0b329ad8-7843-45b1-a6a1-4e641c8fcbf1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458980 Dec 24 05:01:47.105570 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d0aab9d3-bc1f-4ef8-94e4-160a6ba90074 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:47.186469 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d0aab9d3-bc1f-4ef8-94e4-160a6ba90074 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:47.191695 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d0aab9d3-bc1f-4ef8-94e4-160a6ba90074 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:47.229171 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-d0aab9d3-bc1f-4ef8-94e4-160a6ba90074 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=9f946192a481435b99c52be706eeb5f3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2439175 Dec 24 05:01:47.230424 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0aab9d3-bc1f-4ef8-94e4-160a6ba90074 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=69b8d7f9-f4e6-4a13-ba9a-21d5700f14ef,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:47.232333 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 55906) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:47.237543 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0aab9d3-bc1f-4ef8-94e4-160a6ba90074 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.237891 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0aab9d3-bc1f-4ef8-94e4-160a6ba90074 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.238227 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0aab9d3-bc1f-4ef8-94e4-160a6ba90074 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.238553 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0aab9d3-bc1f-4ef8-94e4-160a6ba90074 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.238881 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0aab9d3-bc1f-4ef8-94e4-160a6ba90074 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.239228 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0aab9d3-bc1f-4ef8-94e4-160a6ba90074 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.239550 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0aab9d3-bc1f-4ef8-94e4-160a6ba90074 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.239867 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0aab9d3-bc1f-4ef8-94e4-160a6ba90074 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.240189 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0aab9d3-bc1f-4ef8-94e4-160a6ba90074 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.240506 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0aab9d3-bc1f-4ef8-94e4-160a6ba90074 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.240847 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0aab9d3-bc1f-4ef8-94e4-160a6ba90074 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.241167 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0aab9d3-bc1f-4ef8-94e4-160a6ba90074 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.241478 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0aab9d3-bc1f-4ef8-94e4-160a6ba90074 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.284403 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-fd4de8ca-847b-4938-b0e8-7a354dcac031 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:47.305675 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-fd4de8ca-847b-4938-b0e8-7a354dcac031 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:47.355131 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-fd4de8ca-847b-4938-b0e8-7a354dcac031 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:47.357699 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-fd4de8ca-847b-4938-b0e8-7a354dcac031 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:47.358895 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-fd4de8ca-847b-4938-b0e8-7a354dcac031 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/69b8d7f9-f4e6-4a13-ba9a-21d5700f14ef HTTP/1.1" status: 204 len: 168 time: 0.1255279 Dec 24 05:01:47.369280 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd4de8ca-847b-4938-b0e8-7a354dcac031 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=69b8d7f9-f4e6-4a13-ba9a-21d5700f14ef,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:47.380639 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd4de8ca-847b-4938-b0e8-7a354dcac031 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.381065 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd4de8ca-847b-4938-b0e8-7a354dcac031 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.381433 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd4de8ca-847b-4938-b0e8-7a354dcac031 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.381794 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd4de8ca-847b-4938-b0e8-7a354dcac031 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.382128 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd4de8ca-847b-4938-b0e8-7a354dcac031 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.382670 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd4de8ca-847b-4938-b0e8-7a354dcac031 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.383003 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd4de8ca-847b-4938-b0e8-7a354dcac031 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.383520 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd4de8ca-847b-4938-b0e8-7a354dcac031 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.383854 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd4de8ca-847b-4938-b0e8-7a354dcac031 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.384185 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd4de8ca-847b-4938-b0e8-7a354dcac031 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.384808 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd4de8ca-847b-4938-b0e8-7a354dcac031 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.385174 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd4de8ca-847b-4938-b0e8-7a354dcac031 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.385916 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd4de8ca-847b-4938-b0e8-7a354dcac031 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:01:47.645863 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 55932) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:47.659205 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d6e22250-613a-4a50-890f-ded99727a2ae admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:47.739337 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d6e22250-613a-4a50-890f-ded99727a2ae admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:47.744278 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d6e22250-613a-4a50-890f-ded99727a2ae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:47.782315 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-d6e22250-613a-4a50-890f-ded99727a2ae admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=756fefc6141a4559af0d3b169ad99d09&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1353586 Dec 24 05:01:47.785109 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 55936) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:47.791060 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6e22250-613a-4a50-890f-ded99727a2ae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4ece3ed4-27bc-467a-a470-e96396b39eff,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:47.835754 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-55fd084e-a942-40e1-93ee-b2b1b5365961 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:47.855730 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-55fd084e-a942-40e1-93ee-b2b1b5365961 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:47.906629 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-55fd084e-a942-40e1-93ee-b2b1b5365961 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:47.909288 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-55fd084e-a942-40e1-93ee-b2b1b5365961 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:47.910425 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-55fd084e-a942-40e1-93ee-b2b1b5365961 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/4ece3ed4-27bc-467a-a470-e96396b39eff HTTP/1.1" status: 204 len: 168 time: 0.1243515 Dec 24 05:01:47.917892 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55fd084e-a942-40e1-93ee-b2b1b5365961 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4ece3ed4-27bc-467a-a470-e96396b39eff,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:48.170698 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50d538ee-0633-43f0-b35a-2aa00d78b04f req-bbba6cb0-6386-4ede-951b-499cf457b6b2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:48.172221 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-50d538ee-0633-43f0-b35a-2aa00d78b04f req-bbba6cb0-6386-4ede-951b-499cf457b6b2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0522656 Dec 24 05:01:48.223277 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-50d538ee-0633-43f0-b35a-2aa00d78b04f req-862c2e43-70fd-4e96-b82c-bbff3ed56abe tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451171 Dec 24 05:01:49.355916 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3d3ae66-4da2-41f8-a6a6-59d49ee4692d req-867bd80f-d712-4b11-a40c-d276a0f58709 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:49.357455 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c3d3ae66-4da2-41f8-a6a6-59d49ee4692d req-867bd80f-d712-4b11-a40c-d276a0f58709 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0509291 Dec 24 05:01:49.407972 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:49.410339 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c3d3ae66-4da2-41f8-a6a6-59d49ee4692d req-8a9b5db1-7acb-40e8-8d9b-5aa4bf5037c7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0466187 Dec 24 05:01:50.173811 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 56036) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:50.282544 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e947f56d-e041-4adb-8be8-5455b7edee01 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:50.359253 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e947f56d-e041-4adb-8be8-5455b7edee01 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:50.364500 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e947f56d-e041-4adb-8be8-5455b7edee01 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:50.404436 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-e947f56d-e041-4adb-8be8-5455b7edee01 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=963bf46e196f4b2ba1aae717a716f3f0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2295449 Dec 24 05:01:50.405609 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e947f56d-e041-4adb-8be8-5455b7edee01 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cd42826f-d6e7-4fe7-9171-f42c9165fcf5,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:50.407256 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 56042) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:50.721133 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-63e0b21a-aa8e-4d95-a56b-7959f70408f2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:50.751468 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-722eb4b1-c9ba-4325-9f92-2f384d5252b8 req-15b322be-65e2-4a85-a38d-a4816fef344a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:50.752956 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-722eb4b1-c9ba-4325-9f92-2f384d5252b8 req-15b322be-65e2-4a85-a38d-a4816fef344a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0727811 Dec 24 05:01:50.754720 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-63e0b21a-aa8e-4d95-a56b-7959f70408f2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:50.820043 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-722eb4b1-c9ba-4325-9f92-2f384d5252b8 req-fbe807bf-0a12-4244-83ac-e4ae3ed5d195 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0587966 Dec 24 05:01:50.832019 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-63e0b21a-aa8e-4d95-a56b-7959f70408f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:50.834596 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-63e0b21a-aa8e-4d95-a56b-7959f70408f2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:50.836018 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-63e0b21a-aa8e-4d95-a56b-7959f70408f2 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/cd42826f-d6e7-4fe7-9171-f42c9165fcf5 HTTP/1.1" status: 204 len: 168 time: 0.4278057 Dec 24 05:01:50.844192 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63e0b21a-aa8e-4d95-a56b-7959f70408f2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cd42826f-d6e7-4fe7-9171-f42c9165fcf5,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:51.103162 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 56056) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:51.117143 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0649095f-9e6e-466e-958f-3866219f980d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:51.198704 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0649095f-9e6e-466e-958f-3866219f980d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:51.205398 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0649095f-9e6e-466e-958f-3866219f980d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:51.242781 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-0649095f-9e6e-466e-958f-3866219f980d admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=4112d41d9be6412b96f943f7bf78e0ba&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1385314 Dec 24 05:01:51.243640 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0649095f-9e6e-466e-958f-3866219f980d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3b58a0ae-7b80-464b-8743-09037e271e03,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:51.245791 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 56060) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:01:51.295388 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f2e6e024-3126-4ed1-9695-ad062db95014 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:51.317449 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f2e6e024-3126-4ed1-9695-ad062db95014 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:51.374801 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f2e6e024-3126-4ed1-9695-ad062db95014 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:51.379045 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f2e6e024-3126-4ed1-9695-ad062db95014 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:51.380789 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-f2e6e024-3126-4ed1-9695-ad062db95014 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/3b58a0ae-7b80-464b-8743-09037e271e03 HTTP/1.1" status: 204 len: 168 time: 0.1337276 Dec 24 05:01:51.391203 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2e6e024-3126-4ed1-9695-ad062db95014 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b58a0ae-7b80-464b-8743-09037e271e03,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:01:51.970607 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bbd9eaf-a629-45ed-8c0c-58ad99f867b3 req-a1819b48-cdab-420b-be08-4ee1027498ec tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:51.973024 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5bbd9eaf-a629-45ed-8c0c-58ad99f867b3 req-a1819b48-cdab-420b-be08-4ee1027498ec tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0651376 Dec 24 05:01:52.032083 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5bbd9eaf-a629-45ed-8c0c-58ad99f867b3 req-a7a7de95-a446-4998-affc-0364bc798acb tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0510218 Dec 24 05:01:53.207308 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-ffe65dd7-3a91-4298-a0bd-f166651b55c5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:53.259423 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e40bf9fc-6102-4069-b73f-c63d8d201b71 req-3ced27e1-a039-4f11-97b7-fca492b1a0a7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:53.261619 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e40bf9fc-6102-4069-b73f-c63d8d201b71 req-3ced27e1-a039-4f11-97b7-fca492b1a0a7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0657468 Dec 24 05:01:53.354815 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e40bf9fc-6102-4069-b73f-c63d8d201b71 req-b04f2045-7d14-42a2-908b-1dca6a7c2924 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0831954 Dec 24 05:01:54.524998 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8a1566d-9ed9-4213-9c90-305d45c7fc61 req-be1a70cb-b811-47c0-ae64-79b69d9a658b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:54.527012 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a8a1566d-9ed9-4213-9c90-305d45c7fc61 req-be1a70cb-b811-47c0-ae64-79b69d9a658b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0555036 Dec 24 05:01:54.579909 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a8a1566d-9ed9-4213-9c90-305d45c7fc61 req-5011e50e-5c9a-4a87-8bb0-5b80066c04ef tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464659 Dec 24 05:01:55.282446 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-f4aac701-404f-4f82-a870-f76425c102c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:55.414285 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:01:55.701675 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bf2e503-ee15-4c0b-a33d-2c5d95df3cf8 req-a9e6c252-a445-476c-a24a-09d4e00b2348 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:55.703977 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3bf2e503-ee15-4c0b-a33d-2c5d95df3cf8 req-a9e6c252-a445-476c-a24a-09d4e00b2348 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0529847 Dec 24 05:01:55.755551 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3bf2e503-ee15-4c0b-a33d-2c5d95df3cf8 req-0f64ce72-3e95-42a5-9819-eba69f20bd11 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441735 Dec 24 05:01:56.451941 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:56.892423 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f88c3aae-ea2d-4d4d-ad5b-ec0b8216076d req-71686848-f5bc-4648-836e-97e51546956a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:56.900368 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f88c3aae-ea2d-4d4d-ad5b-ec0b8216076d req-71686848-f5bc-4648-836e-97e51546956a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0639844 Dec 24 05:01:56.961617 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f88c3aae-ea2d-4d4d-ad5b-ec0b8216076d req-7021d896-3964-4882-9b9b-3b6617897f7c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0578802 Dec 24 05:01:57.894455 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:58.083324 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8759c0c1-8176-4bac-b80c-a8969b125c98 req-737ab80f-5966-4605-9327-7a1a77bd5d81 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:58.085115 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8759c0c1-8176-4bac-b80c-a8969b125c98 req-737ab80f-5966-4605-9327-7a1a77bd5d81 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0501137 Dec 24 05:01:58.142811 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8759c0c1-8176-4bac-b80c-a8969b125c98 req-11f0d3aa-b4b1-4c37-9a46-94e4f2815167 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0514636 Dec 24 05:01:58.579436 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:01:59.283463 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b46c215-711e-4642-85bc-fb35a4a67647 req-06bb325b-89ff-4869-8740-bca5dde5d4be tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:01:59.290896 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2b46c215-711e-4642-85bc-fb35a4a67647 req-06bb325b-89ff-4869-8740-bca5dde5d4be tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0695689 Dec 24 05:01:59.356079 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2b46c215-711e-4642-85bc-fb35a4a67647 req-965d158d-3ec3-4508-a2b7-5ead1bc5acc0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0637183 Dec 24 05:02:00.489021 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c3ea6d0-b3cf-4a91-9f22-87693392e6f6 req-714b1f20-d3fd-4a22-bb81-5dff1e29bc9c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:00.490472 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1c3ea6d0-b3cf-4a91-9f22-87693392e6f6 req-714b1f20-d3fd-4a22-bb81-5dff1e29bc9c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0592394 Dec 24 05:02:00.547156 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1c3ea6d0-b3cf-4a91-9f22-87693392e6f6 req-156578d6-a40d-4cca-8831-31defe92116b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468812 Dec 24 05:02:01.290415 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6653e5ca-f056-4a55-9e5e-adadfc9102e8 req-cfc94cc0-fa4d-446d-bbf0-feccec5d5dd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:01.292018 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6653e5ca-f056-4a55-9e5e-adadfc9102e8 req-cfc94cc0-fa4d-446d-bbf0-feccec5d5dd3 service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 1098 time: 0.0576425 Dec 24 05:02:01.345646 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6653e5ca-f056-4a55-9e5e-adadfc9102e8 req-08eec550-2e0c-4135-9084-5aafdda2c2fe service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431232 Dec 24 05:02:01.689387 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a59f03ce-0353-4988-8621-9f3c427ba145 req-274f9c2f-764d-4898-b2a6-bd41c85d50eb tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:01.692143 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a59f03ce-0353-4988-8621-9f3c427ba145 req-274f9c2f-764d-4898-b2a6-bd41c85d50eb tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0645766 Dec 24 05:02:01.755092 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a59f03ce-0353-4988-8621-9f3c427ba145 req-72ca7e28-067c-40a0-aa10-11595509ff25 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0561895 Dec 24 05:02:02.887253 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b65f8f3-82d8-4931-b0e1-bc38a30688e0 req-585fccf3-23fc-4c54-9e21-8690d4a11d6d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:02.888878 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9b65f8f3-82d8-4931-b0e1-bc38a30688e0 req-585fccf3-23fc-4c54-9e21-8690d4a11d6d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0575824 Dec 24 05:02:02.939403 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9b65f8f3-82d8-4931-b0e1-bc38a30688e0 req-1e80a8e7-90c0-46ba-bcb3-e6eeef009114 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441675 Dec 24 05:02:04.074176 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72930da6-b034-447c-bcd2-f76b15a532e5 req-908812bf-56df-4b45-8f1f-42def9268d1a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:04.075991 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-72930da6-b034-447c-bcd2-f76b15a532e5 req-908812bf-56df-4b45-8f1f-42def9268d1a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0611756 Dec 24 05:02:04.153120 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-72930da6-b034-447c-bcd2-f76b15a532e5 req-4f490629-8386-470c-9572-b9d2e974e06f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0702479 Dec 24 05:02:04.409395 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d8a4bce-4246-4860-a884-3ee2cfb881e0 req-36113b4b-8bfc-4971-a7e7-14c298a95f93 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:04.411055 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8d8a4bce-4246-4860-a884-3ee2cfb881e0 req-36113b4b-8bfc-4971-a7e7-14c298a95f93 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0518627 Dec 24 05:02:04.443772 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50838218-6882-444b-9a4f-b3ccfedc0769 req-664ae51a-3045-4c00-90c4-f2d6cff796cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:04.445611 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-50838218-6882-444b-9a4f-b3ccfedc0769 req-664ae51a-3045-4c00-90c4-f2d6cff796cd service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=1b651e55b1a349a0b9582c526d3b5d67&device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 1098 time: 0.0514324 Dec 24 05:02:04.479434 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8d8a4bce-4246-4860-a884-3ee2cfb881e0 req-c541240e-9db0-4517-866d-2d4a8d961895 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0602643 Dec 24 05:02:04.569852 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50838218-6882-444b-9a4f-b3ccfedc0769 req-0fb4b1e0-d8c8-4f57-992d-4f621a9c1b42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:04.571885 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-50838218-6882-444b-9a4f-b3ccfedc0769 req-0fb4b1e0-d8c8-4f57-992d-4f621a9c1b42 service neutron] 10.222.0.46 "GET /v2.0/networks?id=0d368baa-5733-40a7-b836-139a541f4ebb HTTP/1.1" status: 200 len: 919 time: 0.1167669 Dec 24 05:02:04.626553 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-50838218-6882-444b-9a4f-b3ccfedc0769 req-b253227c-0c88-408b-9bdf-c8edf4ff764a service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ea61b5c0-ffb7-42bf-9289-095515c125a2 HTTP/1.1" status: 200 len: 217 time: 0.0442612 Dec 24 05:02:04.682647 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50838218-6882-444b-9a4f-b3ccfedc0769 req-e35c697c-8ead-4fa2-87e4-849271c8afc7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:04.684145 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-50838218-6882-444b-9a4f-b3ccfedc0769 req-e35c697c-8ead-4fa2-87e4-849271c8afc7 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=88f274d6-bcf0-47e8-9f0a-783a53214be4 HTTP/1.1" status: 200 len: 858 time: 0.0489035 Dec 24 05:02:04.719465 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-50838218-6882-444b-9a4f-b3ccfedc0769 req-3819bd1b-baf5-44f1-9941-2e09255d349b service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=0d368baa-5733-40a7-b836-139a541f4ebb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0270553 Dec 24 05:02:04.823499 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-50838218-6882-444b-9a4f-b3ccfedc0769 req-c6bbcb1a-2107-42f8-ad39-94b4498d2011 service neutron] 10.222.0.46 "GET /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0944817 Dec 24 05:02:04.980199 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-50838218-6882-444b-9a4f-b3ccfedc0769 req-9957fbc2-f463-4a06-8f70-a78c25104af2 service neutron] 10.222.0.46 "GET /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1367671 Dec 24 05:02:05.334282 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 56444) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:02:05.503052 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ea7c4c9a-ee60-4e16-9eb0-c8fe98ea0c35 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:05.605588 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ea7c4c9a-ee60-4e16-9eb0-c8fe98ea0c35 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:05.609686 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ea7c4c9a-ee60-4e16-9eb0-c8fe98ea0c35 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:05.645700 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-ea7c4c9a-ee60-4e16-9eb0-c8fe98ea0c35 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=a7d897479c3e4e11a56492bd9a1f09e1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3098118 Dec 24 05:02:05.646287 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db6e2555-2565-452f-aea9-fb104cefbeef req-3b6a0bba-09a3-445d-9cc7-8eeab90bf695 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:05.648597 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-db6e2555-2565-452f-aea9-fb104cefbeef req-3b6a0bba-09a3-445d-9cc7-8eeab90bf695 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0639670 Dec 24 05:02:05.648998 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 56458) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:02:05.670273 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea7c4c9a-ee60-4e16-9eb0-c8fe98ea0c35 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b3e60481-6cb9-4a06-878e-f06a45cf0cd1,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:05.699787 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-db6e2555-2565-452f-aea9-fb104cefbeef req-0c0d5aa6-c62e-4caa-adb5-7ac108e50c77 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439293 Dec 24 05:02:05.710303 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-80a930d4-e759-4878-aa6e-77a174efa9db admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:05.734216 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-80a930d4-e759-4878-aa6e-77a174efa9db admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:05.790605 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-80a930d4-e759-4878-aa6e-77a174efa9db admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:05.793661 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-80a930d4-e759-4878-aa6e-77a174efa9db admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:05.794873 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-80a930d4-e759-4878-aa6e-77a174efa9db admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/b3e60481-6cb9-4a06-878e-f06a45cf0cd1 HTTP/1.1" status: 204 len: 168 time: 0.1449132 Dec 24 05:02:05.803386 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80a930d4-e759-4878-aa6e-77a174efa9db admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b3e60481-6cb9-4a06-878e-f06a45cf0cd1,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:06.851940 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6eb3515-4a70-4ce8-8f32-573f616819c6 req-3cbeef89-d7ac-408b-bc3a-dd13cc9a6b41 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:06.861350 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c6eb3515-4a70-4ce8-8f32-573f616819c6 req-3cbeef89-d7ac-408b-bc3a-dd13cc9a6b41 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0733578 Dec 24 05:02:06.933706 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c6eb3515-4a70-4ce8-8f32-573f616819c6 req-c6c22aa4-54f6-44e6-bee3-dc8c2a28ad61 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712278 Dec 24 05:02:07.006102 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 56502) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:02:07.130567 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e0d9a564-f6ce-4781-988a-4f3483e5a271 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:07.226388 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e0d9a564-f6ce-4781-988a-4f3483e5a271 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:07.231603 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e0d9a564-f6ce-4781-988a-4f3483e5a271 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:07.278209 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0d9a564-f6ce-4781-988a-4f3483e5a271 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fa8878e8-2741-4eae-8c72-b3f83ad7cc8a,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:07.287632 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-e0d9a564-f6ce-4781-988a-4f3483e5a271 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=f9dfd8d9ddc64e8b8f89b55ee841135c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2781241 Dec 24 05:02:07.288156 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 56508) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:02:07.366131 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-4bee2b5e-2f9a-46c5-97c5-c63981479e2e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:07.403123 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-4bee2b5e-2f9a-46c5-97c5-c63981479e2e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:07.481111 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-4bee2b5e-2f9a-46c5-97c5-c63981479e2e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:07.484048 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-4bee2b5e-2f9a-46c5-97c5-c63981479e2e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:07.486191 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-4bee2b5e-2f9a-46c5-97c5-c63981479e2e admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/fa8878e8-2741-4eae-8c72-b3f83ad7cc8a HTTP/1.1" status: 204 len: 168 time: 0.1967788 Dec 24 05:02:07.506250 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bee2b5e-2f9a-46c5-97c5-c63981479e2e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fa8878e8-2741-4eae-8c72-b3f83ad7cc8a,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:07.739341 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 56528) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:02:07.883394 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 56534) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:02:07.902953 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f6239937-0c11-440b-95d5-949bdd55737c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:07.925726 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-5b95f1ae-2c4e-49b9-90c8-36b651a5fa4e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:08.056232 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f6239937-0c11-440b-95d5-949bdd55737c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:08.081618 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f6239937-0c11-440b-95d5-949bdd55737c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:08.123081 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-5b95f1ae-2c4e-49b9-90c8-36b651a5fa4e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:08.138535 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-5b95f1ae-2c4e-49b9-90c8-36b651a5fa4e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:08.147213 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 56544) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:02:08.147919 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-f6239937-0c11-440b-95d5-949bdd55737c admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=9250e0222ac942fdb82cf40c147ec203&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2628202 Dec 24 05:02:08.154279 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6239937-0c11-440b-95d5-949bdd55737c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c32b2ab-ac6d-4feb-920e-10e17c6fcb0e,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:08.176237 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9305e53a-213f-4867-a2a0-14fe6f255318 req-a2630395-3cd0-4b4f-ae64-de021b889dd6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:08.177919 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-9305e53a-213f-4867-a2a0-14fe6f255318 req-a2630395-3cd0-4b4f-ae64-de021b889dd6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.1385188 Dec 24 05:02:08.201156 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-5b95f1ae-2c4e-49b9-90c8-36b651a5fa4e admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=2cef64dc84ce4b078d87def0a50d04fc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4601030 Dec 24 05:02:08.201946 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 56546) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:02:08.219681 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b95f1ae-2c4e-49b9-90c8-36b651a5fa4e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0cf1403e-42ac-4d07-b7e4-62f3666f550e,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:08.220316 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c44c94db-5c3e-4536-bdb1-811b218c60de admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:08.243217 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c44c94db-5c3e-4536-bdb1-811b218c60de admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:08.258160 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-9305e53a-213f-4867-a2a0-14fe6f255318 req-e0d8f2a5-106f-4a29-b8f5-992bb1dbb112 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0671835 Dec 24 05:02:08.301850 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c61a0235-e729-4aad-a41b-18b8531d3cbb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:08.324450 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c61a0235-e729-4aad-a41b-18b8531d3cbb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:08.350426 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c44c94db-5c3e-4536-bdb1-811b218c60de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:08.353006 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c44c94db-5c3e-4536-bdb1-811b218c60de admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:08.354370 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-c44c94db-5c3e-4536-bdb1-811b218c60de admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/0c32b2ab-ac6d-4feb-920e-10e17c6fcb0e HTTP/1.1" status: 204 len: 168 time: 0.2060647 Dec 24 05:02:08.373703 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c44c94db-5c3e-4536-bdb1-811b218c60de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c32b2ab-ac6d-4feb-920e-10e17c6fcb0e,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:08.406403 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c61a0235-e729-4aad-a41b-18b8531d3cbb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:08.412416 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c61a0235-e729-4aad-a41b-18b8531d3cbb admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:08.416085 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-c61a0235-e729-4aad-a41b-18b8531d3cbb admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/0cf1403e-42ac-4d07-b7e4-62f3666f550e HTTP/1.1" status: 204 len: 168 time: 0.2086244 Dec 24 05:02:08.424392 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c61a0235-e729-4aad-a41b-18b8531d3cbb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0cf1403e-42ac-4d07-b7e4-62f3666f550e,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:08.881898 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 56558) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:02:08.895793 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ba999e3f-9946-4d80-a168-d9dfa572d881 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:09.020088 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ba999e3f-9946-4d80-a168-d9dfa572d881 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:09.025406 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ba999e3f-9946-4d80-a168-d9dfa572d881 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:09.078186 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-ba999e3f-9946-4d80-a168-d9dfa572d881 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=2e5022f9a8e64ae8a6a07a880fe829f7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1951678 Dec 24 05:02:09.079104 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba999e3f-9946-4d80-a168-d9dfa572d881 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=462cd761-6cfe-4073-a383-5109e4293765,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:09.080807 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 56570) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:02:09.173713 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c48acab0-2181-4904-9f1b-9f3643d3716c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:09.199397 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c48acab0-2181-4904-9f1b-9f3643d3716c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:09.268553 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c48acab0-2181-4904-9f1b-9f3643d3716c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:09.271809 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c48acab0-2181-4904-9f1b-9f3643d3716c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:09.273134 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-c48acab0-2181-4904-9f1b-9f3643d3716c admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/462cd761-6cfe-4073-a383-5109e4293765 HTTP/1.1" status: 204 len: 168 time: 0.1906693 Dec 24 05:02:09.283515 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c48acab0-2181-4904-9f1b-9f3643d3716c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=462cd761-6cfe-4073-a383-5109e4293765,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:09.465099 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7102452-4741-4376-b1e8-41c61be40ec1 req-81813df3-0f06-4593-b47e-d7b9c9ba11f7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:09.473584 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e7102452-4741-4376-b1e8-41c61be40ec1 req-81813df3-0f06-4593-b47e-d7b9c9ba11f7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0745173 Dec 24 05:02:09.556240 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e7102452-4741-4376-b1e8-41c61be40ec1 req-7d237426-18bf-4447-8c6e-142cfca2dbb0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0771525 Dec 24 05:02:12.236604 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b2f9c11-947b-44da-a117-1705eb98b046 req-a1393b84-8c47-4edc-be09-285e967e0538 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:12.241257 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3b2f9c11-947b-44da-a117-1705eb98b046 req-a1393b84-8c47-4edc-be09-285e967e0538 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0570710 Dec 24 05:02:12.291115 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3b2f9c11-947b-44da-a117-1705eb98b046 req-d64f965d-c3c4-4060-bfb7-1545a2ba3efe tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461936 Dec 24 05:02:14.759474 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 56796) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:02:14.968756 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6d231dac-1918-4609-bed1-14beac6ca2fe admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:15.085274 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6d231dac-1918-4609-bed1-14beac6ca2fe admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:15.091946 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6d231dac-1918-4609-bed1-14beac6ca2fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:15.134303 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-6d231dac-1918-4609-bed1-14beac6ca2fe admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=0ac8f71efa214005afee4763d429edbe&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3737288 Dec 24 05:02:15.135566 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d231dac-1918-4609-bed1-14beac6ca2fe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=317efcec-c3fc-4908-9d90-854d03752a47,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:15.137079 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 56804) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:02:15.203675 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ce3a2611-96d9-45ba-a953-e1978bd7733a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:15.232662 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ce3a2611-96d9-45ba-a953-e1978bd7733a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:15.290903 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ce3a2611-96d9-45ba-a953-e1978bd7733a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:15.294131 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ce3a2611-96d9-45ba-a953-e1978bd7733a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:15.300840 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-ce3a2611-96d9-45ba-a953-e1978bd7733a admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/317efcec-c3fc-4908-9d90-854d03752a47 HTTP/1.1" status: 204 len: 168 time: 0.1599157 Dec 24 05:02:15.314110 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce3a2611-96d9-45ba-a953-e1978bd7733a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=317efcec-c3fc-4908-9d90-854d03752a47,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:17.702208 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-fb83c5f2-0b4f-4463-a48a-6a1dc3c62138 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:17.703639 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-fb83c5f2-0b4f-4463-a48a-6a1dc3c62138 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/networks?id=b92a87f3-957a-4ccb-9b5b-98ad92aebe6e HTTP/1.1" status: 200 len: 815 time: 0.2769744 Dec 24 05:02:17.718639 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-6c613d0d-73f7-428e-ba24-bc5ad9657d9a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/quotas/8f1c3a94f02049e3a76c4fc01fa7a022 HTTP/1.1" status: 200 len: 375 time: 0.0092800 Dec 24 05:02:17.773906 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-ebfb0c21-0216-4453-a74b-629262fcfc15 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=8f1c3a94f02049e3a76c4fc01fa7a022&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0479360 Dec 24 05:02:17.863124 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-7d5f676e-3ea9-43e5-8242-f58c832caed7 service neutron] 10.222.0.43 "GET /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0818610 Dec 24 05:02:17.965979 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-1201ab53-4ebf-4427-94a6-96485043e5f4 service neutron] 10.222.0.43 "GET /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0966766 Dec 24 05:02:18.128544 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-428f9e19-6992-40da-9cda-149be90cce70 req-8edb220f-4db9-40e0-baef-91d7ab9a59a3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 210 time: 0.0259807 Dec 24 05:02:18.305898 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bc9c1020-08b9-444e-874c-43c332c25340 req-8db1b2c8-48e0-4b8d-a6ab-d5a1d38639c2 service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0404317 Dec 24 05:02:18.390888 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc9c1020-08b9-444e-874c-43c332c25340 req-fa6a38de-a115-4743-83ec-c70153369eda service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:18.392428 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bc9c1020-08b9-444e-874c-43c332c25340 req-fa6a38de-a115-4743-83ec-c70153369eda service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=1b651e55b1a349a0b9582c526d3b5d67&device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 1098 time: 0.0497980 Dec 24 05:02:18.509302 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc9c1020-08b9-444e-874c-43c332c25340 req-d38e406d-cdd4-40d1-93e6-441c2d889736 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:18.510870 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bc9c1020-08b9-444e-874c-43c332c25340 req-d38e406d-cdd4-40d1-93e6-441c2d889736 service neutron] 10.222.0.46 "GET /v2.0/networks?id=0d368baa-5733-40a7-b836-139a541f4ebb HTTP/1.1" status: 200 len: 919 time: 0.0968814 Dec 24 05:02:18.572777 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bc9c1020-08b9-444e-874c-43c332c25340 req-e1153f19-782c-44f4-8781-2d041ca9546f service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ea61b5c0-ffb7-42bf-9289-095515c125a2 HTTP/1.1" status: 200 len: 217 time: 0.0478222 Dec 24 05:02:18.658231 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc9c1020-08b9-444e-874c-43c332c25340 req-9a81ca4c-0169-47a9-8ea7-a43a5324b764 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:18.659855 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bc9c1020-08b9-444e-874c-43c332c25340 req-9a81ca4c-0169-47a9-8ea7-a43a5324b764 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=88f274d6-bcf0-47e8-9f0a-783a53214be4 HTTP/1.1" status: 200 len: 858 time: 0.0617840 Dec 24 05:02:18.722961 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bc9c1020-08b9-444e-874c-43c332c25340 req-0a8be086-4c01-4efb-9543-ab3655cb649a service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=0d368baa-5733-40a7-b836-139a541f4ebb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0271556 Dec 24 05:02:18.865574 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bc9c1020-08b9-444e-874c-43c332c25340 req-778e9211-ec45-4171-8900-8d2f824870fe service neutron] 10.222.0.46 "GET /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0921249 Dec 24 05:02:18.986180 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bc9c1020-08b9-444e-874c-43c332c25340 req-d91882fa-7381-403b-875d-13a8143dad2d service neutron] 10.222.0.46 "GET /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0988820 Dec 24 05:02:19.195884 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-f99cdf5e-402f-4013-90ae-9306021a7812 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/networks?tenant_id=aad82f86c5b5403799701feca92f316e&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0293205 Dec 24 05:02:19.244673 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-79bb6746-cf55-4c8c-a219-c7d01a2be0de req-4d621698-b39a-4284-afaa-acd20cadef53 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 210 time: 0.0307903 Dec 24 05:02:19.425580 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-679c6100-b907-4af7-bac8-63a11489e88e tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:19.425920 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:19.427013 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-679c6100-b907-4af7-bac8-63a11489e88e tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2122028 Dec 24 05:02:19.473417 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-6788620c-d3e9-40ba-be78-6e5e23d25528 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/quotas/aad82f86c5b5403799701feca92f316e HTTP/1.1" status: 200 len: 375 time: 0.0385578 Dec 24 05:02:19.522723 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-fb26b14c-6571-41ef-9807-05de1005ddcc tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=aad82f86c5b5403799701feca92f316e&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0391300 Dec 24 05:02:19.546193 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-91d0c546-5a9a-481e-b57c-0b6449fc7de7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:19.547635 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-91d0c546-5a9a-481e-b57c-0b6449fc7de7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.46 "GET /v2.0/networks?id=b92a87f3-957a-4ccb-9b5b-98ad92aebe6e HTTP/1.1" status: 200 len: 815 time: 0.1583478 Dec 24 05:02:19.585607 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-d99c4a3a-9c66-4cae-bd1a-c926f5bcf096 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Request body: {'port': {'device_id': '6e67ec17-823b-4612-8bd4-dbe278717d5e', 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e', 'admin_state_up': True, 'tenant_id': '8f1c3a94f02049e3a76c4fc01fa7a022'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:02:19.706326 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a2ec2587-ae51-4640-aebd-5ed7e1751cf5 req-964e6dc3-c4ff-4ad7-b6b1-866cc08eee9b tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/ports?device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 210 time: 0.0271478 Dec 24 05:02:19.717877 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-d99c4a3a-9c66-4cae-bd1a-c926f5bcf096 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Made reservation on behalf of 8f1c3a94f02049e3a76c4fc01fa7a022 for: {'port': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:02:19.724139 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-d99c4a3a-9c66-4cae-bd1a-c926f5bcf096 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:19.876641 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-d99c4a3a-9c66-4cae-bd1a-c926f5bcf096 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Allocated IP 172.20.0.6 (b92a87f3-957a-4ccb-9b5b-98ad92aebe6e/9b9ff65f-93c8-4cb1-8a99-961ba0d4beaa/7484fcf7-0384-4cf4-8974-7df317686b39) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:02:20.033041 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-d99c4a3a-9c66-4cae-bd1a-c926f5bcf096 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:20.070634 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-d99c4a3a-9c66-4cae-bd1a-c926f5bcf096 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:20.118700 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-d99c4a3a-9c66-4cae-bd1a-c926f5bcf096 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Network b92a87f3-957a-4ccb-9b5b-98ad92aebe6e is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:02:20.122775 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-d99c4a3a-9c66-4cae-bd1a-c926f5bcf096 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:02:20.128327 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-d99c4a3a-9c66-4cae-bd1a-c926f5bcf096 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:02:20.135012 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['50d50f46-e761-4fb1-9761-fa48778aa8aa', 'b0bd939a-1211-4ec1-b074-b2767d087f95', '13f44c71-4981-48aa-bff5-6222de8d0cc1'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:02:20.154719 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d99c4a3a-9c66-4cae-bd1a-c926f5bcf096 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Pushing event updated for resources: {'Port': ['ID=7484fcf7-0384-4cf4-8974-7df317686b39,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:20.186843 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-d99c4a3a-9c66-4cae-bd1a-c926f5bcf096 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:20.187442 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-d99c4a3a-9c66-4cae-bd1a-c926f5bcf096 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:20.205231 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-d99c4a3a-9c66-4cae-bd1a-c926f5bcf096 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.46 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6250167 Dec 24 05:02:20.238696 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-b98f844c-faef-46d9-b9a2-9f1f29e06bef service neutron] Request body: {'port': {'device_id': '6e67ec17-823b-4612-8bd4-dbe278717d5e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81644'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:02:20.300018 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 56984) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:02:20.322505 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-b98f844c-faef-46d9-b9a2-9f1f29e06bef service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:20.391345 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.db_base_plugin_v2 [None req-005c0065-b2b8-4613-ba58-6411dca4af5a admin admin] Deleting subnet b6657dc9-704f-488f-a929-3d0573a04d1f {{(pid=102477) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Dec 24 05:02:20.395968 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-005c0065-b2b8-4613-ba58-6411dca4af5a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:20.426818 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c7e99e8-38f2-4717-91db-1dabdf7ef452 req-1b8ac2e6-5e7e-4cff-8309-806fadc46906 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:20.434892 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6c7e99e8-38f2-4717-91db-1dabdf7ef452 req-1b8ac2e6-5e7e-4cff-8309-806fadc46906 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 931 time: 0.0898018 Dec 24 05:02:20.465680 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-005c0065-b2b8-4613-ba58-6411dca4af5a admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:20.483720 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-005c0065-b2b8-4613-ba58-6411dca4af5a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3590439'] for subnet, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:20.537912 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6c7e99e8-38f2-4717-91db-1dabdf7ef452 req-4559609e-bc49-49dc-a535-cdd4ead410c6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0973456 Dec 24 05:02:20.577184 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-005c0065-b2b8-4613-ba58-6411dca4af5a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3590440', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for subnet, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:20.603263 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-005c0065-b2b8-4613-ba58-6411dca4af5a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b6657dc9-704f-488f-a929-3d0573a04d1f,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:20.609095 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-005c0065-b2b8-4613-ba58-6411dca4af5a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:20.612762 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-005c0065-b2b8-4613-ba58-6411dca4af5a admin admin] 10.222.0.43 "DELETE /v2.0/subnets/b6657dc9-704f-488f-a929-3d0573a04d1f HTTP/1.1" status: 204 len: 168 time: 0.3103878 Dec 24 05:02:20.615334 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 56988) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:02:20.682580 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-b98f844c-faef-46d9-b9a2-9f1f29e06bef service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7484fcf7-0384-4cf4-8974-7df317686b39 {{(pid=102476) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:02:20.691058 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3741433'] for network, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:20.691712 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-b98f844c-faef-46d9-b9a2-9f1f29e06bef service neutron] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:20.704774 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.provisioning_blocks [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-b98f844c-faef-46d9-b9a2-9f1f29e06bef service neutron] Transition to ACTIVE for port object 7484fcf7-0384-4cf4-8974-7df317686b39 will not be triggered until provisioned by entity L2. {{(pid=102476) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 24 05:02:20.710665 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-b98f844c-faef-46d9-b9a2-9f1f29e06bef service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:20.784862 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b98f844c-faef-46d9-b9a2-9f1f29e06bef service neutron] Pushing event updated for resources: {'Port': ['ID=7484fcf7-0384-4cf4-8974-7df317686b39,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:20.792064 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3595960', 'neutron.services.segments.db._delete_segments_for_network-8750577966942'] for network, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:20.813690 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=102477) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 05:02:20.814301 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=102477) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 05:02:20.815213 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102477) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 05:02:20.815733 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] Subscribe: > port after_create 55550000 {{(pid=102477) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 05:02:20.816239 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] Subscribe: > port after_delete 55550000 {{(pid=102477) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 05:02:20.816600 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] Subscribe: > port after_update 55550000 {{(pid=102477) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 05:02:20.817072 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=102477) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 05:02:20.817576 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102477) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 05:02:20.817903 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102477) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 05:02:20.818233 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=102477) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 05:02:20.829796 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e3abf692-088a-4f53-b8f8-72636a39563e req-c08e8d8d-9552-479a-a7fa-9ab47fe0ad6a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/ports?device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 210 time: 0.0470192 Dec 24 05:02:20.860348 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-b98f844c-faef-46d9-b9a2-9f1f29e06bef service neutron] Attempting to bind port 7484fcf7-0384-4cf4-8974-7df317686b39 on host hv-cinder-81644 for vnic_type normal with profile {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:02:20.860716 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-b98f844c-faef-46d9-b9a2-9f1f29e06bef service neutron] Attempting to bind port 7484fcf7-0384-4cf4-8974-7df317686b39 by drivers openvswitch,hyperv on host hv-cinder-81644 at level 0 using segments [{'id': '10307c97-e214-473b-b760-bb1b770153ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e'}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:02:20.861044 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-b98f844c-faef-46d9-b9a2-9f1f29e06bef service neutron] Attempting to bind port 7484fcf7-0384-4cf4-8974-7df317686b39 on network b92a87f3-957a-4ccb-9b5b-98ad92aebe6e {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:02:20.865676 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-b98f844c-faef-46d9-b9a2-9f1f29e06bef service neutron] Port 7484fcf7-0384-4cf4-8974-7df317686b39 on network b92a87f3-957a-4ccb-9b5b-98ad92aebe6e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81644 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 24 05:02:20.865992 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-b98f844c-faef-46d9-b9a2-9f1f29e06bef service neutron] Attempting to bind port 7484fcf7-0384-4cf4-8974-7df317686b39 on network b92a87f3-957a-4ccb-9b5b-98ad92aebe6e {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:02:20.871394 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-b98f844c-faef-46d9-b9a2-9f1f29e06bef service neutron] Checking agent: {'id': '7a2ffd19-371f-4f7b-a239-eea3b5cfd55b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81644', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'started_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 2, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:02:20.871715 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-b98f844c-faef-46d9-b9a2-9f1f29e06bef service neutron] Checking segment: {'id': '10307c97-e214-473b-b760-bb1b770153ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:02:20.872085 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-b98f844c-faef-46d9-b9a2-9f1f29e06bef service neutron] Bound using segment: {'id': '10307c97-e214-473b-b760-bb1b770153ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e'} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:02:20.872500 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-b98f844c-faef-46d9-b9a2-9f1f29e06bef service neutron] Bound port: 7484fcf7-0384-4cf4-8974-7df317686b39, host: hv-cinder-81644, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '10307c97-e214-473b-b760-bb1b770153ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e'}}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:02:20.872920 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-b98f844c-faef-46d9-b9a2-9f1f29e06bef service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:20.897264 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102477) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 05:02:20.897638 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102477) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 05:02:20.897976 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=102477) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 05:02:20.898306 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=102477) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 24 05:02:20.898674 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.services.segments.db [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c2c27570-f2cd-4dac-9473-e82a4e432501']}} {{(pid=102477) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:02:20.915654 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.services.segments.db [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '00999af0-b9ae-4a2b-9c30-590dbe00c43a') {'for_net_delete': True} {{(pid=102477) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:02:20.915951 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.services.segments.db [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '00999af0-b9ae-4a2b-9c30-590dbe00c43a') {} {{(pid=102477) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:02:20.931631 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750577970535', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-29535605'] for segment, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:20.934609 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-b98f844c-faef-46d9-b9a2-9f1f29e06bef service neutron] For port 7484fcf7-0384-4cf4-8974-7df317686b39, host hv-cinder-81644, cleared binding levels {{(pid=102476) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:02:20.939239 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-b98f844c-faef-46d9-b9a2-9f1f29e06bef service neutron] For port 7484fcf7-0384-4cf4-8974-7df317686b39, host hv-cinder-81644, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=7484fcf7-0384-4cf4-8974-7df317686b39,segment=NetworkSegment(10307c97-e214-473b-b760-bb1b770153ec),segment_id=10307c97-e214-473b-b760-bb1b770153ec)] {{(pid=102476) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:02:20.950885 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-b98f844c-faef-46d9-b9a2-9f1f29e06bef service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:20.955613 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:20.964434 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] Releasing vlan 103 on physical network physnet1 to pool {{(pid=102477) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 24 05:02:20.965020 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29532823'] for segment, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: from cryptography.utils import int_from_bytes Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: from cryptography.utils import int_from_bytes Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:02:20.969330 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: Traceback (most recent call last): Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: timer() Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: cb(*args, **kw) Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: return func(*args, **kwargs) Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: self._notify() Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: self.callback(batched_events) Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: event.method(event) Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: aggregate_uuid = self.p_client.list_aggregates( Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: return f(self, *a, **k) Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: return self._get(url).json() Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: return self.request(url, 'GET', **kwargs) Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: base_url = self.get_endpoint(auth, allow=allow, Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 24 05:02:20.973859 dv-cinder-816443-2-iscsi neutron-server[102477]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 24 05:02:20.997371 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-b98f844c-faef-46d9-b9a2-9f1f29e06bef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:20.997890 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-b98f844c-faef-46d9-b9a2-9f1f29e06bef service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:20.999464 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-b98f844c-faef-46d9-b9a2-9f1f29e06bef service neutron] 10.222.0.46 "PUT /v2.0/ports/7484fcf7-0384-4cf4-8974-7df317686b39 HTTP/1.1" status: 200 len: 1093 time: 0.7655895 Dec 24 05:02:21.001755 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6e67ec17-823b-4612-8bd4-dbe278717d5e', 'tag': '7484fcf7-0384-4cf4-8974-7df317686b39'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:02:21.004281 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7a476bd0-690c-4414-839a-0b9e1a10522c" -d '{"events": [{"name": "network-changed", "server_uuid": "6e67ec17-823b-4612-8bd4-dbe278717d5e", "tag": "7484fcf7-0384-4cf4-8974-7df317686b39"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:02:21.027678 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b98f844c-faef-46d9-b9a2-9f1f29e06bef service neutron] Pushing event updated for resources: {'Port': ['ID=7484fcf7-0384-4cf4-8974-7df317686b39,revision_number=3']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:21.043989 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3595937', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-546046'] for network, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:21.049987 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:21.055664 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] 10.222.0.43 "DELETE /v2.0/networks/c2c27570-f2cd-4dac-9473-e82a4e432501 HTTP/1.1" status: 204 len: 168 time: 0.4369798 Dec 24 05:02:21.061529 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:02:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fd056d72-4ad4-4649-a075-bc9e59949c67 x-openstack-request-id: req-fd056d72-4ad4-4649-a075-bc9e59949c67 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:02:21.061820 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6e67ec17-823b-4612-8bd4-dbe278717d5e", "tag": "7484fcf7-0384-4cf4-8974-7df317686b39", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:02:21.062078 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-fd056d72-4ad4-4649-a075-bc9e59949c67 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:02:21.062502 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6e67ec17-823b-4612-8bd4-dbe278717d5e', 'tag': '7484fcf7-0384-4cf4-8974-7df317686b39', 'status': 'completed', 'code': 200} Dec 24 05:02:21.070610 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-389100ef-d282-4d72-bc47-4e4b364acc60 admin admin] Pushing event deleted for resources: {'Network': ['ID=c2c27570-f2cd-4dac-9473-e82a4e432501,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:21.159191 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-84219397-53dd-4988-bb4a-cf8ee9873c4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:21.160726 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-84219397-53dd-4988-bb4a-cf8ee9873c4b service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=8f1c3a94f02049e3a76c4fc01fa7a022&device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 1096 time: 0.0409853 Dec 24 05:02:21.218840 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-9d8aff6b-4b1d-49a7-b646-cb417057b3a2 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=7484fcf7-0384-4cf4-8974-7df317686b39 HTTP/1.1" status: 200 len: 217 time: 0.0373251 Dec 24 05:02:21.231967 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 57002) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:02:21.282771 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-3f909be1-391f-4ad3-90db-8c634ebca100 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=1e014b3683d841968563e0aa0705e862&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0493469 Dec 24 05:02:21.285614 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 57006) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:02:21.327263 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-00e9c438-483a-474d-b8bd-72b4d5462ccb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:21.328978 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-00e9c438-483a-474d-b8bd-72b4d5462ccb service neutron] 10.222.0.46 "GET /v2.0/subnets?id=9b9ff65f-93c8-4cb1-8a99-961ba0d4beaa HTTP/1.1" status: 200 len: 855 time: 0.0755041 Dec 24 05:02:21.349267 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-3cda7dd7-9f74-4e6e-a6eb-d70bda30501a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:21.368826 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-6fd0f2ff-4d22-41fe-baed-dd235a3a7c99 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=b92a87f3-957a-4ccb-9b5b-98ad92aebe6e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0282197 Dec 24 05:02:21.377494 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-3cda7dd7-9f74-4e6e-a6eb-d70bda30501a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:21.444993 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-3cda7dd7-9f74-4e6e-a6eb-d70bda30501a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:21.452044 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-3cda7dd7-9f74-4e6e-a6eb-d70bda30501a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:21.453309 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-3cda7dd7-9f74-4e6e-a6eb-d70bda30501a admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/4e2bef2c-8155-47f6-8213-b403361d85dc HTTP/1.1" status: 204 len: 168 time: 0.1665204 Dec 24 05:02:21.463180 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cda7dd7-9f74-4e6e-a6eb-d70bda30501a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4e2bef2c-8155-47f6-8213-b403361d85dc,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:21.504702 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-1e170ddd-e809-4048-9bba-b59bf29995c6 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.46 "GET /v2.0/networks?tenant_id=aad82f86c5b5403799701feca92f316e&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0427208 Dec 24 05:02:21.528019 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-6585afce-26ad-42e9-be32-2c470aa6c77f service neutron] 10.222.0.46 "GET /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1413255 Dec 24 05:02:21.567662 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8114f49f-57f7-4c33-a09e-d6ee1f4671d5 req-783e7142-3ea9-4ab0-8eb6-46033cd33070 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:21.577986 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8114f49f-57f7-4c33-a09e-d6ee1f4671d5 req-783e7142-3ea9-4ab0-8eb6-46033cd33070 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0649636 Dec 24 05:02:21.658685 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8114f49f-57f7-4c33-a09e-d6ee1f4671d5 req-61bc1f7b-fe2a-415d-a93c-7e9a7a2f4731 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0795321 Dec 24 05:02:21.791745 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6afb449-6d9a-401b-b762-27300b29c53b req-55af3a82-3b9c-4a37-8e74-f40d8799b35d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:21.793401 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a6afb449-6d9a-401b-b762-27300b29c53b req-55af3a82-3b9c-4a37-8e74-f40d8799b35d service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=1b651e55b1a349a0b9582c526d3b5d67&device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 1098 time: 0.2327683 Dec 24 05:02:21.939165 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-bcbce21b-f1a5-4afc-be63-ea04ba917519 req-4b2271b7-c078-4625-ab89-991f3e7e25a8 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/ports?device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 210 time: 0.0303292 Dec 24 05:02:22.082638 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bb4bc5e8-5b13-4057-b5aa-e67d0b1d0561 req-4dc4f0f7-8af1-4a1f-9a8d-632134750b40 service neutron] 10.222.0.46 "GET /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5252001 Dec 24 05:02:22.092811 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-c76f8b37-c723-478e-b998-9101a20c95fe tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:22.094210 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-c76f8b37-c723-478e-b998-9101a20c95fe tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.46 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.5476654 Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:22.100579 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:02:22.102772 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:22.102772 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:02:22.102772 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:22.102772 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:02:22.102772 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:22.102772 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:02:22.102772 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:22.102772 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:02:22.102772 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:22.102772 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:02:22.102772 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:02:22.102772 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:02:22.102772 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fd7aba9-8126-42ec-b9a3-40a52067659b req-1e8ffbcf-661c-45cc-9b1a-a6ddc73700df tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:22.103540 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9fd7aba9-8126-42ec-b9a3-40a52067659b req-1e8ffbcf-661c-45cc-9b1a-a6ddc73700df tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 943 time: 0.4610600 Dec 24 05:02:22.144650 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-3119e448-9d2c-4f84-84e7-6ceebbca15fb tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Request body: {'port': {'device_id': '1ce0890f-150d-48b6-9be0-b572f7429968', 'network_id': '5e42f823-2f9e-40d8-827b-66cbc7e240b7', 'admin_state_up': True, 'tenant_id': 'aad82f86c5b5403799701feca92f316e'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:02:22.294248 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6afb449-6d9a-401b-b762-27300b29c53b req-a820d216-0116-4310-afea-3f8cd56722ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:22.295648 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a6afb449-6d9a-401b-b762-27300b29c53b req-a820d216-0116-4310-afea-3f8cd56722ab service neutron] 10.222.0.46 "GET /v2.0/networks?id=0d368baa-5733-40a7-b836-139a541f4ebb HTTP/1.1" status: 200 len: 919 time: 0.4862509 Dec 24 05:02:22.301766 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9fd7aba9-8126-42ec-b9a3-40a52067659b req-9c51b38d-a6e1-4ecf-a908-4877cf9f103e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1880736 Dec 24 05:02:22.301997 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 57044) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:02:22.336256 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a476bd0-690c-4414-839a-0b9e1a10522c req-bee2fe8b-59bd-43d8-b7e8-d003a78d5b9e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:22.337876 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7a476bd0-690c-4414-839a-0b9e1a10522c req-bee2fe8b-59bd-43d8-b7e8-d003a78d5b9e service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=8f1c3a94f02049e3a76c4fc01fa7a022&device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 1096 time: 0.1101639 Dec 24 05:02:22.379551 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a6afb449-6d9a-401b-b762-27300b29c53b req-e75c1dd0-1027-464b-8b06-6001eb3265e4 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ea61b5c0-ffb7-42bf-9289-095515c125a2 HTTP/1.1" status: 200 len: 217 time: 0.0545564 Dec 24 05:02:22.412157 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-354e6053-2982-4bd6-9d63-de354838f242 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1039232579-network', 'tenant_id': '122a6a1d32d648c6938f0b159bb3641c'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:02:22.480253 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-3119e448-9d2c-4f84-84e7-6ceebbca15fb tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Made reservation on behalf of aad82f86c5b5403799701feca92f316e for: {'port': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:02:22.483774 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-3119e448-9d2c-4f84-84e7-6ceebbca15fb tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:22.495351 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-354e6053-2982-4bd6-9d63-de354838f242 admin admin] Made reservation on behalf of 122a6a1d32d648c6938f0b159bb3641c for: {'network': 1} {{(pid=102477) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:02:22.497897 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-354e6053-2982-4bd6-9d63-de354838f242 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for network, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:22.502259 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6afb449-6d9a-401b-b762-27300b29c53b req-8b1ea1f8-35ed-4061-bc9f-26cf798fc1d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:22.503742 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a6afb449-6d9a-401b-b762-27300b29c53b req-8b1ea1f8-35ed-4061-bc9f-26cf798fc1d8 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=88f274d6-bcf0-47e8-9f0a-783a53214be4 HTTP/1.1" status: 200 len: 858 time: 0.1104820 Dec 24 05:02:22.506452 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-354e6053-2982-4bd6-9d63-de354838f242 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:22.507569 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-3119e448-9d2c-4f84-84e7-6ceebbca15fb tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:22.555642 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a6afb449-6d9a-401b-b762-27300b29c53b req-747f81c9-2c32-4b72-b101-2c8f5500fc1f service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=0d368baa-5733-40a7-b836-139a541f4ebb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0309060 Dec 24 05:02:22.556671 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a476bd0-690c-4414-839a-0b9e1a10522c req-a803e077-4bab-4924-8d73-a0a0d807d99f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:22.558130 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7a476bd0-690c-4414-839a-0b9e1a10522c req-a803e077-4bab-4924-8d73-a0a0d807d99f service neutron] 10.222.0.46 "GET /v2.0/networks?id=b92a87f3-957a-4ccb-9b5b-98ad92aebe6e HTTP/1.1" status: 200 len: 916 time: 0.1893475 Dec 24 05:02:22.591360 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-354e6053-2982-4bd6-9d63-de354838f242 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:22.596109 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-354e6053-2982-4bd6-9d63-de354838f242 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:22.622699 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-354e6053-2982-4bd6-9d63-de354838f242 admin admin] vlan segment allocate from pool success with {'vlan_id': 122, 'physical_network': 'physnet1'} {{(pid=102477) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 24 05:02:22.626774 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-3119e448-9d2c-4f84-84e7-6ceebbca15fb tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:22.631307 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-3119e448-9d2c-4f84-84e7-6ceebbca15fb tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:22.632337 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-354e6053-2982-4bd6-9d63-de354838f242 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=38ca9ba3-47e8-40b7-b947-05d8baaead6e,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:22.637336 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-354e6053-2982-4bd6-9d63-de354838f242 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:22.637627 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.db.segments_db [None req-354e6053-2982-4bd6-9d63-de354838f242 admin admin] Added segment 45cba16b-d4c1-40eb-8945-69769d27d2b7 of type vlan for network 7d6d1704-2ca9-4ba7-a7ef-cd394e15a741 Dec 24 05:02:22.677518 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-354e6053-2982-4bd6-9d63-de354838f242 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750577486812'] for network, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:22.706027 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-354e6053-2982-4bd6-9d63-de354838f242 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for network, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:22.707228 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-354e6053-2982-4bd6-9d63-de354838f242 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:22.708843 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-354e6053-2982-4bd6-9d63-de354838f242 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:22.743512 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-354e6053-2982-4bd6-9d63-de354838f242 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.4402602 Dec 24 05:02:22.746337 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 57052) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:02:22.751391 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-01e654ed-f359-4829-8b19-3e4cb17adde4 admin admin] Request body: {'subnet': {'network_id': '7d6d1704-2ca9-4ba7-a7ef-cd394e15a741', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1039232579-subnet', 'tenant_id': '122a6a1d32d648c6938f0b159bb3641c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:02:22.762415 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3119e448-9d2c-4f84-84e7-6ceebbca15fb tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Pushing event updated for resources: {'SecurityGroup': ['ID=afc5f95f-b105-4542-8255-46564277a986,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:22.778295 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7a476bd0-690c-4414-839a-0b9e1a10522c req-7553052e-ec61-4518-8a3d-e955d4d0a1a6 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=7484fcf7-0384-4cf4-8974-7df317686b39 HTTP/1.1" status: 200 len: 217 time: 0.0908260 Dec 24 05:02:22.788750 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-354e6053-2982-4bd6-9d63-de354838f242 admin admin] Pushing event updated for resources: {'Network': ['ID=7d6d1704-2ca9-4ba7-a7ef-cd394e15a741,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:22.806672 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Network 7d6d1704-2ca9-4ba7-a7ef-cd394e15a741 details requested by agent ovs-agent-dv-cinder-816443-2-iscsi with host dv-cinder-816443-2-iscsi {{(pid=102478) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 24 05:02:22.813827 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-01e654ed-f359-4829-8b19-3e4cb17adde4 admin admin] Made reservation on behalf of 122a6a1d32d648c6938f0b159bb3641c for: {'subnet': 1} {{(pid=102477) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:02:22.816230 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-01e654ed-f359-4829-8b19-3e4cb17adde4 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-29853115'] for subnet, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:22.968791 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a476bd0-690c-4414-839a-0b9e1a10522c req-cd7fd0b4-61f2-413d-927f-a53d3de08e33 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:22.970295 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7a476bd0-690c-4414-839a-0b9e1a10522c req-cd7fd0b4-61f2-413d-927f-a53d3de08e33 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=9b9ff65f-93c8-4cb1-8a99-961ba0d4beaa HTTP/1.1" status: 200 len: 855 time: 0.1824124 Dec 24 05:02:22.995349 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-3119e448-9d2c-4f84-84e7-6ceebbca15fb tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Allocated IP 192.168.233.179 (5e42f823-2f9e-40d8-827b-66cbc7e240b7/a9a1b303-53dd-4f5e-9ffd-833b6bddf909/d8920e65-30d8-4362-a099-871fe2010a7c) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:02:23.005081 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77fa4b2e-3a21-485e-bff2-85a1ab0669b3 req-0690d382-9e23-4bf2-b666-da236ea26b01 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:23.006504 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-77fa4b2e-3a21-485e-bff2-85a1ab0669b3 req-0690d382-9e23-4bf2-b666-da236ea26b01 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.2196813 Dec 24 05:02:23.007213 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-01e654ed-f359-4829-8b19-3e4cb17adde4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-29535722', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-29853097'] for subnet, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:23.028160 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7a476bd0-690c-4414-839a-0b9e1a10522c req-94c41629-fdfd-4161-823d-a306fe6ad939 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=b92a87f3-957a-4ccb-9b5b-98ad92aebe6e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0435443 Dec 24 05:02:23.041211 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a6afb449-6d9a-401b-b762-27300b29c53b req-d23a39c3-b98a-4217-919b-1d113c8b2938 service neutron] 10.222.0.46 "GET /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3533204 Dec 24 05:02:23.106119 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01e654ed-f359-4829-8b19-3e4cb17adde4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=42c4f72c-ce3e-4cb1-9111-06a2ac0d1641,revision_number=0']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:23.110407 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-36943ccf-c185-4b73-b20f-c07488f025dd req-f8d00edc-6eeb-4525-8859-203bc6999a30 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/ports?device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 210 time: 0.0387235 Dec 24 05:02:23.114128 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-01e654ed-f359-4829-8b19-3e4cb17adde4 admin admin] Checking segment: {'id': '45cba16b-d4c1-40eb-8945-69769d27d2b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '7d6d1704-2ca9-4ba7-a7ef-cd394e15a741'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102477) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:02:23.114485 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-01e654ed-f359-4829-8b19-3e4cb17adde4 admin admin] Network hostable DHCP agents. Network: 7d6d1704-2ca9-4ba7-a7ef-cd394e15a741, hostable agents: ['01bc2530-0600-4d1b-b486-2fd9d63a2d51'], hosted agents: [] {{(pid=102477) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 24 05:02:23.136544 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-01e654ed-f359-4829-8b19-3e4cb17adde4 admin admin] Network 7d6d1704-2ca9-4ba7-a7ef-cd394e15a741 is scheduled to be hosted by DHCP agent 01bc2530-0600-4d1b-b486-2fd9d63a2d51 with binding_index 1 {{(pid=102477) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 24 05:02:23.147224 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-01e654ed-f359-4829-8b19-3e4cb17adde4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816443-2-iscsi, 7d6d1704-2ca9-4ba7-a7ef-cd394e15a741) {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:02:23.155444 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01e654ed-f359-4829-8b19-3e4cb17adde4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:23.156051 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-01e654ed-f359-4829-8b19-3e4cb17adde4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:23.157785 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d174273c-cf4d-41ca-89fd-a78ce91d9447 None None] Network 7d6d1704-2ca9-4ba7-a7ef-cd394e15a741 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:02:23.178124 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-01e654ed-f359-4829-8b19-3e4cb17adde4 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.4297931 Dec 24 05:02:23.225441 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-472d35e0-1a90-462a-94be-07c17ca64a67 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:23.272894 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-77fa4b2e-3a21-485e-bff2-85a1ab0669b3 req-d1a5d334-2014-49ef-b166-efb1dcf81d76 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2422476 Dec 24 05:02:23.276823 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d62843d4-c2e4-45e4-953a-4d5af9b7b65d None None] Network 7d6d1704-2ca9-4ba7-a7ef-cd394e15a741 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:02:23.338364 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7a476bd0-690c-4414-839a-0b9e1a10522c req-e4cecc05-1001-435a-8d64-53f2bbca1d40 service neutron] 10.222.0.46 "GET /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2953095 Dec 24 05:02:23.344966 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a6afb449-6d9a-401b-b762-27300b29c53b req-89f33b57-c3d8-4006-8406-9cc84b4e994c service neutron] 10.222.0.46 "GET /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2941480 Dec 24 05:02:23.415586 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-3119e448-9d2c-4f84-84e7-6ceebbca15fb tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:23.469556 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26e74bd2-073a-4070-9f01-d89cc93f41d2 req-6db03b32-df09-458c-bdfa-74606272d7aa tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:23.477980 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-26e74bd2-073a-4070-9f01-d89cc93f41d2 req-6db03b32-df09-458c-bdfa-74606272d7aa tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 943 time: 0.0724325 Dec 24 05:02:23.498071 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7a476bd0-690c-4414-839a-0b9e1a10522c req-c00547d1-2216-4fb5-b709-69899bb2362f service neutron] 10.222.0.46 "GET /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1288335 Dec 24 05:02:23.504349 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-3119e448-9d2c-4f84-84e7-6ceebbca15fb tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:23.524760 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-26e74bd2-073a-4070-9f01-d89cc93f41d2 req-c03f1591-7bcb-4a3c-adef-0946b737123a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457535 Dec 24 05:02:23.555039 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-3119e448-9d2c-4f84-84e7-6ceebbca15fb tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Network 5e42f823-2f9e-40d8-827b-66cbc7e240b7 is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:02:23.559078 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-3119e448-9d2c-4f84-84e7-6ceebbca15fb tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:02:23.560997 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3119e448-9d2c-4f84-84e7-6ceebbca15fb tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Pushing event updated for resources: {'Port': ['ID=d8920e65-30d8-4362-a099-871fe2010a7c,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:23.563095 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-3119e448-9d2c-4f84-84e7-6ceebbca15fb tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:02:23.614664 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-3119e448-9d2c-4f84-84e7-6ceebbca15fb tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:23.615296 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-3119e448-9d2c-4f84-84e7-6ceebbca15fb tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:23.644585 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-3119e448-9d2c-4f84-84e7-6ceebbca15fb tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.46 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.5274327 Dec 24 05:02:23.671783 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-67ce99e4-b950-4011-a7aa-8f24cd716067 service neutron] Request body: {'port': {'device_id': '1ce0890f-150d-48b6-9be0-b572f7429968', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81644'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:02:23.734332 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-67ce99e4-b950-4011-a7aa-8f24cd716067 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:23.826462 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-db2c7794-1a0d-4567-8a03-3bb7b849094d None None] Provisioning complete for port d8920e65-30d8-4362-a099-871fe2010a7c triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:02:23.826984 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-db2c7794-1a0d-4567-8a03-3bb7b849094d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:23.884986 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-db2c7794-1a0d-4567-8a03-3bb7b849094d None None] Port d8920e65-30d8-4362-a099-871fe2010a7c cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 05:02:24.033163 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-67ce99e4-b950-4011-a7aa-8f24cd716067 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d8920e65-30d8-4362-a099-871fe2010a7c {{(pid=102476) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:02:24.040456 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-67ce99e4-b950-4011-a7aa-8f24cd716067 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:24.052493 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.provisioning_blocks [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-67ce99e4-b950-4011-a7aa-8f24cd716067 service neutron] Transition to ACTIVE for port object d8920e65-30d8-4362-a099-871fe2010a7c will not be triggered until provisioned by entity L2. {{(pid=102476) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 24 05:02:24.058766 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-67ce99e4-b950-4011-a7aa-8f24cd716067 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:24.111831 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67ce99e4-b950-4011-a7aa-8f24cd716067 service neutron] Pushing event updated for resources: {'Port': ['ID=d8920e65-30d8-4362-a099-871fe2010a7c,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:24.188191 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-67ce99e4-b950-4011-a7aa-8f24cd716067 service neutron] Attempting to bind port d8920e65-30d8-4362-a099-871fe2010a7c on host hv-cinder-81644 for vnic_type normal with profile {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:02:24.188595 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-67ce99e4-b950-4011-a7aa-8f24cd716067 service neutron] Attempting to bind port d8920e65-30d8-4362-a099-871fe2010a7c by drivers openvswitch,hyperv on host hv-cinder-81644 at level 0 using segments [{'id': '12eac7f7-f84a-41ca-ba10-cc6036d850a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '5e42f823-2f9e-40d8-827b-66cbc7e240b7'}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:02:24.188912 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-67ce99e4-b950-4011-a7aa-8f24cd716067 service neutron] Attempting to bind port d8920e65-30d8-4362-a099-871fe2010a7c on network 5e42f823-2f9e-40d8-827b-66cbc7e240b7 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:02:24.193747 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-67ce99e4-b950-4011-a7aa-8f24cd716067 service neutron] Port d8920e65-30d8-4362-a099-871fe2010a7c on network 5e42f823-2f9e-40d8-827b-66cbc7e240b7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81644 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 24 05:02:24.194080 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-67ce99e4-b950-4011-a7aa-8f24cd716067 service neutron] Attempting to bind port d8920e65-30d8-4362-a099-871fe2010a7c on network 5e42f823-2f9e-40d8-827b-66cbc7e240b7 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:02:24.199300 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-67ce99e4-b950-4011-a7aa-8f24cd716067 service neutron] Checking agent: {'id': '7a2ffd19-371f-4f7b-a239-eea3b5cfd55b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81644', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'started_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 2, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:02:24.199643 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-67ce99e4-b950-4011-a7aa-8f24cd716067 service neutron] Checking segment: {'id': '12eac7f7-f84a-41ca-ba10-cc6036d850a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '5e42f823-2f9e-40d8-827b-66cbc7e240b7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:02:24.200027 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-67ce99e4-b950-4011-a7aa-8f24cd716067 service neutron] Bound using segment: {'id': '12eac7f7-f84a-41ca-ba10-cc6036d850a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '5e42f823-2f9e-40d8-827b-66cbc7e240b7'} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:02:24.200477 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-67ce99e4-b950-4011-a7aa-8f24cd716067 service neutron] Bound port: d8920e65-30d8-4362-a099-871fe2010a7c, host: hv-cinder-81644, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '12eac7f7-f84a-41ca-ba10-cc6036d850a8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '5e42f823-2f9e-40d8-827b-66cbc7e240b7'}}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:02:24.200845 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-67ce99e4-b950-4011-a7aa-8f24cd716067 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:24.251311 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb44e2db-4a93-4938-b05f-1359f71396a3 req-31fde949-a2ae-4e38-82a0-512af7ef7bc5 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:24.252864 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-eb44e2db-4a93-4938-b05f-1359f71396a3 req-31fde949-a2ae-4e38-82a0-512af7ef7bc5 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/ports?device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 948 time: 0.0597365 Dec 24 05:02:24.280895 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-67ce99e4-b950-4011-a7aa-8f24cd716067 service neutron] For port d8920e65-30d8-4362-a099-871fe2010a7c, host hv-cinder-81644, cleared binding levels {{(pid=102476) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:02:24.284214 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-67ce99e4-b950-4011-a7aa-8f24cd716067 service neutron] For port d8920e65-30d8-4362-a099-871fe2010a7c, host hv-cinder-81644, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=d8920e65-30d8-4362-a099-871fe2010a7c,segment=NetworkSegment(12eac7f7-f84a-41ca-ba10-cc6036d850a8),segment_id=12eac7f7-f84a-41ca-ba10-cc6036d850a8)] {{(pid=102476) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:02:24.289040 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-67ce99e4-b950-4011-a7aa-8f24cd716067 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:24.299995 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-eb44e2db-4a93-4938-b05f-1359f71396a3 req-5afb4d84-8c6b-4435-b53c-389dea2f3526 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/security-groups?id=afc5f95f-b105-4542-8255-46564277a986&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409973 Dec 24 05:02:24.330856 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-67ce99e4-b950-4011-a7aa-8f24cd716067 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:24.331758 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-67ce99e4-b950-4011-a7aa-8f24cd716067 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:24.333373 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-67ce99e4-b950-4011-a7aa-8f24cd716067 service neutron] 10.222.0.46 "PUT /v2.0/ports/d8920e65-30d8-4362-a099-871fe2010a7c HTTP/1.1" status: 200 len: 1098 time: 0.6665187 Dec 24 05:02:24.334367 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1ce0890f-150d-48b6-9be0-b572f7429968', 'tag': 'd8920e65-30d8-4362-a099-871fe2010a7c'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:02:24.337147 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f983d095-022a-4223-a679-96f33a7405df" -d '{"events": [{"name": "network-changed", "server_uuid": "1ce0890f-150d-48b6-9be0-b572f7429968", "tag": "d8920e65-30d8-4362-a099-871fe2010a7c"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:02:24.369624 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67ce99e4-b950-4011-a7aa-8f24cd716067 service neutron] Pushing event updated for resources: {'Port': ['ID=d8920e65-30d8-4362-a099-871fe2010a7c,revision_number=3']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:24.396803 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:02:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ec360542-3324-487a-a144-d313910399ec x-openstack-request-id: req-ec360542-3324-487a-a144-d313910399ec {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:02:24.397136 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1ce0890f-150d-48b6-9be0-b572f7429968", "tag": "d8920e65-30d8-4362-a099-871fe2010a7c", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:02:24.397444 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-ec360542-3324-487a-a144-d313910399ec {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:02:24.397933 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1ce0890f-150d-48b6-9be0-b572f7429968', 'tag': 'd8920e65-30d8-4362-a099-871fe2010a7c', 'status': 'completed', 'code': 200} Dec 24 05:02:24.470709 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-016338e1-f9c8-4951-b18f-a31b223cdd70 req-9b673908-c6f9-4e95-bc57-3ff0420b0366 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:24.472234 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-016338e1-f9c8-4951-b18f-a31b223cdd70 req-9b673908-c6f9-4e95-bc57-3ff0420b0366 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0782008 Dec 24 05:02:24.481879 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-e40a3308-9d5c-4233-99e7-62e55043c352 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:24.483315 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-e40a3308-9d5c-4233-99e7-62e55043c352 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=aad82f86c5b5403799701feca92f316e&device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 1101 time: 0.0598824 Dec 24 05:02:24.544056 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-af00b2ec-5867-4ff4-a09d-73a44bbb6b8d service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.179&port_id=d8920e65-30d8-4362-a099-871fe2010a7c HTTP/1.1" status: 200 len: 217 time: 0.0419722 Dec 24 05:02:24.562769 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-016338e1-f9c8-4951-b18f-a31b223cdd70 req-0a10a24a-2b14-4b44-86a8-75b379f21955 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0832088 Dec 24 05:02:24.612709 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-74cabffb-6bfb-4cf2-b75a-afe7bb02d60e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:24.614203 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-74cabffb-6bfb-4cf2-b75a-afe7bb02d60e service neutron] 10.222.0.46 "GET /v2.0/subnets?id=a9a1b303-53dd-4f5e-9ffd-833b6bddf909 HTTP/1.1" status: 200 len: 843 time: 0.0504947 Dec 24 05:02:24.645199 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-464bee79-6455-4fb3-9110-684456de38d2 req-ca1389a0-604a-4a18-b8cf-5d8538819e97 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:24.646657 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-464bee79-6455-4fb3-9110-684456de38d2 req-ca1389a0-604a-4a18-b8cf-5d8538819e97 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 943 time: 0.0493152 Dec 24 05:02:24.660656 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-0b9f12ad-cab5-48b3-bf06-1c6407951703 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:24.662217 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-0b9f12ad-cab5-48b3-bf06-1c6407951703 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=5e42f823-2f9e-40d8-827b-66cbc7e240b7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0399690 Dec 24 05:02:24.694956 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-464bee79-6455-4fb3-9110-684456de38d2 req-57d00abf-0629-4c98-8e40-02849bdfdcc6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415740 Dec 24 05:02:24.761877 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-059b77c9-669c-4933-a3eb-2932c754060c service neutron] 10.222.0.46 "GET /v2.0/networks/5e42f823-2f9e-40d8-827b-66cbc7e240b7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0912957 Dec 24 05:02:24.865615 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aca0b7ef-9cbe-42b3-9e1f-a668b1b43e21 req-cf2bc8cd-2884-46f9-8093-f0d7cbc3e05b service neutron] 10.222.0.46 "GET /v2.0/networks/5e42f823-2f9e-40d8-827b-66cbc7e240b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857029 Dec 24 05:02:25.054381 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f983d095-022a-4223-a679-96f33a7405df req-16c6a060-06d0-43bb-999c-01c93fb4054a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:25.055977 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f983d095-022a-4223-a679-96f33a7405df req-16c6a060-06d0-43bb-999c-01c93fb4054a service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=aad82f86c5b5403799701feca92f316e&device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 1101 time: 0.0460675 Dec 24 05:02:25.158393 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f983d095-022a-4223-a679-96f33a7405df req-fe0a6b8d-ad4c-4e89-ae4b-4493d45b6568 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:25.160427 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f983d095-022a-4223-a679-96f33a7405df req-fe0a6b8d-ad4c-4e89-ae4b-4493d45b6568 service neutron] 10.222.0.46 "GET /v2.0/networks?id=5e42f823-2f9e-40d8-827b-66cbc7e240b7 HTTP/1.1" status: 200 len: 870 time: 0.0880167 Dec 24 05:02:25.206427 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f983d095-022a-4223-a679-96f33a7405df req-97ef2757-b385-4c70-8ca8-e14cc839348d service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.179&port_id=d8920e65-30d8-4362-a099-871fe2010a7c HTTP/1.1" status: 200 len: 217 time: 0.0368834 Dec 24 05:02:25.258179 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-2e97706d-8510-4dc0-ac56-73736ed5cb8e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:25.264370 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f983d095-022a-4223-a679-96f33a7405df req-a147feb4-2d8c-485a-9377-629b15b642ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:25.265865 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f983d095-022a-4223-a679-96f33a7405df req-a147feb4-2d8c-485a-9377-629b15b642ef service neutron] 10.222.0.46 "GET /v2.0/subnets?id=a9a1b303-53dd-4f5e-9ffd-833b6bddf909 HTTP/1.1" status: 200 len: 843 time: 0.0513299 Dec 24 05:02:25.314043 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f983d095-022a-4223-a679-96f33a7405df req-18568e4a-510a-4873-a371-97f191985d8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:25.315624 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f983d095-022a-4223-a679-96f33a7405df req-18568e4a-510a-4873-a371-97f191985d8d service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=5e42f823-2f9e-40d8-827b-66cbc7e240b7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0398290 Dec 24 05:02:25.417718 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f983d095-022a-4223-a679-96f33a7405df req-e65db986-9d89-488c-8bc5-3f2e1c792120 service neutron] 10.222.0.46 "GET /v2.0/networks/5e42f823-2f9e-40d8-827b-66cbc7e240b7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0878034 Dec 24 05:02:25.423806 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59caf632-886f-43c9-b4f9-c3716d78f6e5 req-58a9709a-01f4-4975-b7a8-8e2c94fc8ed8 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:25.425301 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-59caf632-886f-43c9-b4f9-c3716d78f6e5 req-58a9709a-01f4-4975-b7a8-8e2c94fc8ed8 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/ports?device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 948 time: 0.0478659 Dec 24 05:02:25.475682 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-59caf632-886f-43c9-b4f9-c3716d78f6e5 req-d5055971-2154-4ac9-9860-16774029e3cb tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/security-groups?id=afc5f95f-b105-4542-8255-46564277a986&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442920 Dec 24 05:02:25.517958 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f983d095-022a-4223-a679-96f33a7405df req-4c654980-1b3f-4eff-aa0a-06748ef88c35 service neutron] 10.222.0.46 "GET /v2.0/networks/5e42f823-2f9e-40d8-827b-66cbc7e240b7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0903118 Dec 24 05:02:25.698446 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b57bd7a9-f5e1-4e9c-a7f9-b8b6273e4fc0 req-50512460-2082-403b-abb0-7146b30e0ea9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:25.699849 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b57bd7a9-f5e1-4e9c-a7f9-b8b6273e4fc0 req-50512460-2082-403b-abb0-7146b30e0ea9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0544794 Dec 24 05:02:25.750690 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b57bd7a9-f5e1-4e9c-a7f9-b8b6273e4fc0 req-7f5193af-d52f-43b2-9c9d-c53a820c8a7f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424726 Dec 24 05:02:25.818369 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1599c7be-d8ab-41f0-bd96-d27143b599c5 req-8e7414a2-2673-4374-a044-c503a5ad4842 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:25.819816 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1599c7be-d8ab-41f0-bd96-d27143b599c5 req-8e7414a2-2673-4374-a044-c503a5ad4842 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 943 time: 0.0543013 Dec 24 05:02:25.868251 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1599c7be-d8ab-41f0-bd96-d27143b599c5 req-c29def0a-dc61-4cd3-adb6-204ecc37ec11 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421169 Dec 24 05:02:26.130755 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5146a134-a54b-46df-8722-91b4f403efd6 req-e5287261-f6a6-4fbe-bc3b-c2bae1209266 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:26.132330 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5146a134-a54b-46df-8722-91b4f403efd6 req-e5287261-f6a6-4fbe-bc3b-c2bae1209266 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/networks?id=7d6d1704-2ca9-4ba7-a7ef-cd394e15a741 HTTP/1.1" status: 200 len: 814 time: 0.1087401 Dec 24 05:02:26.152729 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5146a134-a54b-46df-8722-91b4f403efd6 req-0a91f3d6-4444-45d4-bd37-0dda5332f44c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/quotas/122a6a1d32d648c6938f0b159bb3641c HTTP/1.1" status: 200 len: 375 time: 0.0143626 Dec 24 05:02:26.187304 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5146a134-a54b-46df-8722-91b4f403efd6 req-6cabf89d-a1e2-4425-b3b6-1f3e84599374 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=122a6a1d32d648c6938f0b159bb3641c&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0294156 Dec 24 05:02:26.276650 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5146a134-a54b-46df-8722-91b4f403efd6 req-a001ce58-ff8a-4073-8d9a-f69d2486c3f7 service neutron] 10.222.0.43 "GET /v2.0/networks/7d6d1704-2ca9-4ba7-a7ef-cd394e15a741?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0820107 Dec 24 05:02:26.379495 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5146a134-a54b-46df-8722-91b4f403efd6 req-54f29a34-3be3-4581-bbf8-e4fa8e730c2d service neutron] 10.222.0.43 "GET /v2.0/networks/7d6d1704-2ca9-4ba7-a7ef-cd394e15a741?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0950732 Dec 24 05:02:26.449849 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:26.519917 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 7484fcf7-0384-4cf4-8974-7df317686b39 details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 05:02:26.572819 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-75e023d2-f059-4ee7-8871-84598ae870f1 req-be3fba23-14c6-44f0-bee1-ba9fc4fea617 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=e0d6209d-3f4e-4467-bcd3-543f26133bbd HTTP/1.1" status: 200 len: 210 time: 0.0299592 Dec 24 05:02:26.622513 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01bcc2b4-237c-4f0e-bb79-a819187ca285 req-8782037e-4478-41e5-bc88-9086167b503d tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:26.624230 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-01bcc2b4-237c-4f0e-bb79-a819187ca285 req-8782037e-4478-41e5-bc88-9086167b503d tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/ports?device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 948 time: 0.0771923 Dec 24 05:02:26.633347 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 7484fcf7-0384-4cf4-8974-7df317686b39, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=7484fcf7-0384-4cf4-8974-7df317686b39,segment=NetworkSegment(10307c97-e214-473b-b760-bb1b770153ec),segment_id=10307c97-e214-473b-b760-bb1b770153ec)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:02:26.646841 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': '7484fcf7-0384-4cf4-8974-7df317686b39', 'network_id': 'b92a87f3-957a-4ccb-9b5b-98ad92aebe6e', 'port_id': '7484fcf7-0384-4cf4-8974-7df317686b39', 'mac_address': 'fa:16:3e:14:57:d8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9b9ff65f-93c8-4cb1-8a99-961ba0d4beaa', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 05:02:26.678765 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-01bcc2b4-237c-4f0e-bb79-a819187ca285 req-3dc1bce4-b80a-490e-af3b-daed0e05aba6 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/security-groups?id=afc5f95f-b105-4542-8255-46564277a986&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0480316 Dec 24 05:02:26.686294 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:26.701350 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7484fcf7-0384-4cf4-8974-7df317686b39 {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:02:26.720911 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 7484fcf7-0384-4cf4-8974-7df317686b39, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=7484fcf7-0384-4cf4-8974-7df317686b39,segment=NetworkSegment(10307c97-e214-473b-b760-bb1b770153ec),segment_id=10307c97-e214-473b-b760-bb1b770153ec)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:02:26.725420 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:26.777635 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=7484fcf7-0384-4cf4-8974-7df317686b39,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:26.874738 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eab05832-63a8-4db9-a1fc-16bc49f2a93f req-9bea06e7-7dca-4eff-9093-cb70d7f53fe9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:26.876414 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-eab05832-63a8-4db9-a1fc-16bc49f2a93f req-9bea06e7-7dca-4eff-9093-cb70d7f53fe9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0533369 Dec 24 05:02:26.939373 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-eab05832-63a8-4db9-a1fc-16bc49f2a93f req-b29c867a-9d4c-4906-8c39-94fd6819287e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0560205 Dec 24 05:02:27.008428 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb86d43a-868d-42c9-9342-ab1ef0df751a req-a1e3961e-b2cc-42e0-b6a7-ee8bea4ba913 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:27.010251 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-cb86d43a-868d-42c9-9342-ab1ef0df751a req-a1e3961e-b2cc-42e0-b6a7-ee8bea4ba913 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 944 time: 0.0530179 Dec 24 05:02:27.074384 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-cb86d43a-868d-42c9-9342-ab1ef0df751a req-fee4294e-d241-4d9d-a1cb-f47774d28008 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0568547 Dec 24 05:02:27.491837 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['7484fcf7-0384-4cf4-8974-7df317686b39'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:02:27.673190 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0a6828ab-cb5c-48f5-97c1-186dd02b6332 req-155b85cc-642f-4b31-9959-6028a393865d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=e0d6209d-3f4e-4467-bcd3-543f26133bbd HTTP/1.1" status: 200 len: 210 time: 0.0302417 Dec 24 05:02:27.812550 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db0fe728-b4d2-4fad-abc4-1241d671e7c3 req-210e93b1-9750-43a9-8d83-5ba2db2567d5 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:27.814687 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-db0fe728-b4d2-4fad-abc4-1241d671e7c3 req-210e93b1-9750-43a9-8d83-5ba2db2567d5 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/ports?device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 948 time: 0.0604811 Dec 24 05:02:27.866857 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-db0fe728-b4d2-4fad-abc4-1241d671e7c3 req-4f0c83ef-8448-4969-8b22-616392b6b6b4 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/security-groups?id=afc5f95f-b105-4542-8255-46564277a986&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437949 Dec 24 05:02:27.896605 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:28.071974 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df69071f-50c6-4c3a-b130-1bc3974fad2e req-9a6d2d81-2d5d-4c4e-92e3-6308af2ec885 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:28.073586 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-df69071f-50c6-4c3a-b130-1bc3974fad2e req-9a6d2d81-2d5d-4c4e-92e3-6308af2ec885 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0578811 Dec 24 05:02:28.151833 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-df69071f-50c6-4c3a-b130-1bc3974fad2e req-841a1758-ca7b-4f58-86f4-583d339fa05c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0716236 Dec 24 05:02:28.239675 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5146a134-a54b-46df-8722-91b4f403efd6 req-4ae731ea-11dc-48e1-b3e7-a60262e20fe4 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:28.241547 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5146a134-a54b-46df-8722-91b4f403efd6 req-4ae731ea-11dc-48e1-b3e7-a60262e20fe4 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.46 "GET /v2.0/networks?id=7d6d1704-2ca9-4ba7-a7ef-cd394e15a741 HTTP/1.1" status: 200 len: 814 time: 0.1493080 Dec 24 05:02:28.252119 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-616b28ed-2e07-47d9-b05b-a9e524859e15 req-4388fe63-415b-44c3-ab3e-554c3a45237a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:28.253917 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-616b28ed-2e07-47d9-b05b-a9e524859e15 req-4388fe63-415b-44c3-ab3e-554c3a45237a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 944 time: 0.0837038 Dec 24 05:02:28.271990 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-5146a134-a54b-46df-8722-91b4f403efd6 req-d2e872bf-0926-49d9-932e-29abd0bd95cb tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Request body: {'port': {'device_id': 'e0d6209d-3f4e-4467-bcd3-543f26133bbd', 'network_id': '7d6d1704-2ca9-4ba7-a7ef-cd394e15a741', 'admin_state_up': True, 'tenant_id': '122a6a1d32d648c6938f0b159bb3641c'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:02:28.369190 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-616b28ed-2e07-47d9-b05b-a9e524859e15 req-f6b1da69-29e4-4001-bd26-70928cd50dd5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1066360 Dec 24 05:02:28.412048 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5146a134-a54b-46df-8722-91b4f403efd6 req-d2e872bf-0926-49d9-932e-29abd0bd95cb tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Made reservation on behalf of 122a6a1d32d648c6938f0b159bb3641c for: {'port': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:02:28.415707 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-5146a134-a54b-46df-8722-91b4f403efd6 req-d2e872bf-0926-49d9-932e-29abd0bd95cb tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:28.547138 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [req-5146a134-a54b-46df-8722-91b4f403efd6 req-d2e872bf-0926-49d9-932e-29abd0bd95cb tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Allocated IP 172.20.0.9 (7d6d1704-2ca9-4ba7-a7ef-cd394e15a741/42c4f72c-ce3e-4cb1-9111-06a2ac0d1641/f6cc3671-adcd-49a0-acb1-9e19b75fc8c9) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:02:28.573119 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:28.704816 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-5146a134-a54b-46df-8722-91b4f403efd6 req-d2e872bf-0926-49d9-932e-29abd0bd95cb tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:28.748403 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-5146a134-a54b-46df-8722-91b4f403efd6 req-d2e872bf-0926-49d9-932e-29abd0bd95cb tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:28.794172 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5146a134-a54b-46df-8722-91b4f403efd6 req-d2e872bf-0926-49d9-932e-29abd0bd95cb tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Network 7d6d1704-2ca9-4ba7-a7ef-cd394e15a741 is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:02:28.797351 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [req-5146a134-a54b-46df-8722-91b4f403efd6 req-d2e872bf-0926-49d9-932e-29abd0bd95cb tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:02:28.798233 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac214975-9b10-49e4-9513-5da54d18785a req-70705238-e37d-480f-921e-06a3b2815115 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:28.799893 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ac214975-9b10-49e4-9513-5da54d18785a req-70705238-e37d-480f-921e-06a3b2815115 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=e0d6209d-3f4e-4467-bcd3-543f26133bbd HTTP/1.1" status: 200 len: 931 time: 0.0496092 Dec 24 05:02:28.800858 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-5146a134-a54b-46df-8722-91b4f403efd6 req-d2e872bf-0926-49d9-932e-29abd0bd95cb tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:02:28.852974 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ac214975-9b10-49e4-9513-5da54d18785a req-59955242-ccd4-4d91-82c8-79116568fd13 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458148 Dec 24 05:02:29.089973 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2e872bf-0926-49d9-932e-29abd0bd95cb tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Pushing event updated for resources: {'Port': ['ID=f6cc3671-adcd-49a0-acb1-9e19b75fc8c9,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:29.149100 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5146a134-a54b-46df-8722-91b4f403efd6 req-d2e872bf-0926-49d9-932e-29abd0bd95cb tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:29.149704 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-5146a134-a54b-46df-8722-91b4f403efd6 req-d2e872bf-0926-49d9-932e-29abd0bd95cb tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:29.168519 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a5a4551-0ef0-414e-9c23-02f1281fa00f req-fa7ecfcd-5362-405a-a00a-8c0d74df7135 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:29.171295 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6a5a4551-0ef0-414e-9c23-02f1281fa00f req-fa7ecfcd-5362-405a-a00a-8c0d74df7135 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/ports?device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 948 time: 0.0826585 Dec 24 05:02:29.180950 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5146a134-a54b-46df-8722-91b4f403efd6 req-d2e872bf-0926-49d9-932e-29abd0bd95cb tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.46 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9122739 Dec 24 05:02:29.202488 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-5146a134-a54b-46df-8722-91b4f403efd6 req-c392e206-f484-44be-91e6-2386a8bbcd01 service neutron] Request body: {'port': {'device_id': 'e0d6209d-3f4e-4467-bcd3-543f26133bbd', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81644'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:02:29.266575 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ed1e20e-90e4-4df9-a353-b71c14b0a9a9 req-3f9d6ba0-ddb8-415f-8d4e-22f4a5edccc7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:29.268034 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0ed1e20e-90e4-4df9-a353-b71c14b0a9a9 req-3f9d6ba0-ddb8-415f-8d4e-22f4a5edccc7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0536733 Dec 24 05:02:29.274315 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6a5a4551-0ef0-414e-9c23-02f1281fa00f req-f0196ece-2a74-437c-95d5-f9a627c4446f tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/security-groups?id=afc5f95f-b105-4542-8255-46564277a986&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0922565 Dec 24 05:02:29.283673 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-5146a134-a54b-46df-8722-91b4f403efd6 req-c392e206-f484-44be-91e6-2386a8bbcd01 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:29.316432 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0ed1e20e-90e4-4df9-a353-b71c14b0a9a9 req-0264f6f4-0a97-4ee9-94be-434beafe3636 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424213 Dec 24 05:02:29.530669 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09800d63-7769-4e68-9016-30279a9dd818 req-0cb490f2-c31a-415c-8b25-8bf66a01622d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:29.532139 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-09800d63-7769-4e68-9016-30279a9dd818 req-0cb490f2-c31a-415c-8b25-8bf66a01622d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 944 time: 0.0715969 Dec 24 05:02:29.604988 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [req-5146a134-a54b-46df-8722-91b4f403efd6 req-c392e206-f484-44be-91e6-2386a8bbcd01 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 {{(pid=102476) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:02:29.617591 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-5146a134-a54b-46df-8722-91b4f403efd6 req-c392e206-f484-44be-91e6-2386a8bbcd01 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:29.630988 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-09800d63-7769-4e68-9016-30279a9dd818 req-deafc710-7308-4b1a-b1c3-be2115196ec2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0908265 Dec 24 05:02:29.635665 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.provisioning_blocks [req-5146a134-a54b-46df-8722-91b4f403efd6 req-c392e206-f484-44be-91e6-2386a8bbcd01 service neutron] Transition to ACTIVE for port object f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 will not be triggered until provisioned by entity L2. {{(pid=102476) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 24 05:02:29.640568 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-5146a134-a54b-46df-8722-91b4f403efd6 req-c392e206-f484-44be-91e6-2386a8bbcd01 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:29.687278 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c392e206-f484-44be-91e6-2386a8bbcd01 service neutron] Pushing event updated for resources: {'Port': ['ID=f6cc3671-adcd-49a0-acb1-9e19b75fc8c9,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:29.768928 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-5146a134-a54b-46df-8722-91b4f403efd6 req-c392e206-f484-44be-91e6-2386a8bbcd01 service neutron] Attempting to bind port f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 on host hv-cinder-81644 for vnic_type normal with profile {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:02:29.769619 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-5146a134-a54b-46df-8722-91b4f403efd6 req-c392e206-f484-44be-91e6-2386a8bbcd01 service neutron] Attempting to bind port f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 by drivers openvswitch,hyperv on host hv-cinder-81644 at level 0 using segments [{'id': '45cba16b-d4c1-40eb-8945-69769d27d2b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '7d6d1704-2ca9-4ba7-a7ef-cd394e15a741'}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:02:29.769619 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5146a134-a54b-46df-8722-91b4f403efd6 req-c392e206-f484-44be-91e6-2386a8bbcd01 service neutron] Attempting to bind port f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 on network 7d6d1704-2ca9-4ba7-a7ef-cd394e15a741 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:02:29.774361 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5146a134-a54b-46df-8722-91b4f403efd6 req-c392e206-f484-44be-91e6-2386a8bbcd01 service neutron] Port f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 on network 7d6d1704-2ca9-4ba7-a7ef-cd394e15a741 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81644 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 24 05:02:29.774686 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5146a134-a54b-46df-8722-91b4f403efd6 req-c392e206-f484-44be-91e6-2386a8bbcd01 service neutron] Attempting to bind port f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 on network 7d6d1704-2ca9-4ba7-a7ef-cd394e15a741 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:02:29.779741 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5146a134-a54b-46df-8722-91b4f403efd6 req-c392e206-f484-44be-91e6-2386a8bbcd01 service neutron] Checking agent: {'id': '7a2ffd19-371f-4f7b-a239-eea3b5cfd55b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81644', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'started_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 2, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:02:29.780081 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5146a134-a54b-46df-8722-91b4f403efd6 req-c392e206-f484-44be-91e6-2386a8bbcd01 service neutron] Checking segment: {'id': '45cba16b-d4c1-40eb-8945-69769d27d2b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '7d6d1704-2ca9-4ba7-a7ef-cd394e15a741'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:02:29.780503 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5146a134-a54b-46df-8722-91b4f403efd6 req-c392e206-f484-44be-91e6-2386a8bbcd01 service neutron] Bound using segment: {'id': '45cba16b-d4c1-40eb-8945-69769d27d2b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '7d6d1704-2ca9-4ba7-a7ef-cd394e15a741'} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:02:29.780962 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-5146a134-a54b-46df-8722-91b4f403efd6 req-c392e206-f484-44be-91e6-2386a8bbcd01 service neutron] Bound port: f6cc3671-adcd-49a0-acb1-9e19b75fc8c9, host: hv-cinder-81644, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '45cba16b-d4c1-40eb-8945-69769d27d2b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '7d6d1704-2ca9-4ba7-a7ef-cd394e15a741'}}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:02:29.781314 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-5146a134-a54b-46df-8722-91b4f403efd6 req-c392e206-f484-44be-91e6-2386a8bbcd01 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:29.860015 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-5146a134-a54b-46df-8722-91b4f403efd6 req-c392e206-f484-44be-91e6-2386a8bbcd01 service neutron] For port f6cc3671-adcd-49a0-acb1-9e19b75fc8c9, host hv-cinder-81644, cleared binding levels {{(pid=102476) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:02:29.864725 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-5146a134-a54b-46df-8722-91b4f403efd6 req-c392e206-f484-44be-91e6-2386a8bbcd01 service neutron] For port f6cc3671-adcd-49a0-acb1-9e19b75fc8c9, host hv-cinder-81644, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=f6cc3671-adcd-49a0-acb1-9e19b75fc8c9,segment=NetworkSegment(45cba16b-d4c1-40eb-8945-69769d27d2b7),segment_id=45cba16b-d4c1-40eb-8945-69769d27d2b7)] {{(pid=102476) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:02:29.870380 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-5146a134-a54b-46df-8722-91b4f403efd6 req-c392e206-f484-44be-91e6-2386a8bbcd01 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:29.910102 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5146a134-a54b-46df-8722-91b4f403efd6 req-c392e206-f484-44be-91e6-2386a8bbcd01 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:29.910716 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-5146a134-a54b-46df-8722-91b4f403efd6 req-c392e206-f484-44be-91e6-2386a8bbcd01 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:29.912092 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5146a134-a54b-46df-8722-91b4f403efd6 req-c392e206-f484-44be-91e6-2386a8bbcd01 service neutron] 10.222.0.46 "PUT /v2.0/ports/f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 HTTP/1.1" status: 200 len: 1093 time: 0.7146554 Dec 24 05:02:29.912612 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e0d6209d-3f4e-4467-bcd3-543f26133bbd', 'tag': 'f6cc3671-adcd-49a0-acb1-9e19b75fc8c9'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:02:29.914764 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2e1b8683-1af3-4262-9814-4a926c23b3f3" -d '{"events": [{"name": "network-changed", "server_uuid": "e0d6209d-3f4e-4467-bcd3-543f26133bbd", "tag": "f6cc3671-adcd-49a0-acb1-9e19b75fc8c9"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:02:29.961232 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c392e206-f484-44be-91e6-2386a8bbcd01 service neutron] Pushing event updated for resources: {'Port': ['ID=f6cc3671-adcd-49a0-acb1-9e19b75fc8c9,revision_number=3']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:29.990695 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c10b56a4-d72a-4ad4-beed-b7306d65a64b req-cf14c132-b7a2-4801-b885-79f46ba5c304 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:29.992677 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c10b56a4-d72a-4ad4-beed-b7306d65a64b req-cf14c132-b7a2-4801-b885-79f46ba5c304 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=e0d6209d-3f4e-4467-bcd3-543f26133bbd HTTP/1.1" status: 200 len: 943 time: 0.0598958 Dec 24 05:02:30.025805 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:02:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5f1560be-dee1-486d-8978-2fcd8866780b x-openstack-request-id: req-5f1560be-dee1-486d-8978-2fcd8866780b {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:02:30.026147 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e0d6209d-3f4e-4467-bcd3-543f26133bbd", "tag": "f6cc3671-adcd-49a0-acb1-9e19b75fc8c9", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:02:30.026400 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-5f1560be-dee1-486d-8978-2fcd8866780b {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:02:30.026780 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e0d6209d-3f4e-4467-bcd3-543f26133bbd', 'tag': 'f6cc3671-adcd-49a0-acb1-9e19b75fc8c9', 'status': 'completed', 'code': 200} Dec 24 05:02:30.073890 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5146a134-a54b-46df-8722-91b4f403efd6 req-1d0cea69-9bd0-4fed-8968-6e728ad167c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:30.075381 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5146a134-a54b-46df-8722-91b4f403efd6 req-1d0cea69-9bd0-4fed-8968-6e728ad167c5 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=122a6a1d32d648c6938f0b159bb3641c&device_id=e0d6209d-3f4e-4467-bcd3-543f26133bbd HTTP/1.1" status: 200 len: 1096 time: 0.0809433 Dec 24 05:02:30.079121 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c10b56a4-d72a-4ad4-beed-b7306d65a64b req-1ccc039a-24cb-4899-b008-03cd6cbf4943 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0768118 Dec 24 05:02:30.139400 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5146a134-a54b-46df-8722-91b4f403efd6 req-448848c7-ef06-41bc-ad94-63294b463f62 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 HTTP/1.1" status: 200 len: 217 time: 0.0377052 Dec 24 05:02:30.189234 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5146a134-a54b-46df-8722-91b4f403efd6 req-c2d3c87a-8b2c-4b01-93a0-4d0588c9335e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:30.190824 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5146a134-a54b-46df-8722-91b4f403efd6 req-c2d3c87a-8b2c-4b01-93a0-4d0588c9335e service neutron] 10.222.0.46 "GET /v2.0/subnets?id=42c4f72c-ce3e-4cb1-9111-06a2ac0d1641 HTTP/1.1" status: 200 len: 854 time: 0.0442042 Dec 24 05:02:30.227050 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5146a134-a54b-46df-8722-91b4f403efd6 req-7db2335e-e1e0-4b68-99be-ae70f1640234 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=7d6d1704-2ca9-4ba7-a7ef-cd394e15a741&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0286462 Dec 24 05:02:30.328301 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5146a134-a54b-46df-8722-91b4f403efd6 req-276104a1-bd78-4034-9e0f-529115047072 service neutron] 10.222.0.46 "GET /v2.0/networks/7d6d1704-2ca9-4ba7-a7ef-cd394e15a741?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0929115 Dec 24 05:02:30.391646 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f50c741-38c3-44c1-a845-a150e581bdb5 req-b876b865-8706-4b99-9966-41dad48ac3a0 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:30.393152 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6f50c741-38c3-44c1-a845-a150e581bdb5 req-b876b865-8706-4b99-9966-41dad48ac3a0 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/ports?device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 948 time: 0.0486319 Dec 24 05:02:30.443128 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6f50c741-38c3-44c1-a845-a150e581bdb5 req-a1ba87bf-d3ee-4739-b5fd-6d4cb88aa0cd tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/security-groups?id=afc5f95f-b105-4542-8255-46564277a986&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428963 Dec 24 05:02:30.455924 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5146a134-a54b-46df-8722-91b4f403efd6 req-ff7c7491-8d24-4697-843d-7cf95a039114 service neutron] 10.222.0.46 "GET /v2.0/networks/7d6d1704-2ca9-4ba7-a7ef-cd394e15a741?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1195900 Dec 24 05:02:30.465077 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c839abad-809b-4344-8bef-dbd7e25283b8 req-9c670cd6-6cea-41ea-a399-9d7ae223144b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:30.466565 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c839abad-809b-4344-8bef-dbd7e25283b8 req-9c670cd6-6cea-41ea-a399-9d7ae223144b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0745819 Dec 24 05:02:30.517875 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device d8920e65-30d8-4362-a099-871fe2010a7c details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 05:02:30.518422 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c839abad-809b-4344-8bef-dbd7e25283b8 req-a2ee973d-cb03-4614-a4de-3df67910257b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447109 Dec 24 05:02:30.528786 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 7484fcf7-0384-4cf4-8974-7df317686b39 up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:02:30.602190 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e1b8683-1af3-4262-9814-4a926c23b3f3 req-060278c1-cfa9-49b3-bdd3-6b1d833f0dca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:30.603699 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2e1b8683-1af3-4262-9814-4a926c23b3f3 req-060278c1-cfa9-49b3-bdd3-6b1d833f0dca service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=122a6a1d32d648c6938f0b159bb3641c&device_id=e0d6209d-3f4e-4467-bcd3-543f26133bbd HTTP/1.1" status: 200 len: 1096 time: 0.0434921 Dec 24 05:02:30.648758 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning for port 7484fcf7-0384-4cf4-8974-7df317686b39 completed by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 24 05:02:30.659038 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port 7484fcf7-0384-4cf4-8974-7df317686b39 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:02:30.659649 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:30.662932 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port d8920e65-30d8-4362-a099-871fe2010a7c, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=d8920e65-30d8-4362-a099-871fe2010a7c,segment=NetworkSegment(12eac7f7-f84a-41ca-ba10-cc6036d850a8),segment_id=12eac7f7-f84a-41ca-ba10-cc6036d850a8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:02:30.704256 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e1b8683-1af3-4262-9814-4a926c23b3f3 req-6e5544e5-cc15-4249-8ad8-59c07101505f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:30.705023 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': 'd8920e65-30d8-4362-a099-871fe2010a7c', 'network_id': '5e42f823-2f9e-40d8-827b-66cbc7e240b7', 'port_id': 'd8920e65-30d8-4362-a099-871fe2010a7c', 'mac_address': 'fa:16:3e:a9:75:26', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 101, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a9a1b303-53dd-4f5e-9ffd-833b6bddf909', 'ip_address': '192.168.233.179'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 05:02:30.705889 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2e1b8683-1af3-4262-9814-4a926c23b3f3 req-6e5544e5-cc15-4249-8ad8-59c07101505f service neutron] 10.222.0.46 "GET /v2.0/networks?id=7d6d1704-2ca9-4ba7-a7ef-cd394e15a741 HTTP/1.1" status: 200 len: 915 time: 0.0940826 Dec 24 05:02:30.751095 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61084d61-671f-4bfc-938e-0087a19d7a3c req-1cdf6ee4-e935-433e-80a9-388e4b376908 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:30.752607 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-61084d61-671f-4bfc-938e-0087a19d7a3c req-1cdf6ee4-e935-433e-80a9-388e4b376908 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 944 time: 0.0524681 Dec 24 05:02:30.753446 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2e1b8683-1af3-4262-9814-4a926c23b3f3 req-ef500145-2b77-4824-a8b6-23176ac49b78 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 HTTP/1.1" status: 200 len: 217 time: 0.0373216 Dec 24 05:02:30.770016 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:30.793695 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d8920e65-30d8-4362-a099-871fe2010a7c {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:02:30.798979 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:30.805898 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e1b8683-1af3-4262-9814-4a926c23b3f3 req-419842b2-b64b-40a2-b9f9-7c94722339d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:30.806495 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-61084d61-671f-4bfc-938e-0087a19d7a3c req-ca8a2590-196a-4259-955e-4b536506784f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471082 Dec 24 05:02:30.807706 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2e1b8683-1af3-4262-9814-4a926c23b3f3 req-419842b2-b64b-40a2-b9f9-7c94722339d5 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=42c4f72c-ce3e-4cb1-9111-06a2ac0d1641 HTTP/1.1" status: 200 len: 854 time: 0.0467257 Dec 24 05:02:30.822741 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port d8920e65-30d8-4362-a099-871fe2010a7c, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=d8920e65-30d8-4362-a099-871fe2010a7c,segment=NetworkSegment(12eac7f7-f84a-41ca-ba10-cc6036d850a8),segment_id=12eac7f7-f84a-41ca-ba10-cc6036d850a8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:02:30.831301 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:30.842242 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6e67ec17-823b-4612-8bd4-dbe278717d5e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7484fcf7-0384-4cf4-8974-7df317686b39'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:02:30.844494 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-725ed152-bd73-4c68-a9b0-d9ca0f75da3b" -d '{"events": [{"server_uuid": "6e67ec17-823b-4612-8bd4-dbe278717d5e", "name": "network-vif-plugged", "status": "completed", "tag": "7484fcf7-0384-4cf4-8974-7df317686b39"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:02:30.849424 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2e1b8683-1af3-4262-9814-4a926c23b3f3 req-e335b90e-a97f-4191-83c7-f4ee3a32a9ab service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=7d6d1704-2ca9-4ba7-a7ef-cd394e15a741&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0310473 Dec 24 05:02:30.884840 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 7484fcf7-0384-4cf4-8974-7df317686b39, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=7484fcf7-0384-4cf4-8974-7df317686b39,segment=NetworkSegment(10307c97-e214-473b-b760-bb1b770153ec),segment_id=10307c97-e214-473b-b760-bb1b770153ec)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:02:30.893225 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:30.900936 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:02:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2125687d-2017-4c7c-ba48-e07a52eb14f1 x-openstack-request-id: req-2125687d-2017-4c7c-ba48-e07a52eb14f1 {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:02:30.901485 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6e67ec17-823b-4612-8bd4-dbe278717d5e", "name": "network-vif-plugged", "status": "completed", "tag": "7484fcf7-0384-4cf4-8974-7df317686b39", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:02:30.901752 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-2125687d-2017-4c7c-ba48-e07a52eb14f1 {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:02:30.902135 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6e67ec17-823b-4612-8bd4-dbe278717d5e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7484fcf7-0384-4cf4-8974-7df317686b39', 'code': 200} Dec 24 05:02:30.911305 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=d8920e65-30d8-4362-a099-871fe2010a7c,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:30.919464 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:02:30.919873 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:02:30.920222 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:02:30.920585 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:02:30.920925 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:02:30.921256 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:02:30.921585 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:02:30.921912 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:02:30.922235 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:02:30.922571 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:02:30.922897 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:02:30.923215 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:02:30.923533 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:02:30.946386 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2e1b8683-1af3-4262-9814-4a926c23b3f3 req-5bae978d-8bf8-4849-87b0-21f901c459ee service neutron] 10.222.0.46 "GET /v2.0/networks/7d6d1704-2ca9-4ba7-a7ef-cd394e15a741?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0886605 Dec 24 05:02:30.975656 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=7484fcf7-0384-4cf4-8974-7df317686b39,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:31.056446 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2e1b8683-1af3-4262-9814-4a926c23b3f3 req-b71b7d94-b62e-4ef6-879d-bbb2a6d75b8a service neutron] 10.222.0.46 "GET /v2.0/networks/7d6d1704-2ca9-4ba7-a7ef-cd394e15a741?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0943611 Dec 24 05:02:31.214505 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5e32e5c-2de7-4b2c-b639-e9bf2bc84200 req-cb18632c-6325-4b0d-805f-bc4ff79e0bfc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:31.216056 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c5e32e5c-2de7-4b2c-b639-e9bf2bc84200 req-cb18632c-6325-4b0d-805f-bc4ff79e0bfc service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 1098 time: 0.0774851 Dec 24 05:02:31.232746 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ddc2446-0a40-4f4b-8edd-b956ef816967 req-bc1eb61c-3a31-42b5-a86b-076b1fd7f1c1 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:31.234209 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5ddc2446-0a40-4f4b-8edd-b956ef816967 req-bc1eb61c-3a31-42b5-a86b-076b1fd7f1c1 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=e0d6209d-3f4e-4467-bcd3-543f26133bbd HTTP/1.1" status: 200 len: 943 time: 0.0700624 Dec 24 05:02:31.305968 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c5e32e5c-2de7-4b2c-b639-e9bf2bc84200 req-2d1f8efc-89a7-4be0-a6b9-a4b32cfc5234 service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0707529 Dec 24 05:02:31.315083 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5ddc2446-0a40-4f4b-8edd-b956ef816967 req-9bd1d590-3eb6-4b8d-996b-d91c769d728b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0736740 Dec 24 05:02:31.584208 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9d9a3dc-6c77-4e30-ae5a-393e70e12789 req-3e4833c2-145b-4604-9d22-77bb140bca90 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:31.585959 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f9d9a3dc-6c77-4e30-ae5a-393e70e12789 req-3e4833c2-145b-4604-9d22-77bb140bca90 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/ports?device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 949 time: 0.0580492 Dec 24 05:02:31.635170 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f9d9a3dc-6c77-4e30-ae5a-393e70e12789 req-f85fefab-e36d-4b52-a55a-67b8a7230821 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/security-groups?id=afc5f95f-b105-4542-8255-46564277a986&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429540 Dec 24 05:02:31.640555 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ccd2981-6455-4890-a529-3629b5eb24f2 req-38629aa7-0457-4cb9-b21c-d004ec798d79 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:31.642076 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6ccd2981-6455-4890-a529-3629b5eb24f2 req-38629aa7-0457-4cb9-b21c-d004ec798d79 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0518835 Dec 24 05:02:31.689451 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6ccd2981-6455-4890-a529-3629b5eb24f2 req-a7c479de-62bb-4cbb-805d-4b9088d7136c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413694 Dec 24 05:02:31.795524 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['d8920e65-30d8-4362-a099-871fe2010a7c'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:02:31.921155 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dbc696e-879e-4672-b91b-2df6db4f2da9 req-8fde3631-1382-4d5f-9282-65a72cf62ce6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:31.922628 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3dbc696e-879e-4672-b91b-2df6db4f2da9 req-8fde3631-1382-4d5f-9282-65a72cf62ce6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 945 time: 0.0488925 Dec 24 05:02:31.976933 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3dbc696e-879e-4672-b91b-2df6db4f2da9 req-9a8e4ef0-e989-4d61-a0ad-548f2e4eb78f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0472591 Dec 24 05:02:32.413304 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:02:32.440584 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5659caf9-ea22-4d6a-bf14-2439a0a75148 req-b45af53a-485a-44c0-b94a-9dffa85e09c2 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:32.442042 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5659caf9-ea22-4d6a-bf14-2439a0a75148 req-b45af53a-485a-44c0-b94a-9dffa85e09c2 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=e0d6209d-3f4e-4467-bcd3-543f26133bbd HTTP/1.1" status: 200 len: 943 time: 0.0496125 Dec 24 05:02:32.494537 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5659caf9-ea22-4d6a-bf14-2439a0a75148 req-0b314f00-b47d-4e8d-b16f-e9b396c81b7c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463905 Dec 24 05:02:32.771656 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3328b22-3699-425e-85a0-43f6bea353ca req-3e677399-6ddd-4f1d-ab59-896a7708a11e tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:32.773494 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c3328b22-3699-425e-85a0-43f6bea353ca req-3e677399-6ddd-4f1d-ab59-896a7708a11e tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/ports?device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 949 time: 0.0588009 Dec 24 05:02:32.816330 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c9a29b-c33b-4dbd-b348-f6b10c9976f5 req-942421c2-f184-4391-9129-2bfa5aeaade4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:32.817942 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d4c9a29b-c33b-4dbd-b348-f6b10c9976f5 req-942421c2-f184-4391-9129-2bfa5aeaade4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0505147 Dec 24 05:02:32.823283 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c3328b22-3699-425e-85a0-43f6bea353ca req-5d0cb9d2-218b-4684-ac95-0a10e7a32e4c tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/security-groups?id=afc5f95f-b105-4542-8255-46564277a986&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436201 Dec 24 05:02:32.866748 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d4c9a29b-c33b-4dbd-b348-f6b10c9976f5 req-72fcc5e7-0544-4878-9bb1-4fdb80e136c4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426426 Dec 24 05:02:33.111183 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c8bf003-6dcb-4e08-a5a6-25cf2870b332 req-bcb246e2-591e-4c34-85bd-a38b3d5a607c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:33.112687 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6c8bf003-6dcb-4e08-a5a6-25cf2870b332 req-bcb246e2-591e-4c34-85bd-a38b3d5a607c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 945 time: 0.0563085 Dec 24 05:02:33.164248 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6c8bf003-6dcb-4e08-a5a6-25cf2870b332 req-baace6b0-16b9-426a-8782-30897b2d6186 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426946 Dec 24 05:02:33.622482 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51f58c48-aa7d-4511-b5d9-b39026d7b61e req-493d6ad6-a4c7-40a5-8882-27a4d2f26e80 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:33.623895 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-51f58c48-aa7d-4511-b5d9-b39026d7b61e req-493d6ad6-a4c7-40a5-8882-27a4d2f26e80 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=e0d6209d-3f4e-4467-bcd3-543f26133bbd HTTP/1.1" status: 200 len: 943 time: 0.0521760 Dec 24 05:02:33.677901 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-51f58c48-aa7d-4511-b5d9-b39026d7b61e req-6ac7f1d8-62b3-4eef-92be-a35fd990ec81 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479486 Dec 24 05:02:33.944469 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-780fc54d-55b2-4f22-93ba-0662e345598d req-e1706b81-a0fc-4fc3-a725-05acca64da1d tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:33.946012 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-780fc54d-55b2-4f22-93ba-0662e345598d req-e1706b81-a0fc-4fc3-a725-05acca64da1d tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/ports?device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 949 time: 0.0539372 Dec 24 05:02:33.992722 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d3079b3-4de7-4099-b00c-b4d1b144e32f req-6920d0da-29da-4039-9f97-f363b7639173 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:33.994150 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1d3079b3-4de7-4099-b00c-b4d1b144e32f req-6920d0da-29da-4039-9f97-f363b7639173 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0521600 Dec 24 05:02:33.995480 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-780fc54d-55b2-4f22-93ba-0662e345598d req-3c8301d8-3495-4588-80a7-30e265cc2684 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/security-groups?id=afc5f95f-b105-4542-8255-46564277a986&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430593 Dec 24 05:02:34.042259 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1d3079b3-4de7-4099-b00c-b4d1b144e32f req-0cce43b6-8f9b-41a1-bf27-ab924cb7e755 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418756 Dec 24 05:02:34.302015 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be912895-2ac9-4c6c-8f45-51ac69c73c51 req-3a3702b7-12bb-49ca-8d47-19dfd8649c9a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:34.303505 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-be912895-2ac9-4c6c-8f45-51ac69c73c51 req-3a3702b7-12bb-49ca-8d47-19dfd8649c9a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 945 time: 0.0525582 Dec 24 05:02:34.354114 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-be912895-2ac9-4c6c-8f45-51ac69c73c51 req-ec11f240-c902-4022-9034-6544a03162d9 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441468 Dec 24 05:02:34.545418 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device d8920e65-30d8-4362-a099-871fe2010a7c up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:02:34.603777 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning for port d8920e65-30d8-4362-a099-871fe2010a7c completed by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 24 05:02:34.608583 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port d8920e65-30d8-4362-a099-871fe2010a7c triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:02:34.608963 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:34.693219 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:34.720044 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1ce0890f-150d-48b6-9be0-b572f7429968', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd8920e65-30d8-4362-a099-871fe2010a7c'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:02:34.722999 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1960fe04-19f6-4def-9dbb-6b25646c46d7" -d '{"events": [{"server_uuid": "1ce0890f-150d-48b6-9be0-b572f7429968", "name": "network-vif-plugged", "status": "completed", "tag": "d8920e65-30d8-4362-a099-871fe2010a7c"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:02:34.735670 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port d8920e65-30d8-4362-a099-871fe2010a7c, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=d8920e65-30d8-4362-a099-871fe2010a7c,segment=NetworkSegment(12eac7f7-f84a-41ca-ba10-cc6036d850a8),segment_id=12eac7f7-f84a-41ca-ba10-cc6036d850a8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:02:34.742107 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:34.766896 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:02:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-39e74666-d185-4a22-b313-3dbd73a9681d x-openstack-request-id: req-39e74666-d185-4a22-b313-3dbd73a9681d {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:02:34.767138 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1ce0890f-150d-48b6-9be0-b572f7429968", "name": "network-vif-plugged", "status": "completed", "tag": "d8920e65-30d8-4362-a099-871fe2010a7c", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:02:34.767407 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-39e74666-d185-4a22-b313-3dbd73a9681d {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:02:34.767784 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1ce0890f-150d-48b6-9be0-b572f7429968', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd8920e65-30d8-4362-a099-871fe2010a7c', 'code': 200} Dec 24 05:02:34.795208 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=d8920e65-30d8-4362-a099-871fe2010a7c,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:34.811926 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-277a98a7-db7c-4f05-8fde-ad10db166835 req-88799276-6a28-4763-81a9-b03327822f4d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:34.813574 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-277a98a7-db7c-4f05-8fde-ad10db166835 req-88799276-6a28-4763-81a9-b03327822f4d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=e0d6209d-3f4e-4467-bcd3-543f26133bbd HTTP/1.1" status: 200 len: 943 time: 0.0588450 Dec 24 05:02:34.867022 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-277a98a7-db7c-4f05-8fde-ad10db166835 req-3b85858e-69ba-49db-a496-89375ce13a73 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442777 Dec 24 05:02:35.052489 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db119135-eaf2-4702-b5ca-22e5c397e94f req-93e4346a-5bf1-4fdf-b859-923b38c4e162 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:35.054039 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-db119135-eaf2-4702-b5ca-22e5c397e94f req-93e4346a-5bf1-4fdf-b859-923b38c4e162 service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 1103 time: 0.0417168 Dec 24 05:02:35.105334 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-db119135-eaf2-4702-b5ca-22e5c397e94f req-467d7da5-cb47-4d81-9b5d-606e6292ea8f service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=afc5f95f-b105-4542-8255-46564277a986&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436754 Dec 24 05:02:35.110805 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34d321ad-6251-4994-b172-d2987137a6c3 req-83a1d1b9-a7b9-41a9-bdb8-e0ef353efd54 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:35.112296 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-34d321ad-6251-4994-b172-d2987137a6c3 req-83a1d1b9-a7b9-41a9-bdb8-e0ef353efd54 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/ports?device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 950 time: 0.0509636 Dec 24 05:02:35.162072 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64601cc6-3576-4103-a751-30cb47cc0dd9 req-8b71a9fc-c5ad-43bb-a17f-fb62d3fb9f04 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:35.162876 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-34d321ad-6251-4994-b172-d2987137a6c3 req-e787c676-1aa4-446c-ab5d-813fa1c76c93 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/security-groups?id=afc5f95f-b105-4542-8255-46564277a986&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448244 Dec 24 05:02:35.163572 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-64601cc6-3576-4103-a751-30cb47cc0dd9 req-8b71a9fc-c5ad-43bb-a17f-fb62d3fb9f04 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0488601 Dec 24 05:02:35.211489 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-64601cc6-3576-4103-a751-30cb47cc0dd9 req-ba08243e-fa7b-456c-9838-3b9955cfd539 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418115 Dec 24 05:02:35.988568 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13ff449e-b258-4b7a-b4af-f5be6c5898b1 req-0f40ca95-efbb-44ac-b2cb-488f061c1cae tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:35.990106 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-13ff449e-b258-4b7a-b4af-f5be6c5898b1 req-0f40ca95-efbb-44ac-b2cb-488f061c1cae tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=e0d6209d-3f4e-4467-bcd3-543f26133bbd HTTP/1.1" status: 200 len: 943 time: 0.0533972 Dec 24 05:02:36.041570 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-13ff449e-b258-4b7a-b4af-f5be6c5898b1 req-a173aa36-847d-41b3-942c-f4ef88714b00 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440361 Dec 24 05:02:36.281155 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95ad670f-a672-4991-b9f6-97b9b9c73f92 req-78346fbb-5a2d-4148-ac96-b3ad0ec98374 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:36.282665 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-95ad670f-a672-4991-b9f6-97b9b9c73f92 req-78346fbb-5a2d-4148-ac96-b3ad0ec98374 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/ports?device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 950 time: 0.0513642 Dec 24 05:02:36.335235 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95546d1e-af4c-4059-9c45-8226e0d082d9 req-d56b4fd7-51ab-4acc-bacc-a5d45b7e8c87 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:36.336786 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-95546d1e-af4c-4059-9c45-8226e0d082d9 req-d56b4fd7-51ab-4acc-bacc-a5d45b7e8c87 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0515566 Dec 24 05:02:36.339675 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-95ad670f-a672-4991-b9f6-97b9b9c73f92 req-5152cd03-f22b-456b-8ffe-ef461dcdc870 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/security-groups?id=afc5f95f-b105-4542-8255-46564277a986&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0506997 Dec 24 05:02:36.393160 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-95546d1e-af4c-4059-9c45-8226e0d082d9 req-f73b7f50-ff8a-4863-990d-f9f397f5cd26 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482240 Dec 24 05:02:36.548715 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 05:02:36.660080 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port f6cc3671-adcd-49a0-acb1-9e19b75fc8c9, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=f6cc3671-adcd-49a0-acb1-9e19b75fc8c9,segment=NetworkSegment(45cba16b-d4c1-40eb-8945-69769d27d2b7),segment_id=45cba16b-d4c1-40eb-8945-69769d27d2b7)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:02:36.678149 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': 'f6cc3671-adcd-49a0-acb1-9e19b75fc8c9', 'network_id': '7d6d1704-2ca9-4ba7-a7ef-cd394e15a741', 'port_id': 'f6cc3671-adcd-49a0-acb1-9e19b75fc8c9', 'mac_address': 'fa:16:3e:04:08:81', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 122, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '42c4f72c-ce3e-4cb1-9111-06a2ac0d1641', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 05:02:36.724452 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:36.740757 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:02:36.760130 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port f6cc3671-adcd-49a0-acb1-9e19b75fc8c9, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=f6cc3671-adcd-49a0-acb1-9e19b75fc8c9,segment=NetworkSegment(45cba16b-d4c1-40eb-8945-69769d27d2b7),segment_id=45cba16b-d4c1-40eb-8945-69769d27d2b7)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:02:36.765304 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:36.813713 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=f6cc3671-adcd-49a0-acb1-9e19b75fc8c9,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:37.167907 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5f67aa9-4360-4f8d-8869-5864b7578976 req-bc99fafd-6f03-42c6-942d-04c3a21dfa41 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:37.169448 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e5f67aa9-4360-4f8d-8869-5864b7578976 req-bc99fafd-6f03-42c6-942d-04c3a21dfa41 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=e0d6209d-3f4e-4467-bcd3-543f26133bbd HTTP/1.1" status: 200 len: 944 time: 0.0543933 Dec 24 05:02:37.215663 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e5f67aa9-4360-4f8d-8869-5864b7578976 req-f1a2ddc8-8fc9-445b-8ab9-83a1836f3ca5 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402546 Dec 24 05:02:37.468461 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27ece62b-38e8-4abd-b6ae-ff42e970b8c2 req-2a0e0a66-f734-49ae-8253-8f888c448106 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:37.469957 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-27ece62b-38e8-4abd-b6ae-ff42e970b8c2 req-2a0e0a66-f734-49ae-8253-8f888c448106 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/ports?device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 950 time: 0.0526006 Dec 24 05:02:37.517555 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-27ece62b-38e8-4abd-b6ae-ff42e970b8c2 req-23320952-3a41-4c42-a97b-8e688c961922 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/security-groups?id=afc5f95f-b105-4542-8255-46564277a986&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413260 Dec 24 05:02:37.519561 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c450241d-c1c8-43b7-b8b6-a0087a3c132c req-f3ab30e5-2bda-431e-90f3-a79093dc2069 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:37.521104 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c450241d-c1c8-43b7-b8b6-a0087a3c132c req-f3ab30e5-2bda-431e-90f3-a79093dc2069 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0524192 Dec 24 05:02:37.575569 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c450241d-c1c8-43b7-b8b6-a0087a3c132c req-b7f784cc-8d75-4f21-a892-73266d9a3266 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0484629 Dec 24 05:02:37.917867 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['f6cc3671-adcd-49a0-acb1-9e19b75fc8c9'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:02:38.345832 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8295c55c-0ec4-48fc-aa9d-988700a7b69a req-2a218715-e847-47f9-8fd8-915329a0bcd2 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:38.347279 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8295c55c-0ec4-48fc-aa9d-988700a7b69a req-2a218715-e847-47f9-8fd8-915329a0bcd2 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=e0d6209d-3f4e-4467-bcd3-543f26133bbd HTTP/1.1" status: 200 len: 944 time: 0.0606310 Dec 24 05:02:38.398271 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8295c55c-0ec4-48fc-aa9d-988700a7b69a req-d7606d5f-b931-4b34-a061-9fabad348718 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447066 Dec 24 05:02:38.654018 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac36c62e-687b-4cc1-ad97-66b095a3bb2a req-0437388c-e79e-4d2c-b6b6-0a9c7ba185bd tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:38.655422 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ac36c62e-687b-4cc1-ad97-66b095a3bb2a req-0437388c-e79e-4d2c-b6b6-0a9c7ba185bd tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/ports?device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 950 time: 0.0540791 Dec 24 05:02:38.690805 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c79ee909-e798-4438-aa53-f94e7ee49ff7 req-b5f2d455-f81b-4e6f-8369-961b805a4a25 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:38.692188 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c79ee909-e798-4438-aa53-f94e7ee49ff7 req-b5f2d455-f81b-4e6f-8369-961b805a4a25 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0473497 Dec 24 05:02:38.704169 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ac36c62e-687b-4cc1-ad97-66b095a3bb2a req-5afcf3d1-bbd3-4b18-920e-8dbec24253c6 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/security-groups?id=afc5f95f-b105-4542-8255-46564277a986&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427604 Dec 24 05:02:38.741214 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c79ee909-e798-4438-aa53-f94e7ee49ff7 req-ce56f888-c105-455c-9190-44e0b2d2cdeb tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428288 Dec 24 05:02:38.973153 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20b36640-bb09-447b-84d2-630511513f9d req-2cb50a06-e990-46f8-aae0-08d4e0024e82 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:38.974654 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-20b36640-bb09-447b-84d2-630511513f9d req-2cb50a06-e990-46f8-aae0-08d4e0024e82 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/ports?device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 950 time: 0.0532875 Dec 24 05:02:39.031307 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-20b36640-bb09-447b-84d2-630511513f9d req-e9c3bbd6-f41e-4ec4-99ac-c6d7b869751b tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/security-groups?id=afc5f95f-b105-4542-8255-46564277a986&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469658 Dec 24 05:02:39.537523 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61f35de2-b712-473c-90f2-befdb385484a req-d0d413bb-daa8-489d-a7fa-dee11313aac4 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:39.538922 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-61f35de2-b712-473c-90f2-befdb385484a req-d0d413bb-daa8-489d-a7fa-dee11313aac4 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=e0d6209d-3f4e-4467-bcd3-543f26133bbd HTTP/1.1" status: 200 len: 944 time: 0.0626125 Dec 24 05:02:39.590536 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-61f35de2-b712-473c-90f2-befdb385484a req-355782a9-68b3-4042-801c-cb6612636314 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444431 Dec 24 05:02:39.867127 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-118fe3dd-b39e-429d-99e7-b720e2781ad1 req-8849895c-c2ea-428e-b5c6-07b87e2cd9d1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:39.868827 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-118fe3dd-b39e-429d-99e7-b720e2781ad1 req-8849895c-c2ea-428e-b5c6-07b87e2cd9d1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0586123 Dec 24 05:02:39.920776 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-118fe3dd-b39e-429d-99e7-b720e2781ad1 req-ac642451-1e3e-44df-9ecb-47901290a20d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455713 Dec 24 05:02:40.170015 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0be91e97-99cc-4511-b2b5-bdbd5cfdb063 req-0208e2c9-92d4-4fb3-8a0c-8844a62538d4 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:40.171387 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0be91e97-99cc-4511-b2b5-bdbd5cfdb063 req-0208e2c9-92d4-4fb3-8a0c-8844a62538d4 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/ports?device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 950 time: 0.0603793 Dec 24 05:02:40.224176 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0be91e97-99cc-4511-b2b5-bdbd5cfdb063 req-601d66be-f9dd-44ac-8c66-ad32f4fbab1a tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/security-groups?id=afc5f95f-b105-4542-8255-46564277a986&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469503 Dec 24 05:02:40.570104 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:02:40.623146 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning for port f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 completed by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 24 05:02:40.627413 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:02:40.627905 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:40.724363 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aeab2e8-fd71-42d7-8ac9-90e4f5ecc156 req-d35dacda-a511-46d0-bbfd-032c4f4f7b7d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:40.724612 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:40.725290 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2aeab2e8-fd71-42d7-8ac9-90e4f5ecc156 req-d35dacda-a511-46d0-bbfd-032c4f4f7b7d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=e0d6209d-3f4e-4467-bcd3-543f26133bbd HTTP/1.1" status: 200 len: 944 time: 0.0646956 Dec 24 05:02:40.743794 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e0d6209d-3f4e-4467-bcd3-543f26133bbd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f6cc3671-adcd-49a0-acb1-9e19b75fc8c9'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:02:40.746182 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b18bbedc-3eb0-46a8-af7f-50d1d6aa0758" -d '{"events": [{"server_uuid": "e0d6209d-3f4e-4467-bcd3-543f26133bbd", "name": "network-vif-plugged", "status": "completed", "tag": "f6cc3671-adcd-49a0-acb1-9e19b75fc8c9"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:02:40.758698 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port f6cc3671-adcd-49a0-acb1-9e19b75fc8c9, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=f6cc3671-adcd-49a0-acb1-9e19b75fc8c9,segment=NetworkSegment(45cba16b-d4c1-40eb-8945-69769d27d2b7),segment_id=45cba16b-d4c1-40eb-8945-69769d27d2b7)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:02:40.763338 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:40.770896 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2aeab2e8-fd71-42d7-8ac9-90e4f5ecc156 req-11c8e513-fdd0-4cdc-967c-297dc39201b0 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448267 Dec 24 05:02:40.814260 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=f6cc3671-adcd-49a0-acb1-9e19b75fc8c9,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:40.819450 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:02:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-92285e74-b2b1-4d9a-8e62-03c0a71db58a x-openstack-request-id: req-92285e74-b2b1-4d9a-8e62-03c0a71db58a {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:02:40.819749 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e0d6209d-3f4e-4467-bcd3-543f26133bbd", "name": "network-vif-plugged", "status": "completed", "tag": "f6cc3671-adcd-49a0-acb1-9e19b75fc8c9", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:02:40.820028 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-92285e74-b2b1-4d9a-8e62-03c0a71db58a {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:02:40.820432 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e0d6209d-3f4e-4467-bcd3-543f26133bbd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f6cc3671-adcd-49a0-acb1-9e19b75fc8c9', 'code': 200} Dec 24 05:02:40.941983 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-562afe6c-3cf4-4edf-9b69-d42c9e8a54ba req-ba060b5e-2870-4199-a488-18ad4042db41 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:40.943434 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-562afe6c-3cf4-4edf-9b69-d42c9e8a54ba req-ba060b5e-2870-4199-a488-18ad4042db41 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.46 "GET /v2.0/ports?device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 950 time: 0.0518477 Dec 24 05:02:41.115998 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7290799a-37a4-4554-b280-ad0fea576aa1 req-3ba385d4-e081-4fb1-a809-88defbfc3f5c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:41.117495 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7290799a-37a4-4554-b280-ad0fea576aa1 req-3ba385d4-e081-4fb1-a809-88defbfc3f5c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.1207931 Dec 24 05:02:41.145290 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfb92ba9-6119-4c9b-a604-9883a7f5595b req-1d0998a3-faf3-46ad-bdc1-70cc60df1b56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:41.146728 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-cfb92ba9-6119-4c9b-a604-9883a7f5595b req-1d0998a3-faf3-46ad-bdc1-70cc60df1b56 service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=e0d6209d-3f4e-4467-bcd3-543f26133bbd HTTP/1.1" status: 200 len: 1098 time: 0.0839307 Dec 24 05:02:41.149408 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-562afe6c-3cf4-4edf-9b69-d42c9e8a54ba req-cb42f41b-2e11-42d6-8268-6abb3c09340e tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Deleting port d8920e65-30d8-4362-a099-871fe2010a7c {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:02:41.149739 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-562afe6c-3cf4-4edf-9b69-d42c9e8a54ba req-cb42f41b-2e11-42d6-8268-6abb3c09340e tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:41.258741 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7290799a-37a4-4554-b280-ad0fea576aa1 req-047bbf5b-e064-4aad-849f-13befb09875b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1331584 Dec 24 05:02:41.287626 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-cfb92ba9-6119-4c9b-a604-9883a7f5595b req-f33b2acb-a687-4b1b-9a60-713d305267ea service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1228192 Dec 24 05:02:41.305175 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-562afe6c-3cf4-4edf-9b69-d42c9e8a54ba req-cb42f41b-2e11-42d6-8268-6abb3c09340e tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] For port d8920e65-30d8-4362-a099-871fe2010a7c, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=d8920e65-30d8-4362-a099-871fe2010a7c,segment=NetworkSegment(12eac7f7-f84a-41ca-ba10-cc6036d850a8),segment_id=12eac7f7-f84a-41ca-ba10-cc6036d850a8)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:02:41.305506 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-562afe6c-3cf4-4edf-9b69-d42c9e8a54ba req-cb42f41b-2e11-42d6-8268-6abb3c09340e tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:41.321181 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-562afe6c-3cf4-4edf-9b69-d42c9e8a54ba req-cb42f41b-2e11-42d6-8268-6abb3c09340e tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Calling delete_port for d8920e65-30d8-4362-a099-871fe2010a7c owned by compute:nova {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:02:41.364249 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d18d631-87c3-41d9-8e6e-c6cba1225b9a req-6a38f30f-8581-4c01-b6b6-d2e255e8d1dd tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:41.365752 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-9d18d631-87c3-41d9-8e6e-c6cba1225b9a req-6a38f30f-8581-4c01-b6b6-d2e255e8d1dd tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/ports?device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 950 time: 0.0605192 Dec 24 05:02:41.412199 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-9d18d631-87c3-41d9-8e6e-c6cba1225b9a req-f7518e79-cff4-42d2-a2af-a72414f30b04 tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/security-groups?id=afc5f95f-b105-4542-8255-46564277a986&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396628 Dec 24 05:02:41.465602 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-562afe6c-3cf4-4edf-9b69-d42c9e8a54ba req-cb42f41b-2e11-42d6-8268-6abb3c09340e tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:41.491463 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb42f41b-2e11-42d6-8268-6abb3c09340e tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Pushing event deleted for resources: {'Port': ['ID=d8920e65-30d8-4362-a099-871fe2010a7c,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:02:41.522155 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['d8920e65-30d8-4362-a099-871fe2010a7c'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:02:41.537690 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-562afe6c-3cf4-4edf-9b69-d42c9e8a54ba req-cb42f41b-2e11-42d6-8268-6abb3c09340e tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] No DVR routers for this DVR port d8920e65-30d8-4362-a099-871fe2010a7c on host hv-cinder-81644 {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:02:41.540761 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-562afe6c-3cf4-4edf-9b69-d42c9e8a54ba req-cb42f41b-2e11-42d6-8268-6abb3c09340e tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:41.545566 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-562afe6c-3cf4-4edf-9b69-d42c9e8a54ba req-cb42f41b-2e11-42d6-8268-6abb3c09340e tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.46 "DELETE /v2.0/ports/d8920e65-30d8-4362-a099-871fe2010a7c HTTP/1.1" status: 204 len: 173 time: 0.5761850 Dec 24 05:02:41.546079 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1ce0890f-150d-48b6-9be0-b572f7429968', 'name': 'network-vif-deleted', 'tag': 'd8920e65-30d8-4362-a099-871fe2010a7c'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:02:41.548404 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-53b99c99-f985-4344-81af-7386fc11b32b" -d '{"events": [{"server_uuid": "1ce0890f-150d-48b6-9be0-b572f7429968", "name": "network-vif-deleted", "tag": "d8920e65-30d8-4362-a099-871fe2010a7c"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:02:41.588703 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:02:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8d815c08-20aa-4575-b8e9-d3c7fdfe8855 x-openstack-request-id: req-8d815c08-20aa-4575-b8e9-d3c7fdfe8855 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:02:41.589047 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1ce0890f-150d-48b6-9be0-b572f7429968", "name": "network-vif-deleted", "tag": "d8920e65-30d8-4362-a099-871fe2010a7c", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:02:41.589303 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-8d815c08-20aa-4575-b8e9-d3c7fdfe8855 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:02:41.589701 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1ce0890f-150d-48b6-9be0-b572f7429968', 'name': 'network-vif-deleted', 'tag': 'd8920e65-30d8-4362-a099-871fe2010a7c', 'status': 'completed', 'code': 200} Dec 24 05:02:41.897684 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af8007f7-10ef-43dd-8fa0-72144514bd93 req-2ec7b70d-c5d9-4a45-b44a-e60ffa5561c3 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:41.899068 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-af8007f7-10ef-43dd-8fa0-72144514bd93 req-2ec7b70d-c5d9-4a45-b44a-e60ffa5561c3 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=e0d6209d-3f4e-4467-bcd3-543f26133bbd HTTP/1.1" status: 200 len: 945 time: 0.0518284 Dec 24 05:02:41.954732 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-af8007f7-10ef-43dd-8fa0-72144514bd93 req-1828edbb-f4e5-4a7c-8918-6628d3548028 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0488486 Dec 24 05:02:42.420047 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ded99cf-8275-4f15-932c-6e4b4472fc28 req-f9495f7e-1bcc-4400-a257-c31b05ea5a36 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:42.421559 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3ded99cf-8275-4f15-932c-6e4b4472fc28 req-f9495f7e-1bcc-4400-a257-c31b05ea5a36 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0617478 Dec 24 05:02:42.471313 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3ded99cf-8275-4f15-932c-6e4b4472fc28 req-1476bd27-8485-4421-9bc1-2ba6b40f17ec tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436521 Dec 24 05:02:42.523369 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ef075eec-8439-427a-abcb-203843b68fe0 req-d08afb58-72fe-4d68-96ba-379e6e8b007d tempest-VolumesNegativeTest-1102357267 tempest-VolumesNegativeTest-1102357267-project] 10.222.0.43 "GET /v2.0/ports?device_id=1ce0890f-150d-48b6-9be0-b572f7429968 HTTP/1.1" status: 200 len: 210 time: 0.0272417 Dec 24 05:02:43.077786 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2406beda-1822-4967-9adc-cb91ad52ace8 req-52e24128-c255-406c-ac3b-09b7861f654f tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:43.079947 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-2406beda-1822-4967-9adc-cb91ad52ace8 req-52e24128-c255-406c-ac3b-09b7861f654f tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=e0d6209d-3f4e-4467-bcd3-543f26133bbd HTTP/1.1" status: 200 len: 945 time: 0.0531063 Dec 24 05:02:43.130189 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-2406beda-1822-4967-9adc-cb91ad52ace8 req-25feaff7-a8db-4960-9380-0d5b82e68b47 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431857 Dec 24 05:02:43.591975 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7366b95-3c34-47ab-801f-1ef163e451fe req-6a8da663-0ee4-47ee-8ca0-22b554a892fc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:43.593513 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a7366b95-3c34-47ab-801f-1ef163e451fe req-6a8da663-0ee4-47ee-8ca0-22b554a892fc tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0551274 Dec 24 05:02:43.645711 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a7366b95-3c34-47ab-801f-1ef163e451fe req-a28e0668-86ea-4fe9-8ca9-8e8afda926f1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458686 Dec 24 05:02:44.250739 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4974e9ca-d34a-4842-b434-9b2b0cd52b2f req-ae728376-be61-48fc-9c0a-35135ed6ef1b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:44.252989 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4974e9ca-d34a-4842-b434-9b2b0cd52b2f req-ae728376-be61-48fc-9c0a-35135ed6ef1b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=e0d6209d-3f4e-4467-bcd3-543f26133bbd HTTP/1.1" status: 200 len: 945 time: 0.0544443 Dec 24 05:02:44.309808 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4974e9ca-d34a-4842-b434-9b2b0cd52b2f req-a8ecb9c3-605d-4ba5-9ec3-0a75b764b8f9 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496299 Dec 24 05:02:44.602897 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device d8920e65-30d8-4362-a099-871fe2010a7c no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:02:44.624688 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] No Port match for: d8920e65-30d8-4362-a099-871fe2010a7c {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:02:44.625055 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device d8920e65-30d8-4362-a099-871fe2010a7c not bound to the agent host hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:02:44.806606 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e327bc35-6dcd-46e7-9882-6ac3dbe4c928 req-c46e08a2-65a6-4502-9d09-4accab3afcc4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:44.808369 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e327bc35-6dcd-46e7-9882-6ac3dbe4c928 req-c46e08a2-65a6-4502-9d09-4accab3afcc4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0824776 Dec 24 05:02:44.859059 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e327bc35-6dcd-46e7-9882-6ac3dbe4c928 req-ef56e1e0-81ef-4a17-b18a-a034f2d7c9a0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441771 Dec 24 05:02:45.985136 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55bd6060-43ef-4e0e-a023-fb335a826cf4 req-938ad5df-c33b-4282-907d-4780a1738411 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:45.986605 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-55bd6060-43ef-4e0e-a023-fb335a826cf4 req-938ad5df-c33b-4282-907d-4780a1738411 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0590384 Dec 24 05:02:46.034512 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-55bd6060-43ef-4e0e-a023-fb335a826cf4 req-342117b3-b9c6-43cd-a4ec-7e74f2d5fdd3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416143 Dec 24 05:02:46.714830 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4f080ed-9ae0-4cc7-b927-d4c3525d141d req-21dc4cc1-45aa-4537-9cf6-7a18bf8c2036 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:46.716355 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a4f080ed-9ae0-4cc7-b927-d4c3525d141d req-21dc4cc1-45aa-4537-9cf6-7a18bf8c2036 service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 1098 time: 0.0439308 Dec 24 05:02:46.771789 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a4f080ed-9ae0-4cc7-b927-d4c3525d141d req-16c83294-2220-4277-9c83-740a74b096a4 service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468054 Dec 24 05:02:47.167773 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecde2813-17a1-4aa3-a902-0b6e288322da req-a8c14dc8-a1f0-4858-b5ec-708331b26b86 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:47.169432 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ecde2813-17a1-4aa3-a902-0b6e288322da req-a8c14dc8-a1f0-4858-b5ec-708331b26b86 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0617063 Dec 24 05:02:47.223035 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ecde2813-17a1-4aa3-a902-0b6e288322da req-3058b2da-c857-497b-b775-44b273ed719b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474792 Dec 24 05:02:48.356566 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cb5ae8b-7027-4d43-8ec6-8e1a12d450da req-de54939d-3f8c-4284-9347-cf3567004edd tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:48.358119 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0cb5ae8b-7027-4d43-8ec6-8e1a12d450da req-de54939d-3f8c-4284-9347-cf3567004edd tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0541675 Dec 24 05:02:48.419880 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0cb5ae8b-7027-4d43-8ec6-8e1a12d450da req-2461f0a6-5245-45cb-a9b9-929c60156641 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497601 Dec 24 05:02:49.427376 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:49.546159 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-826646a2-f251-4f68-8e13-c788c9f08bfd req-57cbb976-889b-4c95-9860-d2188f240f66 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:49.547736 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-826646a2-f251-4f68-8e13-c788c9f08bfd req-57cbb976-889b-4c95-9860-d2188f240f66 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0514128 Dec 24 05:02:49.595708 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-826646a2-f251-4f68-8e13-c788c9f08bfd req-bb582c37-c676-4a22-a262-4bee0b0dde3f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412643 Dec 24 05:02:49.974501 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ff4d78d-e373-4b99-aa66-9cf4f56dc737 req-760f7123-4e2d-425b-94a7-d3ff5ad215c4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:49.976906 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7ff4d78d-e373-4b99-aa66-9cf4f56dc737 req-760f7123-4e2d-425b-94a7-d3ff5ad215c4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0503273 Dec 24 05:02:49.997759 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e09b54f3-eea3-440b-8c64-ad3ee0094408 req-a265795b-6e08-498a-9d2d-af4f2492b921 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:49.999232 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e09b54f3-eea3-440b-8c64-ad3ee0094408 req-a265795b-6e08-498a-9d2d-af4f2492b921 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=1b651e55b1a349a0b9582c526d3b5d67&device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 1098 time: 0.0450203 Dec 24 05:02:50.027195 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7ff4d78d-e373-4b99-aa66-9cf4f56dc737 req-bb444ec0-e7c9-44fb-9bfe-f1d70811e0aa tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429559 Dec 24 05:02:50.107942 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e09b54f3-eea3-440b-8c64-ad3ee0094408 req-dd9c3cae-e54f-47cb-ac48-07daf286d1cc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:50.109523 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e09b54f3-eea3-440b-8c64-ad3ee0094408 req-dd9c3cae-e54f-47cb-ac48-07daf286d1cc service neutron] 10.222.0.46 "GET /v2.0/networks?id=0d368baa-5733-40a7-b836-139a541f4ebb HTTP/1.1" status: 200 len: 919 time: 0.0992708 Dec 24 05:02:50.181408 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e09b54f3-eea3-440b-8c64-ad3ee0094408 req-9b11647c-e667-4cf8-b27e-a7565952e0d4 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ea61b5c0-ffb7-42bf-9289-095515c125a2 HTTP/1.1" status: 200 len: 217 time: 0.0386612 Dec 24 05:02:50.240703 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e09b54f3-eea3-440b-8c64-ad3ee0094408 req-460bbdcb-bf1e-4312-9a40-3ae57c9f2ab6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:50.242192 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e09b54f3-eea3-440b-8c64-ad3ee0094408 req-460bbdcb-bf1e-4312-9a40-3ae57c9f2ab6 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=88f274d6-bcf0-47e8-9f0a-783a53214be4 HTTP/1.1" status: 200 len: 858 time: 0.0526881 Dec 24 05:02:50.278186 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e09b54f3-eea3-440b-8c64-ad3ee0094408 req-c91a6483-1c41-476f-8214-8a6c6b478b35 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=0d368baa-5733-40a7-b836-139a541f4ebb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0250452 Dec 24 05:02:50.374348 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e09b54f3-eea3-440b-8c64-ad3ee0094408 req-d15548c2-4426-40f3-b8b0-8e7bece53a2f service neutron] 10.222.0.46 "GET /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0869873 Dec 24 05:02:50.474698 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e09b54f3-eea3-440b-8c64-ad3ee0094408 req-7e5adc44-70ad-44bf-8ea6-ab9831e94cf9 service neutron] 10.222.0.46 "GET /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0872488 Dec 24 05:02:51.153701 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58f36259-5489-4380-b9d6-8bfa3532f35f req-eb3fec54-3a46-4647-bea5-d65fe37f0784 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:51.155253 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-58f36259-5489-4380-b9d6-8bfa3532f35f req-eb3fec54-3a46-4647-bea5-d65fe37f0784 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0542719 Dec 24 05:02:51.206248 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-58f36259-5489-4380-b9d6-8bfa3532f35f req-848fee79-2947-48b1-87ca-7e7734b14e4f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449281 Dec 24 05:02:52.338977 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-761dcba4-f986-4f88-99ec-980f838368eb req-e4ac2814-5577-4a97-a372-35db284d0481 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:52.340497 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-761dcba4-f986-4f88-99ec-980f838368eb req-e4ac2814-5577-4a97-a372-35db284d0481 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0525606 Dec 24 05:02:52.387968 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-761dcba4-f986-4f88-99ec-980f838368eb req-a29c805a-e105-4470-a7c2-ca8037530227 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415463 Dec 24 05:02:53.195943 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-6feac30c-6f6a-489c-a88f-40317b5a8fc7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:53.524654 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f233c815-47eb-4864-b565-7e8a3066c4f3 req-0c573629-5fcd-43f2-8681-5772c949392d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:53.526046 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f233c815-47eb-4864-b565-7e8a3066c4f3 req-0c573629-5fcd-43f2-8681-5772c949392d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0580585 Dec 24 05:02:53.577286 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f233c815-47eb-4864-b565-7e8a3066c4f3 req-cd9995c3-d0a5-4d7d-b320-d0eeb75a5c61 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449948 Dec 24 05:02:54.704069 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-826739e9-ffc5-444d-8093-77899824223c req-481fe3fd-3bae-4aa7-8211-6011e887da8f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:54.705744 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-826739e9-ffc5-444d-8093-77899824223c req-481fe3fd-3bae-4aa7-8211-6011e887da8f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0544229 Dec 24 05:02:54.755700 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-826739e9-ffc5-444d-8093-77899824223c req-1cf50176-ae5d-4b0c-8669-7d9a560e3f32 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410943 Dec 24 05:02:55.264157 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-0100703c-1f4a-4178-9067-f282eda3bad4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:55.878397 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ec795c2-9f51-489c-9f4f-b83fdfa7149c req-c1d5b87b-8e6d-4d62-8e24-e1838281d22f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:55.879986 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6ec795c2-9f51-489c-9f4f-b83fdfa7149c req-c1d5b87b-8e6d-4d62-8e24-e1838281d22f tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0513518 Dec 24 05:02:55.927861 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6ec795c2-9f51-489c-9f4f-b83fdfa7149c req-acddf05c-816b-45c2-8028-9aa613c68623 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402658 Dec 24 05:02:56.459392 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:57.049714 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11453b13-7c78-4674-8782-a2861a77488e req-c168a9d9-bf3f-4f62-8148-9d424ede2774 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:57.051193 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-11453b13-7c78-4674-8782-a2861a77488e req-c168a9d9-bf3f-4f62-8148-9d424ede2774 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0522313 Dec 24 05:02:57.106512 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-11453b13-7c78-4674-8782-a2861a77488e req-52e1199c-5f5d-46be-9565-355a39b7b8d0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463371 Dec 24 05:02:57.899919 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:58.225934 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66cf334d-8c35-450b-83f3-eade047aa8be req-7759b650-5bfc-4db5-b565-b6d568597184 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:58.227385 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-66cf334d-8c35-450b-83f3-eade047aa8be req-7759b650-5bfc-4db5-b565-b6d568597184 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0513172 Dec 24 05:02:58.276547 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-66cf334d-8c35-450b-83f3-eade047aa8be req-e188c546-a43c-43ed-884f-8ffbdf31086b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419662 Dec 24 05:02:58.582689 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:02:59.401070 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12737fe6-458d-4e76-b77d-9cf18fb81f67 req-7e72b2fa-6022-4e78-b006-222f0512f79d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:02:59.402625 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-12737fe6-458d-4e76-b77d-9cf18fb81f67 req-7e72b2fa-6022-4e78-b006-222f0512f79d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0498173 Dec 24 05:02:59.454579 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-12737fe6-458d-4e76-b77d-9cf18fb81f67 req-68047f61-4be0-4ed1-a7ce-cccf125409e7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453513 Dec 24 05:03:00.581325 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02682518-9453-4a2f-ba6c-8cec770a9b6f req-469098d5-2b82-41d0-b597-be30338de557 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:00.582810 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-02682518-9453-4a2f-ba6c-8cec770a9b6f req-469098d5-2b82-41d0-b597-be30338de557 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0515633 Dec 24 05:03:00.630469 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-02682518-9453-4a2f-ba6c-8cec770a9b6f req-9b46c010-9559-419b-a3ae-c2a42d501b91 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410955 Dec 24 05:03:01.753756 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e881453b-9649-401b-8b6d-6fc3fcafeb82 req-46cf9064-cd3d-4e8f-ab35-53677cb03720 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:01.755222 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e881453b-9649-401b-8b6d-6fc3fcafeb82 req-46cf9064-cd3d-4e8f-ab35-53677cb03720 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0523627 Dec 24 05:03:01.802337 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e881453b-9649-401b-8b6d-6fc3fcafeb82 req-6d45a89c-a1d1-4076-9f87-06fb51631693 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407057 Dec 24 05:03:02.329130 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 57870) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:03:02.469380 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-a90d5db5-6174-4455-809d-12ad8c16366a admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=aad82f86c5b5403799701feca92f316e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1390026 Dec 24 05:03:02.471983 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 57876) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:03:02.519523 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0e5306a7-b074-4998-b1a3-ca7a40ab7615 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:02.543638 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0e5306a7-b074-4998-b1a3-ca7a40ab7615 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:02.595041 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0e5306a7-b074-4998-b1a3-ca7a40ab7615 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:02.597633 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0e5306a7-b074-4998-b1a3-ca7a40ab7615 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:02.603271 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-0e5306a7-b074-4998-b1a3-ca7a40ab7615 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/afc5f95f-b105-4542-8255-46564277a986 HTTP/1.1" status: 204 len: 168 time: 0.1292889 Dec 24 05:03:02.614561 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e5306a7-b074-4998-b1a3-ca7a40ab7615 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=afc5f95f-b105-4542-8255-46564277a986,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:03:02.627903 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e5306a7-b074-4998-b1a3-ca7a40ab7615 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:02.627903 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e5306a7-b074-4998-b1a3-ca7a40ab7615 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:02.627903 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e5306a7-b074-4998-b1a3-ca7a40ab7615 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:02.627903 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e5306a7-b074-4998-b1a3-ca7a40ab7615 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:02.627903 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e5306a7-b074-4998-b1a3-ca7a40ab7615 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:02.627903 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e5306a7-b074-4998-b1a3-ca7a40ab7615 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:02.627903 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e5306a7-b074-4998-b1a3-ca7a40ab7615 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:02.627903 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e5306a7-b074-4998-b1a3-ca7a40ab7615 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:02.627903 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e5306a7-b074-4998-b1a3-ca7a40ab7615 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:02.627903 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e5306a7-b074-4998-b1a3-ca7a40ab7615 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:02.627903 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e5306a7-b074-4998-b1a3-ca7a40ab7615 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:02.627903 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e5306a7-b074-4998-b1a3-ca7a40ab7615 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:02.627903 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e5306a7-b074-4998-b1a3-ca7a40ab7615 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:02.940116 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4274ec78-a631-486f-b44e-48eb0813dc66 req-9f6b3843-b47c-4211-b86e-3eeef85fae6b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:02.941623 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4274ec78-a631-486f-b44e-48eb0813dc66 req-9f6b3843-b47c-4211-b86e-3eeef85fae6b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0611942 Dec 24 05:03:02.997827 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4274ec78-a631-486f-b44e-48eb0813dc66 req-57dd2276-0e87-43a6-895f-57b27cf0728e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502129 Dec 24 05:03:08.101466 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 57980) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:03:08.218560 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b0297ecb-ea45-4d88-8111-58ea869e1d80 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:08.295889 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b0297ecb-ea45-4d88-8111-58ea869e1d80 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:08.301304 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b0297ecb-ea45-4d88-8111-58ea869e1d80 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:08.337754 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0297ecb-ea45-4d88-8111-58ea869e1d80 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f9b37ece-e661-4895-9974-4826f3ccaadb,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:03:08.342826 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-b0297ecb-ea45-4d88-8111-58ea869e1d80 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=c3a93b5704664252a75434c60a003e42&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2403109 Dec 24 05:03:08.345612 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 57988) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:03:08.347540 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0297ecb-ea45-4d88-8111-58ea869e1d80 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:08.347891 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0297ecb-ea45-4d88-8111-58ea869e1d80 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:08.348286 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0297ecb-ea45-4d88-8111-58ea869e1d80 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:08.348629 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0297ecb-ea45-4d88-8111-58ea869e1d80 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:08.349154 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0297ecb-ea45-4d88-8111-58ea869e1d80 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:08.349492 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0297ecb-ea45-4d88-8111-58ea869e1d80 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:08.349820 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0297ecb-ea45-4d88-8111-58ea869e1d80 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:08.350146 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0297ecb-ea45-4d88-8111-58ea869e1d80 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:08.350472 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0297ecb-ea45-4d88-8111-58ea869e1d80 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:08.350796 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0297ecb-ea45-4d88-8111-58ea869e1d80 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:08.351138 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0297ecb-ea45-4d88-8111-58ea869e1d80 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:08.351476 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0297ecb-ea45-4d88-8111-58ea869e1d80 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:08.351796 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0297ecb-ea45-4d88-8111-58ea869e1d80 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:08.394778 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-fd32b372-d189-454a-b035-ba45e1ca2e4a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:08.415505 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-fd32b372-d189-454a-b035-ba45e1ca2e4a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:08.465655 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-fd32b372-d189-454a-b035-ba45e1ca2e4a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:08.468390 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-fd32b372-d189-454a-b035-ba45e1ca2e4a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:08.469794 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-fd32b372-d189-454a-b035-ba45e1ca2e4a admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/f9b37ece-e661-4895-9974-4826f3ccaadb HTTP/1.1" status: 204 len: 168 time: 0.1230979 Dec 24 05:03:08.477455 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd32b372-d189-454a-b035-ba45e1ca2e4a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f9b37ece-e661-4895-9974-4826f3ccaadb,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:03:09.413419 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:03:17.482321 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4ca4415-9d9d-4014-a282-5449f939bc12 req-57385958-6f39-432d-b4c9-b2baf5f386fe tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:17.483784 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a4ca4415-9d9d-4014-a282-5449f939bc12 req-57385958-6f39-432d-b4c9-b2baf5f386fe tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0488701 Dec 24 05:03:17.539179 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a4ca4415-9d9d-4014-a282-5449f939bc12 req-b4926aff-ffa8-43f5-bf87-db228a0c0dd1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0472679 Dec 24 05:03:18.657106 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de5d2394-b37f-4bb9-9d3e-beafd54b8f8c req-dfdcb363-c785-4c75-981a-7a0ac5d0291e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:18.658566 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-de5d2394-b37f-4bb9-9d3e-beafd54b8f8c req-dfdcb363-c785-4c75-981a-7a0ac5d0291e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0500498 Dec 24 05:03:18.708718 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-de5d2394-b37f-4bb9-9d3e-beafd54b8f8c req-dc84b422-461b-42a8-8502-202feb8e211d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413878 Dec 24 05:03:19.263017 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efd72274-872f-4465-b24a-b3ad3434212d req-6a82d4f4-043a-4e00-99a4-e3a1c6dc28fa tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:19.264804 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-efd72274-872f-4465-b24a-b3ad3434212d req-6a82d4f4-043a-4e00-99a4-e3a1c6dc28fa tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 945 time: 0.0532546 Dec 24 05:03:19.319840 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-efd72274-872f-4465-b24a-b3ad3434212d req-7f02f8e9-9077-4030-8ca5-062eafe60e07 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479774 Dec 24 05:03:19.435947 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:19.837069 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fde3fc3b-9f2c-464c-b859-3e56f5cd79b9 req-419ded93-48fa-423b-99e2-89ef1309d18d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:19.838868 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-fde3fc3b-9f2c-464c-b859-3e56f5cd79b9 req-419ded93-48fa-423b-99e2-89ef1309d18d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0494711 Dec 24 05:03:19.888209 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-fde3fc3b-9f2c-464c-b859-3e56f5cd79b9 req-2c4eb06d-3816-4da0-93c9-66e5f5b4a3fa tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431318 Dec 24 05:03:20.450056 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-781e8b2b-9f10-4bf7-8319-97bc8b5d46e1 req-6cccf515-e90a-47ee-baa5-58838a2b979b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:20.451624 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-781e8b2b-9f10-4bf7-8319-97bc8b5d46e1 req-6cccf515-e90a-47ee-baa5-58838a2b979b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 945 time: 0.0581625 Dec 24 05:03:20.501591 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-781e8b2b-9f10-4bf7-8319-97bc8b5d46e1 req-a6965713-3ecf-472f-b983-9585bf0a2837 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413573 Dec 24 05:03:21.007670 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d525c8ae-9a07-4f5c-a1d0-8f66bcda2c3e req-a57dd737-207a-4c74-a346-d4ec32924484 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:21.009217 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d525c8ae-9a07-4f5c-a1d0-8f66bcda2c3e req-a57dd737-207a-4c74-a346-d4ec32924484 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0512142 Dec 24 05:03:21.060539 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d525c8ae-9a07-4f5c-a1d0-8f66bcda2c3e req-e1d2961e-da86-40d4-86cf-a081053a2e02 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420294 Dec 24 05:03:21.637342 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6138f24d-3c90-463e-b132-d39273cf2892 req-e7aae3a8-12fc-4dcc-9b53-3d6e69b1122b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:21.638861 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6138f24d-3c90-463e-b132-d39273cf2892 req-e7aae3a8-12fc-4dcc-9b53-3d6e69b1122b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 945 time: 0.0590258 Dec 24 05:03:21.690603 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6138f24d-3c90-463e-b132-d39273cf2892 req-27aa8dc8-b2bc-438c-a2c7-cdd8bbfa5097 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423174 Dec 24 05:03:22.188731 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dc3e002-1949-4508-a5b3-b84b01387989 req-a8d03280-8a0f-4f47-86e3-abbcd87e95f7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:22.190356 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8dc3e002-1949-4508-a5b3-b84b01387989 req-a8d03280-8a0f-4f47-86e3-abbcd87e95f7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0519111 Dec 24 05:03:22.241402 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8dc3e002-1949-4508-a5b3-b84b01387989 req-4b48d285-8abb-41fa-9f72-6484c0d4acc0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449085 Dec 24 05:03:22.824569 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75d44cdf-9826-4a95-b177-fac3231a6835 req-244b66fa-a1b3-452f-90a1-7057f3af0d7a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:22.826078 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-75d44cdf-9826-4a95-b177-fac3231a6835 req-244b66fa-a1b3-452f-90a1-7057f3af0d7a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 945 time: 0.0526910 Dec 24 05:03:22.888443 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-75d44cdf-9826-4a95-b177-fac3231a6835 req-358c2e68-54c5-49af-bc93-b03303268800 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0556498 Dec 24 05:03:23.191888 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-5578167a-e2b2-422b-b526-b0bcbd64f614 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:23.361878 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77af4b28-9b27-4fa4-9c5b-39314cbe69a4 req-f95c48dd-bd9a-4439-9c3c-3403baaa371e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:23.363401 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-77af4b28-9b27-4fa4-9c5b-39314cbe69a4 req-f95c48dd-bd9a-4439-9c3c-3403baaa371e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0511246 Dec 24 05:03:23.413127 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-77af4b28-9b27-4fa4-9c5b-39314cbe69a4 req-3039395e-f1b6-4304-a9f2-8969cc93c244 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429866 Dec 24 05:03:24.016797 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e2a3880-9cbc-4681-b73f-47ed97adb503 req-c8525f79-c3bf-41e3-a114-7a3693956660 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:24.018310 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8e2a3880-9cbc-4681-b73f-47ed97adb503 req-c8525f79-c3bf-41e3-a114-7a3693956660 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 945 time: 0.0598199 Dec 24 05:03:24.071826 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8e2a3880-9cbc-4681-b73f-47ed97adb503 req-1b418e6c-2f55-4108-846f-241355b92d8e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449984 Dec 24 05:03:24.279157 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3810b95c-7b41-4507-a717-ce6a7e7e4b95 req-412441f8-0a2d-4b12-99ff-6ae20eedfd25 service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0449882 Dec 24 05:03:24.547321 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-635a1016-6243-460a-900b-ff31ecf365e6 req-eeba228f-b14a-45a1-bc01-206b0a46c1f1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:24.548832 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-635a1016-6243-460a-900b-ff31ecf365e6 req-eeba228f-b14a-45a1-bc01-206b0a46c1f1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0585895 Dec 24 05:03:24.600913 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-635a1016-6243-460a-900b-ff31ecf365e6 req-56c15172-2144-4918-b852-5fab9d38b3d6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453861 Dec 24 05:03:24.627820 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3810b95c-7b41-4507-a717-ce6a7e7e4b95 req-ce26b305-d0e9-4239-bbfe-d2ca92a90974 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:24.629396 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3810b95c-7b41-4507-a717-ce6a7e7e4b95 req-ce26b305-d0e9-4239-bbfe-d2ca92a90974 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=6c9c47f70b8d4da5827a8ef4349559ab&device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 1098 time: 0.0405054 Dec 24 05:03:24.779712 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3810b95c-7b41-4507-a717-ce6a7e7e4b95 req-0f7dae5c-dbdd-4cdf-bf9c-c137a7bbcf21 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:24.781209 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3810b95c-7b41-4507-a717-ce6a7e7e4b95 req-0f7dae5c-dbdd-4cdf-bf9c-c137a7bbcf21 service neutron] 10.222.0.46 "GET /v2.0/networks?id=c908572e-3b6b-470c-8b88-35b51f1472c6 HTTP/1.1" status: 200 len: 917 time: 0.0854285 Dec 24 05:03:24.856802 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3810b95c-7b41-4507-a717-ce6a7e7e4b95 req-8fb520cc-697d-40f0-8b88-801f885fd393 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=61ec3441-5b75-4c07-b8ad-4174450d6a55 HTTP/1.1" status: 200 len: 1000 time: 0.0610816 Dec 24 05:03:24.905754 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3810b95c-7b41-4507-a717-ce6a7e7e4b95 req-e4dca867-ff55-4ff0-b74f-a0635de6ffa4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:24.907183 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3810b95c-7b41-4507-a717-ce6a7e7e4b95 req-e4dca867-ff55-4ff0-b74f-a0635de6ffa4 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=699b398d-7f9d-4acb-bc18-ac32f35377c3 HTTP/1.1" status: 200 len: 855 time: 0.0418375 Dec 24 05:03:24.966261 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3810b95c-7b41-4507-a717-ce6a7e7e4b95 req-e9fe9f79-80e8-4b4d-9df7-014a4fdf2abd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:24.967728 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3810b95c-7b41-4507-a717-ce6a7e7e4b95 req-e9fe9f79-80e8-4b4d-9df7-014a4fdf2abd service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=c908572e-3b6b-470c-8b88-35b51f1472c6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0490782 Dec 24 05:03:25.061066 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3810b95c-7b41-4507-a717-ce6a7e7e4b95 req-da194ae2-6211-4cb0-8280-eb4c3775ea82 service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0847237 Dec 24 05:03:25.166680 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3810b95c-7b41-4507-a717-ce6a7e7e4b95 req-4b7b1c8c-678f-4c31-b4f2-278c2a4b576c service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0980072 Dec 24 05:03:25.213004 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55ed044c-35c4-4f76-b658-6962e7399de2 req-38c0bfde-6321-4563-baf9-0fd2eb99073c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:25.214637 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-55ed044c-35c4-4f76-b658-6962e7399de2 req-38c0bfde-6321-4563-baf9-0fd2eb99073c tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 945 time: 0.0626273 Dec 24 05:03:25.261085 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-18fcc849-7085-4f96-9f69-7cfa99cf36a4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:25.266624 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-55ed044c-35c4-4f76-b658-6962e7399de2 req-3e1aad01-a8f7-4d9f-a16f-a94d391063ba tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457771 Dec 24 05:03:25.402737 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a247084f-aa26-4fed-85dd-d2d5af498aaf req-9d57177d-8412-4c62-ae8d-41a6946fd9ae tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:25.404103 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a247084f-aa26-4fed-85dd-d2d5af498aaf req-9d57177d-8412-4c62-ae8d-41a6946fd9ae tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.46 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.0579739 Dec 24 05:03:25.608728 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-a247084f-aa26-4fed-85dd-d2d5af498aaf req-065c36f7-7076-44ea-a383-58ae681edf90 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Deleting port 24d08627-8243-4361-b6b4-8461a18d110f {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:03:25.609064 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-a247084f-aa26-4fed-85dd-d2d5af498aaf req-065c36f7-7076-44ea-a383-58ae681edf90 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:25.986088 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-a247084f-aa26-4fed-85dd-d2d5af498aaf req-065c36f7-7076-44ea-a383-58ae681edf90 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] For port 24d08627-8243-4361-b6b4-8461a18d110f, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=24d08627-8243-4361-b6b4-8461a18d110f,segment=NetworkSegment(d94b0a1e-2098-4b10-9091-c566351ffe74),segment_id=d94b0a1e-2098-4b10-9091-c566351ffe74)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:03:25.986624 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-a247084f-aa26-4fed-85dd-d2d5af498aaf req-065c36f7-7076-44ea-a383-58ae681edf90 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:26.004070 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-a247084f-aa26-4fed-85dd-d2d5af498aaf req-065c36f7-7076-44ea-a383-58ae681edf90 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling delete_port for 24d08627-8243-4361-b6b4-8461a18d110f owned by compute:nova {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:03:26.017450 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08a22980-9a1e-439a-90a9-e38f0b2bb24c req-92660762-f2f4-4bb3-8b62-b7cb9ccd8047 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:26.019531 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-08a22980-9a1e-439a-90a9-e38f0b2bb24c req-92660762-f2f4-4bb3-8b62-b7cb9ccd8047 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 946 time: 0.3419371 Dec 24 05:03:26.114320 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-08a22980-9a1e-439a-90a9-e38f0b2bb24c req-66a64c2f-977d-41df-8242-4114766d94de tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0846181 Dec 24 05:03:26.185954 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-a247084f-aa26-4fed-85dd-d2d5af498aaf req-065c36f7-7076-44ea-a383-58ae681edf90 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:26.224866 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-065c36f7-7076-44ea-a383-58ae681edf90 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Pushing event deleted for resources: {'Port': ['ID=24d08627-8243-4361-b6b4-8461a18d110f,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:03:26.228880 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['ea61b5c0-ffb7-42bf-9289-095515c125a2', '24d08627-8243-4361-b6b4-8461a18d110f'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:03:26.319138 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-a247084f-aa26-4fed-85dd-d2d5af498aaf req-065c36f7-7076-44ea-a383-58ae681edf90 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] No DVR routers for this DVR port 24d08627-8243-4361-b6b4-8461a18d110f on host hv-cinder-81644 {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:03:26.322248 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-a247084f-aa26-4fed-85dd-d2d5af498aaf req-065c36f7-7076-44ea-a383-58ae681edf90 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:26.325888 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a247084f-aa26-4fed-85dd-d2d5af498aaf req-065c36f7-7076-44ea-a383-58ae681edf90 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.46 "DELETE /v2.0/ports/24d08627-8243-4361-b6b4-8461a18d110f HTTP/1.1" status: 204 len: 173 time: 0.8288178 Dec 24 05:03:26.326679 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '580344bb-42e6-4fd7-967d-04e85d821fd2', 'name': 'network-vif-deleted', 'tag': '24d08627-8243-4361-b6b4-8461a18d110f'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:03:26.329805 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7c563bfa-ba22-40c3-9248-b37e8957e0b4" -d '{"events": [{"server_uuid": "580344bb-42e6-4fd7-967d-04e85d821fd2", "name": "network-vif-deleted", "tag": "24d08627-8243-4361-b6b4-8461a18d110f"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:03:26.345582 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee1dda5e-1149-4d2c-b407-d0160b594a5e req-7ffbc5f9-b03c-4681-b2f7-06e270c3d14f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:26.347219 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ee1dda5e-1149-4d2c-b407-d0160b594a5e req-7ffbc5f9-b03c-4681-b2f7-06e270c3d14f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.46 "GET /v2.0/ports?device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 945 time: 0.1236210 Dec 24 05:03:26.424154 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:03:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9ac90b96-61ce-4be6-97e7-42feebd0054f x-openstack-request-id: req-9ac90b96-61ce-4be6-97e7-42feebd0054f {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:03:26.424901 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "580344bb-42e6-4fd7-967d-04e85d821fd2", "name": "network-vif-deleted", "tag": "24d08627-8243-4361-b6b4-8461a18d110f", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:03:26.425165 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-9ac90b96-61ce-4be6-97e7-42feebd0054f {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:03:26.425700 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '580344bb-42e6-4fd7-967d-04e85d821fd2', 'name': 'network-vif-deleted', 'tag': '24d08627-8243-4361-b6b4-8461a18d110f', 'status': 'completed', 'code': 200} Dec 24 05:03:26.466223 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4269a6d5-1a0d-4aa2-96a4-bef9017257ef req-65acc984-c528-470a-87f0-c81670958fe0 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:26.475821 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4269a6d5-1a0d-4aa2-96a4-bef9017257ef req-65acc984-c528-470a-87f0-c81670958fe0 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 945 time: 0.0953546 Dec 24 05:03:26.482582 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:26.511235 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-ee1dda5e-1149-4d2c-b407-d0160b594a5e req-8599fcbe-0523-4f94-ac2a-5b959d84da78 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Deleting port 7484fcf7-0384-4cf4-8974-7df317686b39 {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:03:26.511730 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-ee1dda5e-1149-4d2c-b407-d0160b594a5e req-8599fcbe-0523-4f94-ac2a-5b959d84da78 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:26.528181 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4269a6d5-1a0d-4aa2-96a4-bef9017257ef req-c183cc91-bacb-4623-a66f-45c5c5c978c8 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0510745 Dec 24 05:03:26.600242 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-ee1dda5e-1149-4d2c-b407-d0160b594a5e req-8599fcbe-0523-4f94-ac2a-5b959d84da78 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] For port 7484fcf7-0384-4cf4-8974-7df317686b39, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=7484fcf7-0384-4cf4-8974-7df317686b39,segment=NetworkSegment(10307c97-e214-473b-b760-bb1b770153ec),segment_id=10307c97-e214-473b-b760-bb1b770153ec)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:03:26.600675 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-ee1dda5e-1149-4d2c-b407-d0160b594a5e req-8599fcbe-0523-4f94-ac2a-5b959d84da78 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:26.613548 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-ee1dda5e-1149-4d2c-b407-d0160b594a5e req-8599fcbe-0523-4f94-ac2a-5b959d84da78 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling delete_port for 7484fcf7-0384-4cf4-8974-7df317686b39 owned by compute:nova {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:03:26.746932 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-ee1dda5e-1149-4d2c-b407-d0160b594a5e req-8599fcbe-0523-4f94-ac2a-5b959d84da78 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:26.776090 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8599fcbe-0523-4f94-ac2a-5b959d84da78 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Pushing event deleted for resources: {'Port': ['ID=7484fcf7-0384-4cf4-8974-7df317686b39,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:03:26.818657 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['50d50f46-e761-4fb1-9761-fa48778aa8aa', 'b0bd939a-1211-4ec1-b074-b2767d087f95', '13f44c71-4981-48aa-bff5-6222de8d0cc1', '7484fcf7-0384-4cf4-8974-7df317686b39'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:03:26.820660 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-ee1dda5e-1149-4d2c-b407-d0160b594a5e req-8599fcbe-0523-4f94-ac2a-5b959d84da78 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] No DVR routers for this DVR port 7484fcf7-0384-4cf4-8974-7df317686b39 on host hv-cinder-81644 {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:03:26.823156 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-ee1dda5e-1149-4d2c-b407-d0160b594a5e req-8599fcbe-0523-4f94-ac2a-5b959d84da78 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:26.826479 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ee1dda5e-1149-4d2c-b407-d0160b594a5e req-8599fcbe-0523-4f94-ac2a-5b959d84da78 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.46 "DELETE /v2.0/ports/7484fcf7-0384-4cf4-8974-7df317686b39 HTTP/1.1" status: 204 len: 173 time: 0.4444954 Dec 24 05:03:27.237440 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ac459df7-7ae1-4c4a-8118-31e6a34552c5 req-dd4d1178-f657-4efd-b70f-83467a68f976 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=580344bb-42e6-4fd7-967d-04e85d821fd2 HTTP/1.1" status: 200 len: 210 time: 0.0276666 Dec 24 05:03:27.651393 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5bf187cd-3391-4042-92c3-b68be980ca2d req-854a73e4-a0ea-4b56-a7af-6e6e4a38a7ee tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=6e67ec17-823b-4612-8bd4-dbe278717d5e HTTP/1.1" status: 200 len: 210 time: 0.0304160 Dec 24 05:03:27.903589 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:28.427140 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6e67ec17-823b-4612-8bd4-dbe278717d5e', 'name': 'network-vif-deleted', 'tag': '7484fcf7-0384-4cf4-8974-7df317686b39'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:03:28.431112 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-14f0d67e-375a-42e8-b799-365121111937" -d '{"events": [{"server_uuid": "6e67ec17-823b-4612-8bd4-dbe278717d5e", "name": "network-vif-deleted", "tag": "7484fcf7-0384-4cf4-8974-7df317686b39"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:03:28.467042 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:03:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-71b68ca8-9ba1-48f4-97e0-ad70a06c1264 x-openstack-request-id: req-71b68ca8-9ba1-48f4-97e0-ad70a06c1264 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:03:28.467332 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6e67ec17-823b-4612-8bd4-dbe278717d5e", "name": "network-vif-deleted", "tag": "7484fcf7-0384-4cf4-8974-7df317686b39", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:03:28.467580 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-71b68ca8-9ba1-48f4-97e0-ad70a06c1264 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:03:28.467970 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6e67ec17-823b-4612-8bd4-dbe278717d5e', 'name': 'network-vif-deleted', 'tag': '7484fcf7-0384-4cf4-8974-7df317686b39', 'status': 'completed', 'code': 200} Dec 24 05:03:28.521567 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6cd9e7d-4ebb-4929-9172-3bb7b0b073bc req-28a7aded-c586-4818-a5ae-60c2e49d317e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:28.522962 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b6cd9e7d-4ebb-4929-9172-3bb7b0b073bc req-28a7aded-c586-4818-a5ae-60c2e49d317e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0483460 Dec 24 05:03:28.572458 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b6cd9e7d-4ebb-4929-9172-3bb7b0b073bc req-876724f8-4235-4b26-94c4-2549682d1ee1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432153 Dec 24 05:03:28.579832 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:28.832309 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 24d08627-8243-4361-b6b4-8461a18d110f no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:03:28.854272 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] No Port match for: 24d08627-8243-4361-b6b4-8461a18d110f {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:03:28.854622 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 24d08627-8243-4361-b6b4-8461a18d110f not bound to the agent host hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:03:29.705485 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dc2513a-f692-42e0-bba5-254789bd329c req-b0318437-535e-4e07-a7d5-5a1e119e2761 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:29.707161 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5dc2513a-f692-42e0-bba5-254789bd329c req-b0318437-535e-4e07-a7d5-5a1e119e2761 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0504632 Dec 24 05:03:29.747534 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3af16989-6f13-4e7f-934d-c3169b5ed2d9 req-0da13101-cb27-47b8-a743-846989d360b0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:29.749146 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3af16989-6f13-4e7f-934d-c3169b5ed2d9 req-0da13101-cb27-47b8-a743-846989d360b0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0513535 Dec 24 05:03:29.757402 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5dc2513a-f692-42e0-bba5-254789bd329c req-5f436443-d135-41d0-b88f-7e395c3f5601 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434527 Dec 24 05:03:29.797641 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3af16989-6f13-4e7f-934d-c3169b5ed2d9 req-aadd7b2f-8dd5-4ea9-9aa1-af645b050535 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418878 Dec 24 05:03:30.880483 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bd5ac06-734d-40b2-81a8-570c99940e07 req-c4b2a8ce-9923-4be6-8b07-3fc3d7dadb92 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:30.881987 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0bd5ac06-734d-40b2-81a8-570c99940e07 req-c4b2a8ce-9923-4be6-8b07-3fc3d7dadb92 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0509605 Dec 24 05:03:30.926033 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdcaae23-2c4f-441a-b584-dae2b9e9b5fa req-3748b70e-2d50-45b3-baed-de9da83b6314 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:30.927520 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-fdcaae23-2c4f-441a-b584-dae2b9e9b5fa req-3748b70e-2d50-45b3-baed-de9da83b6314 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0529122 Dec 24 05:03:30.929269 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0bd5ac06-734d-40b2-81a8-570c99940e07 req-22b9a3a2-06c0-47ef-b616-433ffe7b6e29 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405951 Dec 24 05:03:30.949909 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 7484fcf7-0384-4cf4-8974-7df317686b39 no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:03:30.976435 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-fdcaae23-2c4f-441a-b584-dae2b9e9b5fa req-35d4c145-f106-4e53-a97f-c8caf734a430 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426669 Dec 24 05:03:31.096139 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] No Port match for: 7484fcf7-0384-4cf4-8974-7df317686b39 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:03:31.096443 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 7484fcf7-0384-4cf4-8974-7df317686b39 not bound to the agent host hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:03:32.049146 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab494a58-1a56-409c-bfc0-b459b24cc9af req-4a24614b-b61b-4ea7-8079-9386da7a7dc8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:32.050610 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ab494a58-1a56-409c-bfc0-b459b24cc9af req-4a24614b-b61b-4ea7-8079-9386da7a7dc8 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0532770 Dec 24 05:03:32.097953 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ab494a58-1a56-409c-bfc0-b459b24cc9af req-d2bfee35-779c-4635-b604-18bba52c7b3b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412869 Dec 24 05:03:32.102649 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8d41289-a264-4d75-8846-a5d95460d644 req-82175c9a-91c1-4123-8f64-a6f3c4e150f4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:32.104406 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e8d41289-a264-4d75-8846-a5d95460d644 req-82175c9a-91c1-4123-8f64-a6f3c4e150f4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0516183 Dec 24 05:03:32.156153 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e8d41289-a264-4d75-8846-a5d95460d644 req-16e00e7f-72cf-4913-a837-dc445bea53c4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456510 Dec 24 05:03:33.225813 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bb1403e-5b63-415f-a5c8-2d18f5860781 req-0e262120-1aae-4743-a382-a9399fd05805 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:33.227324 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0bb1403e-5b63-415f-a5c8-2d18f5860781 req-0e262120-1aae-4743-a382-a9399fd05805 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0543823 Dec 24 05:03:33.277762 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fb0e1a1-6369-4220-9392-1f7b736df323 req-c5b48a91-1d4c-4cb9-be55-5a7df5d57532 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:33.278923 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0bb1403e-5b63-415f-a5c8-2d18f5860781 req-156d8b06-42bc-455d-81aa-959766a3439a tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451598 Dec 24 05:03:33.279410 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4fb0e1a1-6369-4220-9392-1f7b736df323 req-c5b48a91-1d4c-4cb9-be55-5a7df5d57532 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0513377 Dec 24 05:03:33.331017 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4fb0e1a1-6369-4220-9392-1f7b736df323 req-2a5a00eb-8834-4e0e-a6d8-cf8a12db6d2d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442266 Dec 24 05:03:34.270971 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf7de9d1-7aee-46cb-a99b-41e70bfadc8b req-b2837fc5-c633-47f7-ac9f-c4dae58db4a6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:34.272488 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bf7de9d1-7aee-46cb-a99b-41e70bfadc8b req-b2837fc5-c633-47f7-ac9f-c4dae58db4a6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 945 time: 0.0586677 Dec 24 05:03:34.321590 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bf7de9d1-7aee-46cb-a99b-41e70bfadc8b req-e84c43af-316e-476d-a7de-e34dc7b35076 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427370 Dec 24 05:03:34.407877 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35b5bc9f-99fe-4829-a146-d5e5eb32ad25 req-4a2ade07-5621-467d-9bee-761e62b2d83b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:34.410280 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-35b5bc9f-99fe-4829-a146-d5e5eb32ad25 req-4a2ade07-5621-467d-9bee-761e62b2d83b tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0545127 Dec 24 05:03:34.462790 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e46b8b55-851c-4fea-a672-0397ea34b549 req-4f6cc6a3-0f2a-4de8-adc0-0754d730f8c2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:34.464333 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e46b8b55-851c-4fea-a672-0397ea34b549 req-4f6cc6a3-0f2a-4de8-adc0-0754d730f8c2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0566413 Dec 24 05:03:34.514203 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e46b8b55-851c-4fea-a672-0397ea34b549 req-b7cfee07-b94a-4545-a700-8d5317a28477 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435302 Dec 24 05:03:34.633499 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-35b5bc9f-99fe-4829-a146-d5e5eb32ad25 req-7a8448bf-4b9f-490c-968e-22581d36ccb9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2163906 Dec 24 05:03:35.442634 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb731b49-c957-4fac-8ed3-d993634a0205 req-332108d8-27b5-471e-95d4-2966ee404603 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:35.444452 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-eb731b49-c957-4fac-8ed3-d993634a0205 req-332108d8-27b5-471e-95d4-2966ee404603 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 945 time: 0.0532458 Dec 24 05:03:35.492846 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-eb731b49-c957-4fac-8ed3-d993634a0205 req-924b6821-1580-487c-a436-06ba87b8e1d4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409057 Dec 24 05:03:35.641227 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac02ea8b-d99b-40e5-b3bf-9c521ae681ff req-7f505ac5-2e7c-4c58-be20-4f16a26bb84b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:35.642669 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ac02ea8b-d99b-40e5-b3bf-9c521ae681ff req-7f505ac5-2e7c-4c58-be20-4f16a26bb84b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0494256 Dec 24 05:03:35.692023 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ac02ea8b-d99b-40e5-b3bf-9c521ae681ff req-9faac18e-31c9-48df-99c2-2ee10b057e1f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429034 Dec 24 05:03:35.750647 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41f7d0e3-9224-4c11-9ab6-68804b436410 req-130a3584-48b4-42d8-86df-b8f3282c8880 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:35.752166 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-41f7d0e3-9224-4c11-9ab6-68804b436410 req-130a3584-48b4-42d8-86df-b8f3282c8880 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0520935 Dec 24 05:03:35.803999 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-41f7d0e3-9224-4c11-9ab6-68804b436410 req-89b2fd61-00f4-4118-a9b4-b960f2f3cb9c tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455937 Dec 24 05:03:36.616907 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-672e40c1-d383-4039-a6a2-86ee17264438 req-8dc790d7-68dc-4b6a-beac-1cd6e033a4b7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:36.618578 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-672e40c1-d383-4039-a6a2-86ee17264438 req-8dc790d7-68dc-4b6a-beac-1cd6e033a4b7 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 945 time: 0.0527382 Dec 24 05:03:36.666673 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-672e40c1-d383-4039-a6a2-86ee17264438 req-62c94230-f2d2-4607-b962-39985d519800 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422947 Dec 24 05:03:36.821314 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-325ff823-2be6-4160-a5fe-cf9a3dcb8619 req-285287b0-ba49-414c-94bb-21394658d482 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:36.823113 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-325ff823-2be6-4160-a5fe-cf9a3dcb8619 req-285287b0-ba49-414c-94bb-21394658d482 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0516613 Dec 24 05:03:36.876653 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-325ff823-2be6-4160-a5fe-cf9a3dcb8619 req-0f1b6478-8f50-4ed6-a73c-6b3e1b4f321e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440381 Dec 24 05:03:36.929965 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae5b29ac-0fa2-456d-ac37-d234138dba71 req-9e3fca18-68f1-44ad-953f-15274d501831 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:36.931500 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ae5b29ac-0fa2-456d-ac37-d234138dba71 req-9e3fca18-68f1-44ad-953f-15274d501831 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0539677 Dec 24 05:03:36.986290 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ae5b29ac-0fa2-456d-ac37-d234138dba71 req-d6100c86-a20b-488c-856a-1ada0ba02c63 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451148 Dec 24 05:03:37.789004 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cda93e06-c548-43d9-b65f-d55d4169fd51 req-410c1c0f-29f4-4486-b7c7-822d60c814b5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:37.790474 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-cda93e06-c548-43d9-b65f-d55d4169fd51 req-410c1c0f-29f4-4486-b7c7-822d60c814b5 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 945 time: 0.0532405 Dec 24 05:03:37.838072 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-cda93e06-c548-43d9-b65f-d55d4169fd51 req-7d670fa9-c19c-48a8-9055-52aacab87360 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414414 Dec 24 05:03:38.006187 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9685d5cf-1315-46d8-8ccd-b5ae709f573c req-cfaf183c-43a0-48d7-b74a-0cd9363583a1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:38.007559 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-9685d5cf-1315-46d8-8ccd-b5ae709f573c req-cfaf183c-43a0-48d7-b74a-0cd9363583a1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0503845 Dec 24 05:03:38.057623 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-9685d5cf-1315-46d8-8ccd-b5ae709f573c req-9abfb029-9c01-46aa-8445-e34e2f281573 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437698 Dec 24 05:03:38.105527 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f73dbabf-85d7-4dc0-82ce-536491dc3c3c req-4630b7f6-ea4e-4888-bb5e-4f6ec43d60c4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:38.106972 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f73dbabf-85d7-4dc0-82ce-536491dc3c3c req-4630b7f6-ea4e-4888-bb5e-4f6ec43d60c4 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0531783 Dec 24 05:03:38.156397 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f73dbabf-85d7-4dc0-82ce-536491dc3c3c req-070cd334-30ed-49a5-8312-89e9bb28bfc6 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405827 Dec 24 05:03:38.961173 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6a1bc77-a37d-456a-b2fb-c4c4a26838ee req-7e5f1e8e-cf88-4208-a65a-01e19e9142a4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:38.962643 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f6a1bc77-a37d-456a-b2fb-c4c4a26838ee req-7e5f1e8e-cf88-4208-a65a-01e19e9142a4 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 945 time: 0.0539920 Dec 24 05:03:39.010244 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f6a1bc77-a37d-456a-b2fb-c4c4a26838ee req-7866a1f7-96d0-4a35-a09d-7fd2924b75a6 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415025 Dec 24 05:03:39.185717 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2f3be33-f4a8-4817-b1c8-15cc28529d90 req-6be83086-0a74-44ff-b485-e96f7ab1de1d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:39.187251 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e2f3be33-f4a8-4817-b1c8-15cc28529d90 req-6be83086-0a74-44ff-b485-e96f7ab1de1d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0534322 Dec 24 05:03:39.240352 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e2f3be33-f4a8-4817-b1c8-15cc28529d90 req-ef2474fb-c677-4ded-9dd7-d173bd56ba62 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0459697 Dec 24 05:03:39.277154 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-166e8b5b-7290-465c-a165-13fcf701c829 req-00cd69b7-db78-4e1d-8cbf-9f89b85b2854 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:39.278659 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-166e8b5b-7290-465c-a165-13fcf701c829 req-00cd69b7-db78-4e1d-8cbf-9f89b85b2854 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0498743 Dec 24 05:03:39.325880 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-166e8b5b-7290-465c-a165-13fcf701c829 req-3b50130e-0388-4045-9f74-9d161b20d3e7 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412459 Dec 24 05:03:40.136596 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9b431f-1bc5-457b-b228-d1fd7b2f2205 req-c80b372b-d721-428c-b915-238554d85ea0 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:40.138248 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-fa9b431f-1bc5-457b-b228-d1fd7b2f2205 req-c80b372b-d721-428c-b915-238554d85ea0 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 945 time: 0.0543389 Dec 24 05:03:40.190443 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-fa9b431f-1bc5-457b-b228-d1fd7b2f2205 req-0c1ce568-3781-4f94-9c73-e9b8ba0fa9ff tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437522 Dec 24 05:03:40.323482 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfad08eb-f280-40c5-bda4-87f3349d125c req-0f3c809b-70db-4dc1-95ae-8ea353d4ef1f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:40.325326 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bfad08eb-f280-40c5-bda4-87f3349d125c req-0f3c809b-70db-4dc1-95ae-8ea353d4ef1f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.46 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 945 time: 0.0635841 Dec 24 05:03:40.372202 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53c2f008-777d-430e-b017-5f574eaaaf4b req-137d1711-5006-4189-9d78-58de1dc7884d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:40.373722 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-53c2f008-777d-430e-b017-5f574eaaaf4b req-137d1711-5006-4189-9d78-58de1dc7884d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0500894 Dec 24 05:03:40.425360 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-53c2f008-777d-430e-b017-5f574eaaaf4b req-ed55ea41-201a-4ed5-a68c-146b6839eafc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452340 Dec 24 05:03:40.466565 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5657b688-1d99-4233-8d4a-da01373ed228 req-3c96adfb-02c1-429a-a982-fb31273d087e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:40.468074 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5657b688-1d99-4233-8d4a-da01373ed228 req-3c96adfb-02c1-429a-a982-fb31273d087e tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0672779 Dec 24 05:03:40.481950 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-bfad08eb-f280-40c5-bda4-87f3349d125c req-05b4d188-ee7e-4e5b-b358-3f192409578b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Deleting port 13f44c71-4981-48aa-bff5-6222de8d0cc1 {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:03:40.482288 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-bfad08eb-f280-40c5-bda4-87f3349d125c req-05b4d188-ee7e-4e5b-b358-3f192409578b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:40.580003 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5657b688-1d99-4233-8d4a-da01373ed228 req-1b5c6421-487e-470f-842a-3b626f311127 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1056008 Dec 24 05:03:40.602862 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-bfad08eb-f280-40c5-bda4-87f3349d125c req-05b4d188-ee7e-4e5b-b358-3f192409578b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] For port 13f44c71-4981-48aa-bff5-6222de8d0cc1, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=13f44c71-4981-48aa-bff5-6222de8d0cc1,segment=NetworkSegment(10307c97-e214-473b-b760-bb1b770153ec),segment_id=10307c97-e214-473b-b760-bb1b770153ec)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:03:40.603363 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-bfad08eb-f280-40c5-bda4-87f3349d125c req-05b4d188-ee7e-4e5b-b358-3f192409578b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:40.617445 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-bfad08eb-f280-40c5-bda4-87f3349d125c req-05b4d188-ee7e-4e5b-b358-3f192409578b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling delete_port for 13f44c71-4981-48aa-bff5-6222de8d0cc1 owned by compute:nova {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:03:40.752309 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-bfad08eb-f280-40c5-bda4-87f3349d125c req-05b4d188-ee7e-4e5b-b358-3f192409578b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:40.791249 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05b4d188-ee7e-4e5b-b358-3f192409578b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Pushing event deleted for resources: {'Port': ['ID=13f44c71-4981-48aa-bff5-6222de8d0cc1,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:03:40.832744 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-bfad08eb-f280-40c5-bda4-87f3349d125c req-05b4d188-ee7e-4e5b-b358-3f192409578b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] No DVR routers for this DVR port 13f44c71-4981-48aa-bff5-6222de8d0cc1 on host hv-cinder-81644 {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:03:40.835717 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-bfad08eb-f280-40c5-bda4-87f3349d125c req-05b4d188-ee7e-4e5b-b358-3f192409578b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:40.839106 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bfad08eb-f280-40c5-bda4-87f3349d125c req-05b4d188-ee7e-4e5b-b358-3f192409578b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.46 "DELETE /v2.0/ports/13f44c71-4981-48aa-bff5-6222de8d0cc1 HTTP/1.1" status: 204 len: 173 time: 0.5072401 Dec 24 05:03:40.839541 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e93dfa9e-7d0c-4922-9108-dd3b9c6265e2', 'name': 'network-vif-deleted', 'tag': '13f44c71-4981-48aa-bff5-6222de8d0cc1'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:03:40.841839 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-71f68db6-9d0c-44c6-995e-0957615c2ee9" -d '{"events": [{"server_uuid": "e93dfa9e-7d0c-4922-9108-dd3b9c6265e2", "name": "network-vif-deleted", "tag": "13f44c71-4981-48aa-bff5-6222de8d0cc1"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:03:40.878437 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:03:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e39b0056-6fc0-4843-bd85-2b47b6ad276b x-openstack-request-id: req-e39b0056-6fc0-4843-bd85-2b47b6ad276b {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:03:40.878726 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e93dfa9e-7d0c-4922-9108-dd3b9c6265e2", "name": "network-vif-deleted", "tag": "13f44c71-4981-48aa-bff5-6222de8d0cc1", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:03:40.878956 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-e39b0056-6fc0-4843-bd85-2b47b6ad276b {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:03:40.879377 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e93dfa9e-7d0c-4922-9108-dd3b9c6265e2', 'name': 'network-vif-deleted', 'tag': '13f44c71-4981-48aa-bff5-6222de8d0cc1', 'status': 'completed', 'code': 200} Dec 24 05:03:41.294752 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-34ac43cf-4de2-4113-9f3a-53f1afb17ea3 req-4791cfca-5c0b-421f-8956-8f1cc0f3f3f3 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 210 time: 0.0298958 Dec 24 05:03:41.556156 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9588941-2740-4c53-bce3-b8f2ccf25ed9 req-d0db6f90-60fa-4016-a891-8bcc43576c87 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:41.558132 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e9588941-2740-4c53-bce3-b8f2ccf25ed9 req-d0db6f90-60fa-4016-a891-8bcc43576c87 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0513527 Dec 24 05:03:41.607830 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e9588941-2740-4c53-bce3-b8f2ccf25ed9 req-ad06295a-6720-4a60-afa5-a4ca9c2ba8c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429451 Dec 24 05:03:41.695649 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a44e7f08-de82-4e82-ad50-09d47f972a3e req-4f7dd9bd-ced3-4c70-b720-824c98c2b4d3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:41.697134 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a44e7f08-de82-4e82-ad50-09d47f972a3e req-4f7dd9bd-ced3-4c70-b720-824c98c2b4d3 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0494080 Dec 24 05:03:41.747523 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a44e7f08-de82-4e82-ad50-09d47f972a3e req-c397c99a-4594-4f8a-a198-65a065342ccf tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441947 Dec 24 05:03:42.399148 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4152cdb0-2d6f-475c-b875-57036a9de4b2 req-75efd9d5-70c5-4122-a921-aa38f7e04c82 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 210 time: 0.0302687 Dec 24 05:03:42.747565 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71ff8111-05dc-491f-bab1-506653ca7e93 req-cf6df347-d577-46a4-a845-da13add49a9f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:42.749068 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-71ff8111-05dc-491f-bab1-506653ca7e93 req-cf6df347-d577-46a4-a845-da13add49a9f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0564752 Dec 24 05:03:42.806360 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-71ff8111-05dc-491f-bab1-506653ca7e93 req-3f4198a1-2cf5-4c57-8c51-7cd585a32fbd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0512943 Dec 24 05:03:42.864939 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28673efb-796d-464d-80f6-3dda980d989c req-b283844c-719e-4bd2-a4ac-7e5c9a324360 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:42.866432 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-28673efb-796d-464d-80f6-3dda980d989c req-b283844c-719e-4bd2-a4ac-7e5c9a324360 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0508144 Dec 24 05:03:42.923071 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-28673efb-796d-464d-80f6-3dda980d989c req-9c54aafd-f090-4289-8f77-f150da57e242 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500898 Dec 24 05:03:43.501919 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ccb1aa58-50a3-46e8-ab22-e1be2ce54d14 req-51f6fac9-5299-42cd-849d-4a57a60fe653 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 210 time: 0.0273774 Dec 24 05:03:43.943975 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d333fe43-d7ab-40e3-b7ba-acc0be0b587c req-28af4d16-de21-4737-a2b8-686fca450808 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:43.945466 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d333fe43-d7ab-40e3-b7ba-acc0be0b587c req-28af4d16-de21-4737-a2b8-686fca450808 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0552247 Dec 24 05:03:43.995661 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d333fe43-d7ab-40e3-b7ba-acc0be0b587c req-96851cd6-aec5-4b1e-baba-a554c1bcb3a2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441606 Dec 24 05:03:44.046639 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e676ea32-9ee4-4f91-8e94-90b6fc988a0d req-715b93ea-d29f-4937-9f94-ba4921990de2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:44.048166 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e676ea32-9ee4-4f91-8e94-90b6fc988a0d req-715b93ea-d29f-4937-9f94-ba4921990de2 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0561717 Dec 24 05:03:44.110192 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e676ea32-9ee4-4f91-8e94-90b6fc988a0d req-2db9f06e-fbb1-418b-9281-856ce93174d1 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0528135 Dec 24 05:03:44.603759 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-de279349-9ab6-4e56-a557-56510d36e0b5 req-cf4b2201-c17c-4f26-9f60-9b3ce649819e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 210 time: 0.0305245 Dec 24 05:03:44.611567 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['50d50f46-e761-4fb1-9761-fa48778aa8aa', 'b0bd939a-1211-4ec1-b074-b2767d087f95', '13f44c71-4981-48aa-bff5-6222de8d0cc1'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:03:45.139541 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd925cf9-ebb2-4529-bf66-bd9f895b6fb3 req-40279d54-56bf-4a80-8abb-2f2a65e285e0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:45.141193 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bd925cf9-ebb2-4529-bf66-bd9f895b6fb3 req-40279d54-56bf-4a80-8abb-2f2a65e285e0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0650702 Dec 24 05:03:45.191253 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bd925cf9-ebb2-4529-bf66-bd9f895b6fb3 req-b75cce76-c14c-4d5c-befc-8c55c5f3266a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436819 Dec 24 05:03:45.227995 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c276555-19e5-45e3-a8fa-647020ee5faa req-00dfbd08-cdfd-40e6-8704-ba0033238bb9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:45.229588 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8c276555-19e5-45e3-a8fa-647020ee5faa req-00dfbd08-cdfd-40e6-8704-ba0033238bb9 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0488341 Dec 24 05:03:45.286930 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8c276555-19e5-45e3-a8fa-647020ee5faa req-95e26b5b-c78e-4787-90ae-fb8384282257 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471401 Dec 24 05:03:45.699959 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-799d5898-a724-428e-b941-06c971715a89 req-d34dde25-51ef-4a58-84d7-0bf41d440682 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 210 time: 0.0275047 Dec 24 05:03:46.318442 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0a641e5-7fda-4979-ac5c-e85031e7b32e req-375bb61f-3948-4bc8-b611-c78fee4e20cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:46.319967 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e0a641e5-7fda-4979-ac5c-e85031e7b32e req-375bb61f-3948-4bc8-b611-c78fee4e20cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0546834 Dec 24 05:03:46.370559 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e0a641e5-7fda-4979-ac5c-e85031e7b32e req-d5ba60dc-0376-4f36-961b-5e6ff03fd914 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443265 Dec 24 05:03:46.405634 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c544fef9-4dc8-47b2-9d27-e65cc696fa70 req-85727e6f-e9bb-486e-b714-b5cb2e09d503 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:46.407182 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c544fef9-4dc8-47b2-9d27-e65cc696fa70 req-85727e6f-e9bb-486e-b714-b5cb2e09d503 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0487845 Dec 24 05:03:46.412998 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:03:46.454053 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c544fef9-4dc8-47b2-9d27-e65cc696fa70 req-ea7cb7ec-0e87-4139-8536-9ce6163b3e8d tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406651 Dec 24 05:03:46.796969 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-312185c2-b368-4ebf-9385-96a5901071d6 req-34bc5721-bc95-4b25-be78-f5a348ecb8ca tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 210 time: 0.0293586 Dec 24 05:03:47.504157 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff7ae01-db80-47dc-822d-a50cfdc48560 req-619b8c65-3af7-435d-b392-fd0eac912102 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:47.505681 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9ff7ae01-db80-47dc-822d-a50cfdc48560 req-619b8c65-3af7-435d-b392-fd0eac912102 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0539989 Dec 24 05:03:47.554666 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9ff7ae01-db80-47dc-822d-a50cfdc48560 req-c921ac27-1176-4a53-b945-6dc7f8759337 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428767 Dec 24 05:03:47.586989 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-834be70e-82da-41d4-b1e2-dd1a754fd39c req-f961f40a-5b92-4a15-9a69-994fa2aeda43 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:47.590903 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-834be70e-82da-41d4-b1e2-dd1a754fd39c req-f961f40a-5b92-4a15-9a69-994fa2aeda43 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0607915 Dec 24 05:03:47.643582 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-834be70e-82da-41d4-b1e2-dd1a754fd39c req-5c361cc8-d245-47ed-a3be-bb370493ccd0 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/security-groups?id=fb15db0c-18b7-4431-8838-f84f360e82f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485215 Dec 24 05:03:47.804936 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdf30afa-50e9-4781-9bd1-fe38f81a5e8a req-9b7ba6b0-145d-415b-bb7b-9d51aadb3bdb tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:47.806285 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bdf30afa-50e9-4781-9bd1-fe38f81a5e8a req-9b7ba6b0-145d-415b-bb7b-9d51aadb3bdb tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.46 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 945 time: 0.0567498 Dec 24 05:03:47.907012 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3835ca68-30e1-41c1-b7a5-2178d233c859 req-e180dc19-d749-49b8-9ba2-1178bb98485e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=e93dfa9e-7d0c-4922-9108-dd3b9c6265e2 HTTP/1.1" status: 200 len: 210 time: 0.0298290 Dec 24 05:03:47.929864 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-bdf30afa-50e9-4781-9bd1-fe38f81a5e8a req-2181e8d1-00e7-48cc-9545-9415725db6a5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Deleting port ea61b5c0-ffb7-42bf-9289-095515c125a2 {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:03:47.930204 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-bdf30afa-50e9-4781-9bd1-fe38f81a5e8a req-2181e8d1-00e7-48cc-9545-9415725db6a5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:48.031857 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-bdf30afa-50e9-4781-9bd1-fe38f81a5e8a req-2181e8d1-00e7-48cc-9545-9415725db6a5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] For port ea61b5c0-ffb7-42bf-9289-095515c125a2, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=ea61b5c0-ffb7-42bf-9289-095515c125a2,segment=NetworkSegment(d94b0a1e-2098-4b10-9091-c566351ffe74),segment_id=d94b0a1e-2098-4b10-9091-c566351ffe74)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:03:48.032223 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-bdf30afa-50e9-4781-9bd1-fe38f81a5e8a req-2181e8d1-00e7-48cc-9545-9415725db6a5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:48.050032 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-bdf30afa-50e9-4781-9bd1-fe38f81a5e8a req-2181e8d1-00e7-48cc-9545-9415725db6a5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Calling delete_port for ea61b5c0-ffb7-42bf-9289-095515c125a2 owned by compute:nova {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:03:48.184879 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-bdf30afa-50e9-4781-9bd1-fe38f81a5e8a req-2181e8d1-00e7-48cc-9545-9415725db6a5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:48.229856 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2181e8d1-00e7-48cc-9545-9415725db6a5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Pushing event deleted for resources: {'Port': ['ID=ea61b5c0-ffb7-42bf-9289-095515c125a2,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:03:48.273655 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-bdf30afa-50e9-4781-9bd1-fe38f81a5e8a req-2181e8d1-00e7-48cc-9545-9415725db6a5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] No DVR routers for this DVR port ea61b5c0-ffb7-42bf-9289-095515c125a2 on host hv-cinder-81644 {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:03:48.276409 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-bdf30afa-50e9-4781-9bd1-fe38f81a5e8a req-2181e8d1-00e7-48cc-9545-9415725db6a5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:48.279698 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bdf30afa-50e9-4781-9bd1-fe38f81a5e8a req-2181e8d1-00e7-48cc-9545-9415725db6a5 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.46 "DELETE /v2.0/ports/ea61b5c0-ffb7-42bf-9289-095515c125a2 HTTP/1.1" status: 204 len: 173 time: 0.4660535 Dec 24 05:03:48.280132 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '27408900-d9e8-47e1-be4d-aac80e3f6fae', 'name': 'network-vif-deleted', 'tag': 'ea61b5c0-ffb7-42bf-9289-095515c125a2'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:03:48.282462 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1cd20e96-3631-4691-a2db-178f269c0ca6" -d '{"events": [{"server_uuid": "27408900-d9e8-47e1-be4d-aac80e3f6fae", "name": "network-vif-deleted", "tag": "ea61b5c0-ffb7-42bf-9289-095515c125a2"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:03:48.326143 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:03:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-16823e8c-f57e-46d6-8a0e-79a68a4354af x-openstack-request-id: req-16823e8c-f57e-46d6-8a0e-79a68a4354af {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:03:48.326427 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "27408900-d9e8-47e1-be4d-aac80e3f6fae", "name": "network-vif-deleted", "tag": "ea61b5c0-ffb7-42bf-9289-095515c125a2", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:03:48.326669 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-16823e8c-f57e-46d6-8a0e-79a68a4354af {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:03:48.327059 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '27408900-d9e8-47e1-be4d-aac80e3f6fae', 'name': 'network-vif-deleted', 'tag': 'ea61b5c0-ffb7-42bf-9289-095515c125a2', 'status': 'completed', 'code': 200} Dec 24 05:03:48.455153 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['ea61b5c0-ffb7-42bf-9289-095515c125a2'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:03:48.691830 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68508373-528e-4fe2-ac99-09478bf1f9f4 req-2db1e884-abd7-4395-8eb4-651d5e9606b4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:48.693393 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-68508373-528e-4fe2-ac99-09478bf1f9f4 req-2db1e884-abd7-4395-8eb4-651d5e9606b4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0551298 Dec 24 05:03:48.720059 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 13f44c71-4981-48aa-bff5-6222de8d0cc1 no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:03:48.761402 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-68508373-528e-4fe2-ac99-09478bf1f9f4 req-1702d297-9006-4b37-8ebb-95dcd652746e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0608659 Dec 24 05:03:48.766740 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] No Port match for: 13f44c71-4981-48aa-bff5-6222de8d0cc1 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:03:48.766740 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 13f44c71-4981-48aa-bff5-6222de8d0cc1 not bound to the agent host hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:03:48.770958 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-011ebeab-2219-44f6-8d55-30b6c1dd2e18 req-2742ba50-6692-48d6-a71c-cc5f6353ee70 tempest-ServerRescueNegativeTestJSON-1922177972 tempest-ServerRescueNegativeTestJSON-1922177972-project] 10.222.0.43 "GET /v2.0/ports?device_id=27408900-d9e8-47e1-be4d-aac80e3f6fae HTTP/1.1" status: 200 len: 210 time: 0.0371978 Dec 24 05:03:49.232609 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30e6aabf-e953-4598-b14b-1427159a8136 req-29def6d2-df38-4853-bc33-122f79f7544f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:49.234163 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-30e6aabf-e953-4598-b14b-1427159a8136 req-29def6d2-df38-4853-bc33-122f79f7544f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 946 time: 0.0550835 Dec 24 05:03:49.297679 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-30e6aabf-e953-4598-b14b-1427159a8136 req-37d895aa-c6d7-40e0-8477-87e9ce250f5f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0555050 Dec 24 05:03:49.429860 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:49.829432 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 58594) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:03:49.876844 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c3a2594-47d8-4f8a-ae91-b8210a46fd9a req-7b8a3bbb-0ac7-46d8-8a27-197e2d381aa8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:49.878474 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7c3a2594-47d8-4f8a-ae91-b8210a46fd9a req-7b8a3bbb-0ac7-46d8-8a27-197e2d381aa8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0507009 Dec 24 05:03:49.936743 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7c3a2594-47d8-4f8a-ae91-b8210a46fd9a req-bd60ee67-a1ee-44fd-a9ac-6c04c9e307d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0509069 Dec 24 05:03:50.298246 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-649c2937-fd59-44a4-8bcd-69921dbd0f5f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-548364'] for router_interface, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:50.500462 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12115404-5d46-4d3b-b3bf-afa93dcc65ff req-8798a4a4-88ad-429e-93f8-25eb554c2cca tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:50.502424 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-12115404-5d46-4d3b-b3bf-afa93dcc65ff req-8798a4a4-88ad-429e-93f8-25eb554c2cca tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 946 time: 0.1222296 Dec 24 05:03:50.590792 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-12115404-5d46-4d3b-b3bf-afa93dcc65ff req-ca6fd033-30fc-4b9e-947a-a95487d0b084 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0715449 Dec 24 05:03:50.682762 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-649c2937-fd59-44a4-8bcd-69921dbd0f5f admin admin] Deleting port e2f138ca-5e6c-4ae5-883d-02357c2bbbd2 {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:03:50.683461 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-649c2937-fd59-44a4-8bcd-69921dbd0f5f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:50.727637 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device ea61b5c0-ffb7-42bf-9289-095515c125a2 no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:03:50.750446 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] No Port match for: ea61b5c0-ffb7-42bf-9289-095515c125a2 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:03:50.750790 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device ea61b5c0-ffb7-42bf-9289-095515c125a2 not bound to the agent host hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:03:50.764407 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [None req-649c2937-fd59-44a4-8bcd-69921dbd0f5f admin admin] For port e2f138ca-5e6c-4ae5-883d-02357c2bbbd2, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=e2f138ca-5e6c-4ae5-883d-02357c2bbbd2,segment=NetworkSegment(d94b0a1e-2098-4b10-9091-c566351ffe74),segment_id=d94b0a1e-2098-4b10-9091-c566351ffe74)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:03:50.764833 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-649c2937-fd59-44a4-8bcd-69921dbd0f5f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:50.783136 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-649c2937-fd59-44a4-8bcd-69921dbd0f5f admin admin] Calling delete_port for e2f138ca-5e6c-4ae5-883d-02357c2bbbd2 owned by network:router_interface {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:03:50.965955 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-649c2937-fd59-44a4-8bcd-69921dbd0f5f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:50.995087 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-649c2937-fd59-44a4-8bcd-69921dbd0f5f admin admin] Pushing event deleted for resources: {'Port': ['ID=e2f138ca-5e6c-4ae5-883d-02357c2bbbd2,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:03:51.071382 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7717f84e-217e-479e-bbb9-c7d41175209d req-a17bf185-6761-4d1a-b810-e5aeef841755 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:51.075483 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7717f84e-217e-479e-bbb9-c7d41175209d req-a17bf185-6761-4d1a-b810-e5aeef841755 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0565202 Dec 24 05:03:51.133475 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7717f84e-217e-479e-bbb9-c7d41175209d req-70bbdf8c-005d-4be4-ac1a-9ec697b75295 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0511467 Dec 24 05:03:51.411510 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-649c2937-fd59-44a4-8bcd-69921dbd0f5f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-627465', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-548448'] for router_interface, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:51.595182 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d007fc8a-4b3c-4ac9-a6b2-3902382c42fc req-868d5456-11eb-420d-ad28-68b9aef5ee5a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:51.596655 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d007fc8a-4b3c-4ac9-a6b2-3902382c42fc req-868d5456-11eb-420d-ad28-68b9aef5ee5a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.46 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 946 time: 0.0884268 Dec 24 05:03:51.751850 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-649c2937-fd59-44a4-8bcd-69921dbd0f5f admin admin] Router 0dcd2bd7-b267-461d-9321-738fb26edb1d has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102476) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:03:51.767593 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c7501a8-eb5e-48b8-a18f-3b79f853dc7d req-af31a844-513b-4433-a573-a948a2e8755e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:51.769088 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4c7501a8-eb5e-48b8-a18f-3b79f853dc7d req-af31a844-513b-4433-a573-a948a2e8755e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 946 time: 0.1056728 Dec 24 05:03:51.831780 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-d007fc8a-4b3c-4ac9-a6b2-3902382c42fc req-04952a32-b3eb-446d-8232-c303c3d38e42 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Deleting port b0bd939a-1211-4ec1-b074-b2767d087f95 {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:03:51.832109 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-d007fc8a-4b3c-4ac9-a6b2-3902382c42fc req-04952a32-b3eb-446d-8232-c303c3d38e42 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:51.928030 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4c7501a8-eb5e-48b8-a18f-3b79f853dc7d req-528bd662-3ee6-48e1-8faf-13e10acfdb0e tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1520565 Dec 24 05:03:51.998414 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-d007fc8a-4b3c-4ac9-a6b2-3902382c42fc req-04952a32-b3eb-446d-8232-c303c3d38e42 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] For port b0bd939a-1211-4ec1-b074-b2767d087f95, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=b0bd939a-1211-4ec1-b074-b2767d087f95,segment=NetworkSegment(10307c97-e214-473b-b760-bb1b770153ec),segment_id=10307c97-e214-473b-b760-bb1b770153ec)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:03:51.999131 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-d007fc8a-4b3c-4ac9-a6b2-3902382c42fc req-04952a32-b3eb-446d-8232-c303c3d38e42 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:52.006165 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-649c2937-fd59-44a4-8bcd-69921dbd0f5f admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:03:52.014619 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-649c2937-fd59-44a4-8bcd-69921dbd0f5f admin admin] 10.222.0.43 "PUT /v2.0/routers/0dcd2bd7-b267-461d-9321-738fb26edb1d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1816995 Dec 24 05:03:52.014927 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 58622) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:03:52.016375 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-d007fc8a-4b3c-4ac9-a6b2-3902382c42fc req-04952a32-b3eb-446d-8232-c303c3d38e42 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling delete_port for b0bd939a-1211-4ec1-b074-b2767d087f95 owned by compute:nova {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:03:52.024926 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06c82842-ebb7-4469-b721-0d203fa726af None None] Sync routers for ids ['0dcd2bd7-b267-461d-9321-738fb26edb1d'] in dv-cinder-816443-2-iscsi {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:03:52.039597 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06c82842-ebb7-4469-b721-0d203fa726af None None] Routers {'0dcd2bd7-b267-461d-9321-738fb26edb1d'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:03:52.042301 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-06c82842-ebb7-4469-b721-0d203fa726af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:03:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['0dcd2bd7-b267-461d-9321-738fb26edb1d'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:03:52.161231 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e56851c3-db40-406c-99a6-4eb7704a3d6c admin admin] Publish callbacks [] for router, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:52.174878 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-d007fc8a-4b3c-4ac9-a6b2-3902382c42fc req-04952a32-b3eb-446d-8232-c303c3d38e42 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:52.177321 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-06c82842-ebb7-4469-b721-0d203fa726af None None] Set router 0dcd2bd7-b267-461d-9321-738fb26edb1d gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:03:52.230403 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['50d50f46-e761-4fb1-9761-fa48778aa8aa', 'b0bd939a-1211-4ec1-b074-b2767d087f95'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:03:52.258546 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04952a32-b3eb-446d-8232-c303c3d38e42 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Pushing event deleted for resources: {'Port': ['ID=b0bd939a-1211-4ec1-b074-b2767d087f95,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:03:52.281443 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e56851c3-db40-406c-99a6-4eb7704a3d6c admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:52.306152 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-d007fc8a-4b3c-4ac9-a6b2-3902382c42fc req-04952a32-b3eb-446d-8232-c303c3d38e42 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] No DVR routers for this DVR port b0bd939a-1211-4ec1-b074-b2767d087f95 on host hv-cinder-81644 {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:03:52.316970 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-d007fc8a-4b3c-4ac9-a6b2-3902382c42fc req-04952a32-b3eb-446d-8232-c303c3d38e42 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:52.320881 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d007fc8a-4b3c-4ac9-a6b2-3902382c42fc req-04952a32-b3eb-446d-8232-c303c3d38e42 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.46 "DELETE /v2.0/ports/b0bd939a-1211-4ec1-b074-b2767d087f95 HTTP/1.1" status: 204 len: 173 time: 0.7155139 Dec 24 05:03:52.326593 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cccacaaf-be31-4169-8a5b-13ea806dbd2c', 'name': 'network-vif-deleted', 'tag': 'b0bd939a-1211-4ec1-b074-b2767d087f95'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:03:52.330013 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dfd4f34d-c5eb-4c31-8de4-b4f93c2935ad" -d '{"events": [{"server_uuid": "cccacaaf-be31-4169-8a5b-13ea806dbd2c", "name": "network-vif-deleted", "tag": "b0bd939a-1211-4ec1-b074-b2767d087f95"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:03:52.381740 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-e56851c3-db40-406c-99a6-4eb7704a3d6c admin admin] Deleting port 1e3aad5b-d728-4cff-9337-8dd407616d35 {{(pid=102477) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:03:52.382086 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e56851c3-db40-406c-99a6-4eb7704a3d6c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:52.387015 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-138b4816-236b-434a-9fe2-579bed7b049e req-50ec50ca-a010-4623-b0b4-e7cb351ebff2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:52.388650 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-138b4816-236b-434a-9fe2-579bed7b049e req-50ec50ca-a010-4623-b0b4-e7cb351ebff2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.1733389 Dec 24 05:03:52.407617 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:03:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-082be369-8d2f-4d4e-94f5-374964a715e6 x-openstack-request-id: req-082be369-8d2f-4d4e-94f5-374964a715e6 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:03:52.407893 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cccacaaf-be31-4169-8a5b-13ea806dbd2c", "name": "network-vif-deleted", "tag": "b0bd939a-1211-4ec1-b074-b2767d087f95", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:03:52.408140 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-082be369-8d2f-4d4e-94f5-374964a715e6 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:03:52.408576 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cccacaaf-be31-4169-8a5b-13ea806dbd2c', 'name': 'network-vif-deleted', 'tag': 'b0bd939a-1211-4ec1-b074-b2767d087f95', 'status': 'completed', 'code': 200} Dec 24 05:03:52.409383 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-06c82842-ebb7-4469-b721-0d203fa726af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0dcd2bd7-b267-461d-9321-738fb26edb1d', 'name': 'tempest-ServerRescueNegativeTestJSON-561074829-router', 'tenant_id': '1b651e55b1a349a0b9582c526d3b5d67', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.96'}], 'enable_snat': True}, 'gw_port_id': '1e3aad5b-d728-4cff-9337-8dd407616d35', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:10Z', 'updated_at': '2021-12-24T05:03:50Z', 'revision_number': 5, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'gw_port': {'id': '1e3aad5b-d728-4cff-9337-8dd407616d35', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:3e:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0dcd2bd7-b267-461d-9321-738fb26edb1d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.96', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:11Z', 'updated_at': '2021-12-24T04:59:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:03:52.446887 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06c82842-ebb7-4469-b721-0d203fa726af None None] Checking router: 0dcd2bd7-b267-461d-9321-738fb26edb1d for host: dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:03:52.459779 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06c82842-ebb7-4469-b721-0d203fa726af None None] Routers {'0dcd2bd7-b267-461d-9321-738fb26edb1d'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:03:52.460733 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-06c82842-ebb7-4469-b721-0d203fa726af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:03:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['0dcd2bd7-b267-461d-9321-738fb26edb1d'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:03:52.470747 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-138b4816-236b-434a-9fe2-579bed7b049e req-af125655-974d-4557-8b5f-9f5dbf371706 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0752299 Dec 24 05:03:52.496333 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.db [None req-e56851c3-db40-406c-99a6-4eb7704a3d6c admin admin] For port 1e3aad5b-d728-4cff-9337-8dd407616d35, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=1e3aad5b-d728-4cff-9337-8dd407616d35,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102477) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:03:52.496818 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e56851c3-db40-406c-99a6-4eb7704a3d6c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:52.511330 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-e56851c3-db40-406c-99a6-4eb7704a3d6c admin admin] Calling delete_port for 1e3aad5b-d728-4cff-9337-8dd407616d35 owned by network:router_gateway {{(pid=102477) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:03:52.559402 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-06c82842-ebb7-4469-b721-0d203fa726af None None] Set router 0dcd2bd7-b267-461d-9321-738fb26edb1d gateway port host: None {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:03:52.617109 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-06c82842-ebb7-4469-b721-0d203fa726af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0dcd2bd7-b267-461d-9321-738fb26edb1d', 'name': 'tempest-ServerRescueNegativeTestJSON-561074829-router', 'tenant_id': '1b651e55b1a349a0b9582c526d3b5d67', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:10Z', 'updated_at': '2021-12-24T05:03:52Z', 'revision_number': 6, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'gw_port_host': None}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:03:52.646951 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06c82842-ebb7-4469-b721-0d203fa726af None None] The sync data for ids ['0dcd2bd7-b267-461d-9321-738fb26edb1d'] in dv-cinder-816443-2-iscsi is: [{'id': '0dcd2bd7-b267-461d-9321-738fb26edb1d', 'name': 'tempest-ServerRescueNegativeTestJSON-561074829-router', 'tenant_id': '1b651e55b1a349a0b9582c526d3b5d67', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:10Z', 'updated_at': '2021-12-24T05:03:52Z', 'revision_number': 6, 'project_id': '1b651e55b1a349a0b9582c526d3b5d67', 'gw_port_host': None}] {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:03:52.720998 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e56851c3-db40-406c-99a6-4eb7704a3d6c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:52.748347 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e56851c3-db40-406c-99a6-4eb7704a3d6c admin admin] Pushing event deleted for resources: {'Port': ['ID=1e3aad5b-d728-4cff-9337-8dd407616d35,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:03:52.811416 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e56851c3-db40-406c-99a6-4eb7704a3d6c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-545986'] for router_gateway, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:52.917450 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e56851c3-db40-406c-99a6-4eb7704a3d6c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-546088', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2070312'] for router, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:52.919789 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e56851c3-db40-406c-99a6-4eb7704a3d6c admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:52.989629 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e56851c3-db40-406c-99a6-4eb7704a3d6c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-546081'] for router, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:52.989882 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e56851c3-db40-406c-99a6-4eb7704a3d6c admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0dcd2bd7-b267-461d-9321-738fb26edb1d {{(pid=102477) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 24 05:03:52.995707 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e56851c3-db40-406c-99a6-4eb7704a3d6c admin admin] Publish callbacks [] for router, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:52.996985 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-e56851c3-db40-406c-99a6-4eb7704a3d6c admin admin] 10.222.0.43 "DELETE /v2.0/routers/0dcd2bd7-b267-461d-9321-738fb26edb1d HTTP/1.1" status: 204 len: 168 time: 0.9808202 Dec 24 05:03:52.999580 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 58632) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:03:53.057093 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-dd34e345-ac90-4535-9524-cf633e0f19f8 req-2d846e80-8dfb-4d9c-aa39-4c338c999e0f tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=cccacaaf-be31-4169-8a5b-13ea806dbd2c HTTP/1.1" status: 200 len: 210 time: 0.0317986 Dec 24 05:03:53.068936 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_v2 [None req-c87ee93e-684b-4492-9e92-e6b59fa3bb30 admin admin] Deleting subnet 88f274d6-bcf0-47e8-9f0a-783a53214be4 {{(pid=102476) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Dec 24 05:03:53.073729 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c87ee93e-684b-4492-9e92-e6b59fa3bb30 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:53.117915 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c87ee93e-684b-4492-9e92-e6b59fa3bb30 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-32509714'] for subnet, precommit_delete_associations {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:53.158874 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c87ee93e-684b-4492-9e92-e6b59fa3bb30 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3590439'] for subnet, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:53.194825 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-cc163794-4dec-4788-9d26-2f57ee09a2eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:53.212163 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c87ee93e-684b-4492-9e92-e6b59fa3bb30 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3590440', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-32528482', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-32970397'] for subnet, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:53.236276 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c87ee93e-684b-4492-9e92-e6b59fa3bb30 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=88f274d6-bcf0-47e8-9f0a-783a53214be4,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:03:53.242196 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c87ee93e-684b-4492-9e92-e6b59fa3bb30 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:53.245710 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-c87ee93e-684b-4492-9e92-e6b59fa3bb30 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/88f274d6-bcf0-47e8-9f0a-783a53214be4 HTTP/1.1" status: 204 len: 168 time: 0.2448463 Dec 24 05:03:53.248178 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 58636) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:03:53.329773 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-53cd8186-b9f2-4b8f-9dc5-3ae5fda47993 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3741433'] for network, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:53.410755 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-53cd8186-b9f2-4b8f-9dc5-3ae5fda47993 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3595960', 'neutron.services.segments.db._delete_segments_for_network-8750577966942'] for network, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:53.433452 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-53cd8186-b9f2-4b8f-9dc5-3ae5fda47993 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0d368baa-5733-40a7-b836-139a541f4ebb']}} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:03:53.447082 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-53cd8186-b9f2-4b8f-9dc5-3ae5fda47993 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd94b0a1e-2098-4b10-9091-c566351ffe74') {'for_net_delete': True} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:03:53.447559 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-53cd8186-b9f2-4b8f-9dc5-3ae5fda47993 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd94b0a1e-2098-4b10-9091-c566351ffe74') {} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:03:53.463032 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-53cd8186-b9f2-4b8f-9dc5-3ae5fda47993 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750577970535', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-32509733'] for segment, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:53.478650 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-53cd8186-b9f2-4b8f-9dc5-3ae5fda47993 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:53.486306 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-53cd8186-b9f2-4b8f-9dc5-3ae5fda47993 admin admin] Releasing vlan 133 on physical network physnet1 to pool {{(pid=102476) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 24 05:03:53.486745 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-53cd8186-b9f2-4b8f-9dc5-3ae5fda47993 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-32528320'] for segment, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:53.490929 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: Traceback (most recent call last): Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: timer() Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: cb(*args, **kw) Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: return func(*args, **kwargs) Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: self._notify() Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: self.callback(batched_events) Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: event.method(event) Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: aggregate_uuid = self.p_client.list_aggregates( Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: return f(self, *a, **k) Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: return self._get(url).json() Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: return self.request(url, 'GET', **kwargs) Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: base_url = self.get_endpoint(auth, allow=allow, Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 24 05:03:53.493184 dv-cinder-816443-2-iscsi neutron-server[102476]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 24 05:03:53.538933 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device e2f138ca-5e6c-4ae5-883d-02357c2bbbd2 no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:03:53.555702 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-53cd8186-b9f2-4b8f-9dc5-3ae5fda47993 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3595937', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-546046'] for network, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:53.560391 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-53cd8186-b9f2-4b8f-9dc5-3ae5fda47993 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:53.561173 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: e2f138ca-5e6c-4ae5-883d-02357c2bbbd2 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:03:53.561585 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device e2f138ca-5e6c-4ae5-883d-02357c2bbbd2 not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:03:53.562062 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 1e3aad5b-d728-4cff-9337-8dd407616d35 no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:03:53.563653 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-53cd8186-b9f2-4b8f-9dc5-3ae5fda47993 admin admin] 10.222.0.43 "DELETE /v2.0/networks/0d368baa-5733-40a7-b836-139a541f4ebb HTTP/1.1" status: 204 len: 168 time: 0.3145356 Dec 24 05:03:53.582805 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: 1e3aad5b-d728-4cff-9337-8dd407616d35 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:03:53.583065 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 1e3aad5b-d728-4cff-9337-8dd407616d35 not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:03:53.593522 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53cd8186-b9f2-4b8f-9dc5-3ae5fda47993 admin admin] Pushing event deleted for resources: {'Network': ['ID=0d368baa-5733-40a7-b836-139a541f4ebb,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:03:53.633943 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-059e7ebf-4157-4b9a-a1b0-3cd690f9278f req-e8eca41f-d239-4c3a-a7ab-57e57332f2a7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:53.635526 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-059e7ebf-4157-4b9a-a1b0-3cd690f9278f req-e8eca41f-d239-4c3a-a7ab-57e57332f2a7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0707629 Dec 24 05:03:53.689704 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-059e7ebf-4157-4b9a-a1b0-3cd690f9278f req-274ffad8-bafd-4c62-886e-1ccf7a56ef84 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424149 Dec 24 05:03:53.746825 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 58642) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:03:53.792040 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-2a298a3a-fca5-49da-bde1-8fe27def0cd8 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=1b651e55b1a349a0b9582c526d3b5d67&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0440335 Dec 24 05:03:53.794848 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 58644) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:03:53.853044 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-5c9aa6ad-3bd7-4584-be44-b9a1834b8c75 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:53.873784 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-5c9aa6ad-3bd7-4584-be44-b9a1834b8c75 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:53.928858 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-5c9aa6ad-3bd7-4584-be44-b9a1834b8c75 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:53.931434 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-5c9aa6ad-3bd7-4584-be44-b9a1834b8c75 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:53.932923 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-5c9aa6ad-3bd7-4584-be44-b9a1834b8c75 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/fb15db0c-18b7-4431-8838-f84f360e82f2 HTTP/1.1" status: 204 len: 168 time: 0.1370494 Dec 24 05:03:53.940583 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c9aa6ad-3bd7-4584-be44-b9a1834b8c75 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fb15db0c-18b7-4431-8838-f84f360e82f2,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:03:54.428268 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d52bd5-91e4-46e1-b254-bc416b89f0e3 req-2f01f325-5b6a-47d9-8572-7550a05bfbf9 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:54.429873 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d5d52bd5-91e4-46e1-b254-bc416b89f0e3 req-2f01f325-5b6a-47d9-8572-7550a05bfbf9 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=e0d6209d-3f4e-4467-bcd3-543f26133bbd HTTP/1.1" status: 200 len: 945 time: 0.0528514 Dec 24 05:03:54.481194 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d5d52bd5-91e4-46e1-b254-bc416b89f0e3 req-6dde58e4-c607-4e2a-b080-7ce42e428a6c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435338 Dec 24 05:03:54.742605 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 61ec3441-5b75-4c07-b8ad-4174450d6a55 details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 05:03:54.754411 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device b0bd939a-1211-4ec1-b074-b2767d087f95 no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:03:54.779370 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] No Port match for: b0bd939a-1211-4ec1-b074-b2767d087f95 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:03:54.779719 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device b0bd939a-1211-4ec1-b074-b2767d087f95 not bound to the agent host hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:03:54.824214 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a1d848a-3ba7-4b4d-9c73-4913427a5a4c req-cd066481-fd5e-4444-8f46-7a9c4088ce25 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:54.825499 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4a1d848a-3ba7-4b4d-9c73-4913427a5a4c req-cd066481-fd5e-4444-8f46-7a9c4088ce25 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0504014 Dec 24 05:03:54.870170 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 61ec3441-5b75-4c07-b8ad-4174450d6a55, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=61ec3441-5b75-4c07-b8ad-4174450d6a55,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:03:54.875217 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4a1d848a-3ba7-4b4d-9c73-4913427a5a4c req-389c0246-2755-4efa-8309-d3770c4bc8eb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433521 Dec 24 05:03:54.881900 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': '61ec3441-5b75-4c07-b8ad-4174450d6a55', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'port_id': '61ec3441-5b75-4c07-b8ad-4174450d6a55', 'mac_address': 'fa:16:3e:41:aa:aa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 05:03:54.924911 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:54.938295 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 61ec3441-5b75-4c07-b8ad-4174450d6a55 {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:03:54.957416 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 61ec3441-5b75-4c07-b8ad-4174450d6a55, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=61ec3441-5b75-4c07-b8ad-4174450d6a55,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:03:54.962605 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:55.009238 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=61ec3441-5b75-4c07-b8ad-4174450d6a55,revision_number=6']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:03:55.016645 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:55.017034 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:55.017500 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:55.017843 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:55.018342 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:55.018818 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:55.019301 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:55.019766 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:55.020247 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:55.020625 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:55.020981 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:55.021298 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:55.021624 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:03:55.152555 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['61ec3441-5b75-4c07-b8ad-4174450d6a55'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:03:55.269396 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b51967e3-f3af-4905-bdee-9be4c1da0fe7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:55.488400 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2736ffd0-f8bf-4cde-842b-2793c703b3f3 req-24aff0fc-f7be-45ae-899f-d7f5a5830822 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:55.490047 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2736ffd0-f8bf-4cde-842b-2793c703b3f3 req-24aff0fc-f7be-45ae-899f-d7f5a5830822 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 946 time: 0.0511811 Dec 24 05:03:55.553124 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2736ffd0-f8bf-4cde-842b-2793c703b3f3 req-d6f32023-41e8-4f6a-bce0-0760d9ee2d8d tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0560231 Dec 24 05:03:55.607801 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c6394c9-6968-4652-8b56-bc2b742cf69b req-1f4b0334-4c72-4da4-9e3e-85beedec17d3 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:55.609426 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0c6394c9-6968-4652-8b56-bc2b742cf69b req-1f4b0334-4c72-4da4-9e3e-85beedec17d3 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=e0d6209d-3f4e-4467-bcd3-543f26133bbd HTTP/1.1" status: 200 len: 945 time: 0.0509956 Dec 24 05:03:55.665215 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0c6394c9-6968-4652-8b56-bc2b742cf69b req-1bffe054-67c5-4213-8560-cbd48ad0bd69 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426888 Dec 24 05:03:56.005861 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67a0f85f-faed-465c-9dd8-a0030edd9c5b req-7cf0fc87-a54c-4a9a-a2d4-eca977b03c24 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:56.007405 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-67a0f85f-faed-465c-9dd8-a0030edd9c5b req-7cf0fc87-a54c-4a9a-a2d4-eca977b03c24 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 944 time: 0.0552363 Dec 24 05:03:56.054772 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-67a0f85f-faed-465c-9dd8-a0030edd9c5b req-1b13603a-3c99-4a84-a0b8-31547584ab2c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411162 Dec 24 05:03:56.473950 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:56.672679 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fc4fe0e-177e-4eb4-9c14-0e47e59d8e73 req-bfbb380f-790d-4209-b7dc-54d711b2af0b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:56.674231 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5fc4fe0e-177e-4eb4-9c14-0e47e59d8e73 req-bfbb380f-790d-4209-b7dc-54d711b2af0b tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 946 time: 0.0534840 Dec 24 05:03:56.729347 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5fc4fe0e-177e-4eb4-9c14-0e47e59d8e73 req-133dedd3-b9e1-47dd-8240-2f95a4a4a86a tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0490153 Dec 24 05:03:56.757070 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 61ec3441-5b75-4c07-b8ad-4174450d6a55 up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:03:56.793786 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e3565c0-80d1-4064-8137-bd451dcb2fbe req-3ec4d8eb-9066-4623-9544-59bb5a2fa42a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:56.795280 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6e3565c0-80d1-4064-8137-bd451dcb2fbe req-3ec4d8eb-9066-4623-9544-59bb5a2fa42a tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=e0d6209d-3f4e-4467-bcd3-543f26133bbd HTTP/1.1" status: 200 len: 945 time: 0.0519106 Dec 24 05:03:56.803839 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port 61ec3441-5b75-4c07-b8ad-4174450d6a55 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:03:56.804199 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:56.843212 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6e3565c0-80d1-4064-8137-bd451dcb2fbe req-f6a8c3a8-ea7b-43c0-967d-9885d22844d9 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413063 Dec 24 05:03:56.885960 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:56.909597 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6485c286-d5e3-42e7-bf58-c4685f8c3066', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '61ec3441-5b75-4c07-b8ad-4174450d6a55'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:03:56.911830 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-62456a1a-d5ab-45e3-9e8a-c68b067a437a" -d '{"events": [{"server_uuid": "6485c286-d5e3-42e7-bf58-c4685f8c3066", "name": "network-vif-plugged", "status": "completed", "tag": "61ec3441-5b75-4c07-b8ad-4174450d6a55"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:03:56.924307 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 61ec3441-5b75-4c07-b8ad-4174450d6a55, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=61ec3441-5b75-4c07-b8ad-4174450d6a55,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:03:56.931332 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:56.961656 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:03:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-293fbc55-e061-4e86-b033-4573c3a86aac x-openstack-request-id: req-293fbc55-e061-4e86-b033-4573c3a86aac {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:03:56.961970 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6485c286-d5e3-42e7-bf58-c4685f8c3066", "name": "network-vif-plugged", "status": "completed", "tag": "61ec3441-5b75-4c07-b8ad-4174450d6a55", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:03:56.962218 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-293fbc55-e061-4e86-b033-4573c3a86aac {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:03:56.962601 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6485c286-d5e3-42e7-bf58-c4685f8c3066', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '61ec3441-5b75-4c07-b8ad-4174450d6a55', 'code': 200} Dec 24 05:03:56.988265 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=61ec3441-5b75-4c07-b8ad-4174450d6a55,revision_number=7']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:03:57.197749 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e329549-2024-41a3-aaf2-549df8ae42d0 req-60fa3a5b-b5c6-4984-8279-6eae6211a1a7 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:57.199183 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0e329549-2024-41a3-aaf2-549df8ae42d0 req-60fa3a5b-b5c6-4984-8279-6eae6211a1a7 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.46 "GET /v2.0/ports?device_id=e0d6209d-3f4e-4467-bcd3-543f26133bbd HTTP/1.1" status: 200 len: 945 time: 0.0747459 Dec 24 05:03:57.211100 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f30cf3fb-458b-4240-b7fd-7979a742d19a req-c0dc8693-a7e5-40e0-8727-331cb80852dd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:57.212448 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f30cf3fb-458b-4240-b7fd-7979a742d19a req-c0dc8693-a7e5-40e0-8727-331cb80852dd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0632796 Dec 24 05:03:57.310934 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f30cf3fb-458b-4240-b7fd-7979a742d19a req-f2c77d52-6cd9-4d32-bbcb-5b0333e489dc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0916252 Dec 24 05:03:57.332427 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-0e329549-2024-41a3-aaf2-549df8ae42d0 req-97270b4a-9ae7-42fc-827b-b90fc5807878 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Deleting port f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:03:57.332792 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-0e329549-2024-41a3-aaf2-549df8ae42d0 req-97270b4a-9ae7-42fc-827b-b90fc5807878 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:57.421925 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-0e329549-2024-41a3-aaf2-549df8ae42d0 req-97270b4a-9ae7-42fc-827b-b90fc5807878 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] For port f6cc3671-adcd-49a0-acb1-9e19b75fc8c9, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=f6cc3671-adcd-49a0-acb1-9e19b75fc8c9,segment=NetworkSegment(45cba16b-d4c1-40eb-8945-69769d27d2b7),segment_id=45cba16b-d4c1-40eb-8945-69769d27d2b7)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:03:57.422181 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-0e329549-2024-41a3-aaf2-549df8ae42d0 req-97270b4a-9ae7-42fc-827b-b90fc5807878 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:57.438080 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-0e329549-2024-41a3-aaf2-549df8ae42d0 req-97270b4a-9ae7-42fc-827b-b90fc5807878 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling delete_port for f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 owned by compute:nova {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:03:57.568672 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-0e329549-2024-41a3-aaf2-549df8ae42d0 req-97270b4a-9ae7-42fc-827b-b90fc5807878 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:57.599261 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97270b4a-9ae7-42fc-827b-b90fc5807878 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Pushing event deleted for resources: {'Port': ['ID=f6cc3671-adcd-49a0-acb1-9e19b75fc8c9,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:03:57.620659 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['f6cc3671-adcd-49a0-acb1-9e19b75fc8c9'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:03:57.642020 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-0e329549-2024-41a3-aaf2-549df8ae42d0 req-97270b4a-9ae7-42fc-827b-b90fc5807878 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] No DVR routers for this DVR port f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 on host hv-cinder-81644 {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:03:57.644435 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-0e329549-2024-41a3-aaf2-549df8ae42d0 req-97270b4a-9ae7-42fc-827b-b90fc5807878 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:57.647782 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0e329549-2024-41a3-aaf2-549df8ae42d0 req-97270b4a-9ae7-42fc-827b-b90fc5807878 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.46 "DELETE /v2.0/ports/f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 HTTP/1.1" status: 204 len: 173 time: 0.4343228 Dec 24 05:03:57.648238 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e0d6209d-3f4e-4467-bcd3-543f26133bbd', 'name': 'network-vif-deleted', 'tag': 'f6cc3671-adcd-49a0-acb1-9e19b75fc8c9'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:03:57.650573 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e629391c-5bca-4bcc-a696-df2b3aebe056" -d '{"events": [{"server_uuid": "e0d6209d-3f4e-4467-bcd3-543f26133bbd", "name": "network-vif-deleted", "tag": "f6cc3671-adcd-49a0-acb1-9e19b75fc8c9"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:03:57.687416 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:03:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8f909d8f-1179-45db-8123-6d2221693eab x-openstack-request-id: req-8f909d8f-1179-45db-8123-6d2221693eab {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:03:57.687712 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e0d6209d-3f4e-4467-bcd3-543f26133bbd", "name": "network-vif-deleted", "tag": "f6cc3671-adcd-49a0-acb1-9e19b75fc8c9", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:03:57.687967 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-8f909d8f-1179-45db-8123-6d2221693eab {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:03:57.688367 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e0d6209d-3f4e-4467-bcd3-543f26133bbd', 'name': 'network-vif-deleted', 'tag': 'f6cc3671-adcd-49a0-acb1-9e19b75fc8c9', 'status': 'completed', 'code': 200} Dec 24 05:03:57.845983 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50f788c7-a068-4556-8a58-8a0c6da563d1 req-621cf896-542b-48d6-a976-ff37e9e8c7df tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:57.847752 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-50f788c7-a068-4556-8a58-8a0c6da563d1 req-621cf896-542b-48d6-a976-ff37e9e8c7df tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 946 time: 0.0507278 Dec 24 05:03:57.915545 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:57.925138 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-50f788c7-a068-4556-8a58-8a0c6da563d1 req-20a027bd-a9b2-4c50-ae8d-463490a87bdc tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/security-groups?id=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0710790 Dec 24 05:03:57.972405 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6e23c233-cd46-4e36-9cee-6a8142d496be req-dad05ac8-93b5-4c5c-a5f0-62fa7bc6567c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=e0d6209d-3f4e-4467-bcd3-543f26133bbd HTTP/1.1" status: 200 len: 210 time: 0.0331719 Dec 24 05:03:58.441137 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94cf1dbc-9c82-4581-b491-620898f2dcfb req-d929dfe7-d7c3-41b7-8ee9-c8d9c14b8d94 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:58.442497 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-94cf1dbc-9c82-4581-b491-620898f2dcfb req-d929dfe7-d7c3-41b7-8ee9-c8d9c14b8d94 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0565195 Dec 24 05:03:58.494629 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-94cf1dbc-9c82-4581-b491-620898f2dcfb req-02cc8afe-2600-4414-9558-8dfa36b2f45f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442822 Dec 24 05:03:58.547856 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b934c425-5922-4f6e-b8c0-aa9c128af03c req-ea0fa537-dbb9-482f-9196-8af49c1b7f35 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:58.549393 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b934c425-5922-4f6e-b8c0-aa9c128af03c req-ea0fa537-dbb9-482f-9196-8af49c1b7f35 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.46 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 946 time: 0.0491762 Dec 24 05:03:58.580873 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:58.656449 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-b934c425-5922-4f6e-b8c0-aa9c128af03c req-3604f8b4-0c76-4a56-b1f8-dc40983fbac2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Deleting port 50d50f46-e761-4fb1-9761-fa48778aa8aa {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:03:58.656928 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-b934c425-5922-4f6e-b8c0-aa9c128af03c req-3604f8b4-0c76-4a56-b1f8-dc40983fbac2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:58.756433 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-b934c425-5922-4f6e-b8c0-aa9c128af03c req-3604f8b4-0c76-4a56-b1f8-dc40983fbac2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] For port 50d50f46-e761-4fb1-9761-fa48778aa8aa, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=50d50f46-e761-4fb1-9761-fa48778aa8aa,segment=NetworkSegment(10307c97-e214-473b-b760-bb1b770153ec),segment_id=10307c97-e214-473b-b760-bb1b770153ec)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:03:58.756728 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-b934c425-5922-4f6e-b8c0-aa9c128af03c req-3604f8b4-0c76-4a56-b1f8-dc40983fbac2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:58.769507 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-b934c425-5922-4f6e-b8c0-aa9c128af03c req-3604f8b4-0c76-4a56-b1f8-dc40983fbac2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Calling delete_port for 50d50f46-e761-4fb1-9761-fa48778aa8aa owned by compute:nova {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:03:58.901638 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-b934c425-5922-4f6e-b8c0-aa9c128af03c req-3604f8b4-0c76-4a56-b1f8-dc40983fbac2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:58.929507 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3604f8b4-0c76-4a56-b1f8-dc40983fbac2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Pushing event deleted for resources: {'Port': ['ID=50d50f46-e761-4fb1-9761-fa48778aa8aa,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:03:58.937534 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['50d50f46-e761-4fb1-9761-fa48778aa8aa'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:03:58.969509 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-b934c425-5922-4f6e-b8c0-aa9c128af03c req-3604f8b4-0c76-4a56-b1f8-dc40983fbac2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] No DVR routers for this DVR port 50d50f46-e761-4fb1-9761-fa48778aa8aa on host hv-cinder-81644 {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:03:58.973354 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-b934c425-5922-4f6e-b8c0-aa9c128af03c req-3604f8b4-0c76-4a56-b1f8-dc40983fbac2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:03:58.976769 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b934c425-5922-4f6e-b8c0-aa9c128af03c req-3604f8b4-0c76-4a56-b1f8-dc40983fbac2 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.46 "DELETE /v2.0/ports/50d50f46-e761-4fb1-9761-fa48778aa8aa HTTP/1.1" status: 204 len: 173 time: 0.4094820 Dec 24 05:03:59.041211 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-88d88514-a5ce-4771-9bf1-8db02d392b92 req-36d86b7c-941f-4127-a9c0-b0500ed0be55 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 210 time: 0.0288467 Dec 24 05:03:59.622625 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a203c404-c245-4df0-8347-2f84b8b02ccd req-73f59ccf-f437-435f-a76c-629c1126fcab tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:03:59.624000 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a203c404-c245-4df0-8347-2f84b8b02ccd req-73f59ccf-f437-435f-a76c-629c1126fcab tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0572140 Dec 24 05:03:59.672685 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a203c404-c245-4df0-8347-2f84b8b02ccd req-719509a9-d3e3-4161-9e37-ac4331cdecbd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425744 Dec 24 05:03:59.689297 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7c07c04e-36eb-4aa0-8a33-1c1424a2db2e', 'name': 'network-vif-deleted', 'tag': '50d50f46-e761-4fb1-9761-fa48778aa8aa'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:03:59.691582 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-edbe40ff-3a05-4a18-8985-a53813c46f72" -d '{"events": [{"server_uuid": "7c07c04e-36eb-4aa0-8a33-1c1424a2db2e", "name": "network-vif-deleted", "tag": "50d50f46-e761-4fb1-9761-fa48778aa8aa"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:03:59.726515 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:03:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f589fee6-3e4e-4e75-899b-c96a18e2eae0 x-openstack-request-id: req-f589fee6-3e4e-4e75-899b-c96a18e2eae0 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:03:59.726837 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7c07c04e-36eb-4aa0-8a33-1c1424a2db2e", "name": "network-vif-deleted", "tag": "50d50f46-e761-4fb1-9761-fa48778aa8aa", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:03:59.727090 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-f589fee6-3e4e-4e75-899b-c96a18e2eae0 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:03:59.727483 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7c07c04e-36eb-4aa0-8a33-1c1424a2db2e', 'name': 'network-vif-deleted', 'tag': '50d50f46-e761-4fb1-9761-fa48778aa8aa', 'status': 'completed', 'code': 200} Dec 24 05:04:00.151785 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e1fc7a5b-7bf6-49bb-8cbc-92a0116c4a44 req-074e417c-f082-41c2-9a8f-06bafbf057bf tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 210 time: 0.0311356 Dec 24 05:04:00.823659 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1403893-98ce-4d56-a054-d2cfc8ec2a87 req-7786fe51-b1eb-4fa6-8683-3387ffefd056 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:00.825126 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f1403893-98ce-4d56-a054-d2cfc8ec2a87 req-7786fe51-b1eb-4fa6-8683-3387ffefd056 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0557554 Dec 24 05:04:00.878257 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f1403893-98ce-4d56-a054-d2cfc8ec2a87 req-05c7e9dd-65f6-4412-8ccb-5e5e2f4ea184 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429475 Dec 24 05:04:01.261311 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-17a95ebc-cebf-4859-a552-010885d1d9ac req-4706e3c3-7ec7-4bd4-b625-e49e06b631c0 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 210 time: 0.0257022 Dec 24 05:04:02.023166 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e905340b-bf83-4c98-8b7c-4a152e99ecfc req-b9e664ab-a690-483a-b545-2abd4140fc7e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:02.024657 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e905340b-bf83-4c98-8b7c-4a152e99ecfc req-b9e664ab-a690-483a-b545-2abd4140fc7e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0609593 Dec 24 05:04:02.071159 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e905340b-bf83-4c98-8b7c-4a152e99ecfc req-6f13f569-c517-4e3c-9fa6-78ac6a42bd11 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402954 Dec 24 05:04:02.363978 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-804498f5-d619-462c-ac3f-dabd72a81f26 req-6984080c-d6b9-49a5-ab8a-8c3951540c42 tempest-AttachVolumeNegativeTest-42001764 tempest-AttachVolumeNegativeTest-42001764-project] 10.222.0.43 "GET /v2.0/ports?device_id=7c07c04e-36eb-4aa0-8a33-1c1424a2db2e HTTP/1.1" status: 200 len: 210 time: 0.0250876 Dec 24 05:04:02.970148 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:04:02.994092 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] No Port match for: f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:04:02.994675 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device f6cc3671-adcd-49a0-acb1-9e19b75fc8c9 not bound to the agent host hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:04:03.199386 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c64eb91-de21-43a6-8d21-7197738c8059 req-b239e3ac-b365-4720-93a3-b4b2d581013f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:03.201025 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1c64eb91-de21-43a6-8d21-7197738c8059 req-b239e3ac-b365-4720-93a3-b4b2d581013f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0508835 Dec 24 05:04:03.252020 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1c64eb91-de21-43a6-8d21-7197738c8059 req-e949114e-a539-4cc4-9245-4dbba3b2fb07 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451214 Dec 24 05:04:03.421752 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 58808) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:03.468660 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.db_base_plugin_v2 [None req-bfbce0ca-c5f6-4b6d-9187-01e0c3a2ef77 admin admin] Deleting subnet 9b9ff65f-93c8-4cb1-8a99-961ba0d4beaa {{(pid=102477) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Dec 24 05:04:03.473600 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-bfbce0ca-c5f6-4b6d-9187-01e0c3a2ef77 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:03.516833 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-bfbce0ca-c5f6-4b6d-9187-01e0c3a2ef77 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-29535554'] for subnet, precommit_delete_associations {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:03.553396 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-bfbce0ca-c5f6-4b6d-9187-01e0c3a2ef77 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3590439'] for subnet, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:03.615419 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-bfbce0ca-c5f6-4b6d-9187-01e0c3a2ef77 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3590440', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-29535541', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-29853072'] for subnet, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:03.632996 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 50d50f46-e761-4fb1-9761-fa48778aa8aa no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:04:03.639154 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfbce0ca-c5f6-4b6d-9187-01e0c3a2ef77 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9b9ff65f-93c8-4cb1-8a99-961ba0d4beaa,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:03.644944 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-bfbce0ca-c5f6-4b6d-9187-01e0c3a2ef77 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:03.648311 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-bfbce0ca-c5f6-4b6d-9187-01e0c3a2ef77 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/9b9ff65f-93c8-4cb1-8a99-961ba0d4beaa HTTP/1.1" status: 204 len: 168 time: 0.2255626 Dec 24 05:04:03.651572 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 58810) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:03.657251 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] No Port match for: 50d50f46-e761-4fb1-9761-fa48778aa8aa {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:04:03.657601 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 50d50f46-e761-4fb1-9761-fa48778aa8aa not bound to the agent host hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:04:03.721442 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f88e68ce-31dd-472e-9c32-625e96093693 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3741433'] for network, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:03.795208 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f88e68ce-31dd-472e-9c32-625e96093693 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3595960', 'neutron.services.segments.db._delete_segments_for_network-8750577966942'] for network, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:03.815865 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.services.segments.db [None req-f88e68ce-31dd-472e-9c32-625e96093693 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b92a87f3-957a-4ccb-9b5b-98ad92aebe6e']}} {{(pid=102477) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:04:03.825226 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.services.segments.db [None req-f88e68ce-31dd-472e-9c32-625e96093693 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '10307c97-e214-473b-b760-bb1b770153ec') {'for_net_delete': True} {{(pid=102477) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:04:03.825513 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.services.segments.db [None req-f88e68ce-31dd-472e-9c32-625e96093693 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '10307c97-e214-473b-b760-bb1b770153ec') {} {{(pid=102477) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:04:03.834524 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f88e68ce-31dd-472e-9c32-625e96093693 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750577970535', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-29535605'] for segment, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:03.847718 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f88e68ce-31dd-472e-9c32-625e96093693 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:03.853905 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f88e68ce-31dd-472e-9c32-625e96093693 admin admin] Releasing vlan 125 on physical network physnet1 to pool {{(pid=102477) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 24 05:04:03.854280 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f88e68ce-31dd-472e-9c32-625e96093693 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29532823'] for segment, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: Traceback (most recent call last): Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: timer() Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: cb(*args, **kw) Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: return func(*args, **kwargs) Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: self._notify() Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: self.callback(batched_events) Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: event.method(event) Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: aggregate_uuid = self.p_client.list_aggregates( Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: return f(self, *a, **k) Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: return self._get(url).json() Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: return self.request(url, 'GET', **kwargs) Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: base_url = self.get_endpoint(auth, allow=allow, Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 24 05:04:03.855849 dv-cinder-816443-2-iscsi neutron-server[102477]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 24 05:04:03.917139 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f88e68ce-31dd-472e-9c32-625e96093693 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3595937', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-546046'] for network, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:03.922433 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f88e68ce-31dd-472e-9c32-625e96093693 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:03.925532 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-f88e68ce-31dd-472e-9c32-625e96093693 admin admin] 10.222.0.43 "DELETE /v2.0/networks/b92a87f3-957a-4ccb-9b5b-98ad92aebe6e HTTP/1.1" status: 204 len: 168 time: 0.2730908 Dec 24 05:04:03.937509 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f88e68ce-31dd-472e-9c32-625e96093693 admin admin] Pushing event deleted for resources: {'Network': ['ID=b92a87f3-957a-4ccb-9b5b-98ad92aebe6e,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:04.101937 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 58814) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:04.142683 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-c6f8b8ec-3b0a-416f-af18-1357ee81d028 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=8f1c3a94f02049e3a76c4fc01fa7a022&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0395546 Dec 24 05:04:04.145040 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 58820) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:04.191881 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a182650b-33c4-4a77-80fd-8e66a388d99a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:04.218652 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a182650b-33c4-4a77-80fd-8e66a388d99a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:04.264792 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a182650b-33c4-4a77-80fd-8e66a388d99a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:04.267502 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a182650b-33c4-4a77-80fd-8e66a388d99a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:04.271044 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-a182650b-33c4-4a77-80fd-8e66a388d99a admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e HTTP/1.1" status: 204 len: 168 time: 0.1227288 Dec 24 05:04:04.277044 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a182650b-33c4-4a77-80fd-8e66a388d99a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7c2ffc24-a2f4-4a81-8c6c-bf0be9c26d3e,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:04.293604 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a182650b-33c4-4a77-80fd-8e66a388d99a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:04.293959 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a182650b-33c4-4a77-80fd-8e66a388d99a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:04.294300 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a182650b-33c4-4a77-80fd-8e66a388d99a admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:04.294637 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a182650b-33c4-4a77-80fd-8e66a388d99a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:04.294966 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a182650b-33c4-4a77-80fd-8e66a388d99a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:04.295293 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a182650b-33c4-4a77-80fd-8e66a388d99a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:04.295617 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a182650b-33c4-4a77-80fd-8e66a388d99a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:04.295944 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a182650b-33c4-4a77-80fd-8e66a388d99a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:04.296268 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a182650b-33c4-4a77-80fd-8e66a388d99a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:04.300743 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a182650b-33c4-4a77-80fd-8e66a388d99a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:04.301373 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a182650b-33c4-4a77-80fd-8e66a388d99a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:04.301891 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a182650b-33c4-4a77-80fd-8e66a388d99a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:04.302324 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a182650b-33c4-4a77-80fd-8e66a388d99a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:04.398199 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16405f3d-b0ba-436b-a173-19f2d880ba1d req-d5719b74-bdd0-43f7-9028-0b9792bc8771 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:04.399883 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-16405f3d-b0ba-436b-a173-19f2d880ba1d req-d5719b74-bdd0-43f7-9028-0b9792bc8771 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0569084 Dec 24 05:04:04.452620 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-16405f3d-b0ba-436b-a173-19f2d880ba1d req-49e2831e-0877-40ef-9d66-850dff643653 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454264 Dec 24 05:04:05.577327 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75861cc0-48ff-4fea-801b-c5ac337725b7 req-19c7cd30-6a67-4722-8559-92de1ff35b3a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:05.578890 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-75861cc0-48ff-4fea-801b-c5ac337725b7 req-19c7cd30-6a67-4722-8559-92de1ff35b3a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0552814 Dec 24 05:04:05.630120 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-75861cc0-48ff-4fea-801b-c5ac337725b7 req-c03b293e-cba2-45ad-98fc-78db63832f42 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447671 Dec 24 05:04:06.758790 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c606c50-c4d2-4d85-ada2-10a5785e3e12 req-dd9d94ca-e5ca-4e0d-8637-130ae0484260 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:06.760592 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6c606c50-c4d2-4d85-ada2-10a5785e3e12 req-dd9d94ca-e5ca-4e0d-8637-130ae0484260 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0553675 Dec 24 05:04:06.812560 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6c606c50-c4d2-4d85-ada2-10a5785e3e12 req-1dbf5476-38a1-4849-a9ac-52134ddbc9c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431054 Dec 24 05:04:07.939667 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c3a504d-b963-46ff-8383-04885c31b007 req-c0560afa-74c2-4fc9-813e-090b30c7a774 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:07.941169 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7c3a504d-b963-46ff-8383-04885c31b007 req-c0560afa-74c2-4fc9-813e-090b30c7a774 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0509410 Dec 24 05:04:07.969131 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 58912) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:07.990291 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7c3a504d-b963-46ff-8383-04885c31b007 req-8b674290-b183-4bec-af70-35684f95527f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426943 Dec 24 05:04:08.079921 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-874589b3-ea0e-468f-b5b7-1662d96f4fd6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:08.167228 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-874589b3-ea0e-468f-b5b7-1662d96f4fd6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:08.173089 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-874589b3-ea0e-468f-b5b7-1662d96f4fd6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:08.213081 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-874589b3-ea0e-468f-b5b7-1662d96f4fd6 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=37f575a6561f4239a86d28a9f2f61ec9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2424641 Dec 24 05:04:08.215021 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-874589b3-ea0e-468f-b5b7-1662d96f4fd6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ec1f80a6-42c1-4051-a81c-f27efc57129c,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:08.217521 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 58916) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:08.280417 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-8909d297-a525-4032-9513-997a86107458 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:08.302399 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-8909d297-a525-4032-9513-997a86107458 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:08.351816 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-8909d297-a525-4032-9513-997a86107458 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:08.354826 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-8909d297-a525-4032-9513-997a86107458 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:08.355992 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-8909d297-a525-4032-9513-997a86107458 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/ec1f80a6-42c1-4051-a81c-f27efc57129c HTTP/1.1" status: 204 len: 168 time: 0.1391752 Dec 24 05:04:08.363554 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8909d297-a525-4032-9513-997a86107458 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ec1f80a6-42c1-4051-a81c-f27efc57129c,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:08.627057 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 58938) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:08.640327 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c093d9ad-a8b4-4ed6-852d-2a1f6634880a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:08.715278 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c093d9ad-a8b4-4ed6-852d-2a1f6634880a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:08.719838 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c093d9ad-a8b4-4ed6-852d-2a1f6634880a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:08.757563 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-c093d9ad-a8b4-4ed6-852d-2a1f6634880a admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=41aa54bab8fb4578acf2f550915fb334&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1293113 Dec 24 05:04:08.758409 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c093d9ad-a8b4-4ed6-852d-2a1f6634880a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9f3d3fd9-023d-4053-911c-b00f7179e02b,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:08.760254 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 58946) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:08.807606 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-4382ea17-1f0f-40e5-afe4-22d90cb28cb0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:08.831121 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-4382ea17-1f0f-40e5-afe4-22d90cb28cb0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:08.881319 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-4382ea17-1f0f-40e5-afe4-22d90cb28cb0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:08.883857 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-4382ea17-1f0f-40e5-afe4-22d90cb28cb0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:08.885289 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-4382ea17-1f0f-40e5-afe4-22d90cb28cb0 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/9f3d3fd9-023d-4053-911c-b00f7179e02b HTTP/1.1" status: 204 len: 168 time: 0.1240151 Dec 24 05:04:08.897958 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4382ea17-1f0f-40e5-afe4-22d90cb28cb0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9f3d3fd9-023d-4053-911c-b00f7179e02b,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:08.906314 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4382ea17-1f0f-40e5-afe4-22d90cb28cb0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:08.906667 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4382ea17-1f0f-40e5-afe4-22d90cb28cb0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:08.907011 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4382ea17-1f0f-40e5-afe4-22d90cb28cb0 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:08.907346 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4382ea17-1f0f-40e5-afe4-22d90cb28cb0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:08.907676 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4382ea17-1f0f-40e5-afe4-22d90cb28cb0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:08.908124 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4382ea17-1f0f-40e5-afe4-22d90cb28cb0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:08.908453 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4382ea17-1f0f-40e5-afe4-22d90cb28cb0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:08.908816 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4382ea17-1f0f-40e5-afe4-22d90cb28cb0 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:08.909138 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4382ea17-1f0f-40e5-afe4-22d90cb28cb0 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:08.909478 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4382ea17-1f0f-40e5-afe4-22d90cb28cb0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:08.909798 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4382ea17-1f0f-40e5-afe4-22d90cb28cb0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:08.910128 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4382ea17-1f0f-40e5-afe4-22d90cb28cb0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:08.910433 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4382ea17-1f0f-40e5-afe4-22d90cb28cb0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:04:09.288343 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-346c0473-fbfb-4523-b644-27fb861f7692 req-138d5988-aaad-4645-8a99-a813023066a6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:09.289840 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-346c0473-fbfb-4523-b644-27fb861f7692 req-138d5988-aaad-4645-8a99-a813023066a6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.2260621 Dec 24 05:04:09.340214 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-346c0473-fbfb-4523-b644-27fb861f7692 req-a027c68c-f3fe-46db-ac4d-7fe66617e193 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440652 Dec 24 05:04:10.635447 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00bd4fee-216a-44b6-8724-af0c14f1c753 req-aaaab6b8-edfb-417b-805e-c08926f5226b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:10.637030 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-00bd4fee-216a-44b6-8724-af0c14f1c753 req-aaaab6b8-edfb-417b-805e-c08926f5226b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.2122540 Dec 24 05:04:10.654780 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 59014) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:10.684319 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-00bd4fee-216a-44b6-8724-af0c14f1c753 req-967140db-6bcb-4111-9ffe-b651b9f23f56 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412743 Dec 24 05:04:10.759620 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-4b100035-6d8e-4d80-87bc-8a3c42da8dba admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:10.843632 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-4b100035-6d8e-4d80-87bc-8a3c42da8dba admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:10.848961 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-4b100035-6d8e-4d80-87bc-8a3c42da8dba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:10.891272 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-4b100035-6d8e-4d80-87bc-8a3c42da8dba admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=d31a505eabd048e3a011d0f1037efd5b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2329886 Dec 24 05:04:10.891272 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b100035-6d8e-4d80-87bc-8a3c42da8dba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e84582a2-0f5d-4b0b-976e-389d21e392e7,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:10.891882 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 59024) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:10.940241 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4718c173-6c26-4ba4-9af5-2cdc57822271 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:10.961895 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4718c173-6c26-4ba4-9af5-2cdc57822271 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:11.011495 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4718c173-6c26-4ba4-9af5-2cdc57822271 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:11.014210 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4718c173-6c26-4ba4-9af5-2cdc57822271 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:11.015358 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-4718c173-6c26-4ba4-9af5-2cdc57822271 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/e84582a2-0f5d-4b0b-976e-389d21e392e7 HTTP/1.1" status: 204 len: 168 time: 0.1223757 Dec 24 05:04:11.023584 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4718c173-6c26-4ba4-9af5-2cdc57822271 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e84582a2-0f5d-4b0b-976e-389d21e392e7,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:11.318277 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 59030) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:11.332725 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-20f353ab-66bb-4c10-83dc-269b4ddd01a0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:11.405599 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-20f353ab-66bb-4c10-83dc-269b4ddd01a0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:11.410985 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-20f353ab-66bb-4c10-83dc-269b4ddd01a0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:11.450704 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20f353ab-66bb-4c10-83dc-269b4ddd01a0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=89576102-f825-402f-89b2-d052477449b5,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:11.456263 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-20f353ab-66bb-4c10-83dc-269b4ddd01a0 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=624e540bb95946ed8794c08584c4835d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1368396 Dec 24 05:04:11.458938 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 59032) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:11.507341 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2aeb26bf-4151-4ffa-a1b9-bf8ed08a604f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:11.528152 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2aeb26bf-4151-4ffa-a1b9-bf8ed08a604f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:11.583281 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2aeb26bf-4151-4ffa-a1b9-bf8ed08a604f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:11.586258 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-2aeb26bf-4151-4ffa-a1b9-bf8ed08a604f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:11.587401 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-2aeb26bf-4151-4ffa-a1b9-bf8ed08a604f admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/89576102-f825-402f-89b2-d052477449b5 HTTP/1.1" status: 204 len: 168 time: 0.1275601 Dec 24 05:04:11.595260 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2aeb26bf-4151-4ffa-a1b9-bf8ed08a604f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=89576102-f825-402f-89b2-d052477449b5,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:11.805667 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-464a9cbc-350b-47f0-8c3d-1fda118fd2b3 req-d65ab277-f4cc-408d-8fc0-6ec600e42ed3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:11.807215 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-464a9cbc-350b-47f0-8c3d-1fda118fd2b3 req-d65ab277-f4cc-408d-8fc0-6ec600e42ed3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0483649 Dec 24 05:04:11.857577 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-464a9cbc-350b-47f0-8c3d-1fda118fd2b3 req-c9df12e0-2c9e-45fd-8adf-d17a8ef959c6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443797 Dec 24 05:04:12.982352 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7016d53-0b1f-4ad5-919f-d65140416832 req-850127f4-b7a5-47e2-80b1-cb1dc06b0e5b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:12.984048 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e7016d53-0b1f-4ad5-919f-d65140416832 req-850127f4-b7a5-47e2-80b1-cb1dc06b0e5b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0492134 Dec 24 05:04:13.034184 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e7016d53-0b1f-4ad5-919f-d65140416832 req-1c04e4d3-b198-4c8d-bb1a-a9a55618933a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435116 Dec 24 05:04:14.162109 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9bc477b-6be9-4f96-97ef-29913817e136 req-bdbcc3b9-715a-47c2-b875-acb855385b4b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:14.170971 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f9bc477b-6be9-4f96-97ef-29913817e136 req-bdbcc3b9-715a-47c2-b875-acb855385b4b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0576394 Dec 24 05:04:14.252109 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f9bc477b-6be9-4f96-97ef-29913817e136 req-f06e0ef8-e15e-49fb-83f5-0e96f1e424c6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0798533 Dec 24 05:04:15.408587 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94c99b09-0972-4789-bfe3-218b7e9bf560 req-cf20bc50-7d29-446f-a446-d1922a8ffe48 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:15.410266 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-94c99b09-0972-4789-bfe3-218b7e9bf560 req-cf20bc50-7d29-446f-a446-d1922a8ffe48 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0763533 Dec 24 05:04:15.459898 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-94c99b09-0972-4789-bfe3-218b7e9bf560 req-abd7e8ce-c035-47b5-9943-984316675cc9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433729 Dec 24 05:04:16.585510 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7e0da25-63a5-47ac-885f-649d6d6a2aea req-3b095e01-0338-4494-b2d2-1c217d8e2103 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:16.588017 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f7e0da25-63a5-47ac-885f-649d6d6a2aea req-3b095e01-0338-4494-b2d2-1c217d8e2103 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0538080 Dec 24 05:04:16.640820 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f7e0da25-63a5-47ac-885f-649d6d6a2aea req-8a3df532-c408-43e4-a624-953a96ac76e6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458579 Dec 24 05:04:17.973214 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-476613c2-d123-447d-8919-dc0df71c48c7 req-95fd612a-19a2-4aed-9897-ff7ee5b0cc75 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:17.974741 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-476613c2-d123-447d-8919-dc0df71c48c7 req-95fd612a-19a2-4aed-9897-ff7ee5b0cc75 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0525157 Dec 24 05:04:18.025936 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-476613c2-d123-447d-8919-dc0df71c48c7 req-4bdeb3bd-130c-4c27-81bb-70c517673f91 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425391 Dec 24 05:04:19.163599 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-416dc7ff-e525-4fe6-92b1-2b983cdd536c req-9be22ac8-71af-40a5-8cc6-8670fa5cf4d8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:19.165247 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-416dc7ff-e525-4fe6-92b1-2b983cdd536c req-9be22ac8-71af-40a5-8cc6-8670fa5cf4d8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0542550 Dec 24 05:04:19.224627 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-416dc7ff-e525-4fe6-92b1-2b983cdd536c req-0ac02598-b9a1-4fc0-bd25-3faba4a0a6c7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0529807 Dec 24 05:04:19.438384 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:20.354875 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e7bffca-6725-4f81-9016-69ae62429032 req-c6f9556e-8f08-4629-8fae-89d453cacb9b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:20.357202 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2e7bffca-6725-4f81-9016-69ae62429032 req-c6f9556e-8f08-4629-8fae-89d453cacb9b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0597670 Dec 24 05:04:20.415446 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2e7bffca-6725-4f81-9016-69ae62429032 req-20ed1318-cd74-4c87-8c94-c66cb0e38e8e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0512779 Dec 24 05:04:21.589429 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3db7120-3ecf-4441-9737-257c1d1b831a req-787a1772-3ff2-4ef5-8ab2-3c467bdc9ae6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:21.597966 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e3db7120-3ecf-4441-9737-257c1d1b831a req-787a1772-3ff2-4ef5-8ab2-3c467bdc9ae6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0943000 Dec 24 05:04:21.683871 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e3db7120-3ecf-4441-9737-257c1d1b831a req-4639cdc1-e44b-4307-8286-77296cb3f270 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0848632 Dec 24 05:04:21.730421 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-02a6cbc5-e357-46d5-bc79-8f0fb6976513 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:21.739026 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-02a6cbc5-e357-46d5-bc79-8f0fb6976513 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/networks?id=7d6d1704-2ca9-4ba7-a7ef-cd394e15a741 HTTP/1.1" status: 200 len: 814 time: 0.3113177 Dec 24 05:04:21.763707 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-49bedcf1-cb08-4cc8-913e-5f900e17afe6 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/quotas/122a6a1d32d648c6938f0b159bb3641c HTTP/1.1" status: 200 len: 375 time: 0.0229762 Dec 24 05:04:21.796881 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-5febdfb1-9c6a-4012-90fb-0f263a78ce16 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=122a6a1d32d648c6938f0b159bb3641c&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0322351 Dec 24 05:04:22.038900 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-7bce8d99-65d3-4bc0-b7de-fc1834466693 service neutron] 10.222.0.43 "GET /v2.0/networks/7d6d1704-2ca9-4ba7-a7ef-cd394e15a741?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2334292 Dec 24 05:04:22.145594 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-84a2aaf2-0d7b-4ffa-aa11-dd994c3eeccf service neutron] 10.222.0.43 "GET /v2.0/networks/7d6d1704-2ca9-4ba7-a7ef-cd394e15a741?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0999043 Dec 24 05:04:22.351618 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-02e965c6-43d1-4d9a-b5d6-7005fa75da81 req-88458aaf-f2bb-448f-9a4b-0c2949497102 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 210 time: 0.0551214 Dec 24 05:04:22.411041 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fad2312-b95a-4c40-b3d0-545cc29bdbbf req-d6ab833f-31f8-4f64-8eac-f34a962dc504 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:22.412999 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7fad2312-b95a-4c40-b3d0-545cc29bdbbf req-d6ab833f-31f8-4f64-8eac-f34a962dc504 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=6c9c47f70b8d4da5827a8ef4349559ab&device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 1098 time: 0.0574172 Dec 24 05:04:22.836116 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0060760b-8dfb-4b33-b9d3-7145c73e31ad req-0821958d-9958-465c-9853-166ee3360942 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:22.845185 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0060760b-8dfb-4b33-b9d3-7145c73e31ad req-0821958d-9958-465c-9853-166ee3360942 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0841136 Dec 24 05:04:22.913910 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0060760b-8dfb-4b33-b9d3-7145c73e31ad req-8b6bdae9-4a1d-4e69-8fe5-6f699b87a24c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0674610 Dec 24 05:04:23.198179 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-080ba763-3ef9-42b2-9417-1692d6dedde7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:23.413197 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:04:23.464046 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-705c3d12-560b-48ca-b09e-9afff0b48927 req-c341805f-320a-4a67-8cf3-85742fcc4e66 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 210 time: 0.0358286 Dec 24 05:04:24.034227 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a34ac93-2228-47b8-b6c4-178e9f33a5b6 req-4bd1e617-03dc-4e73-8646-f4c121abe4fc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:24.035687 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0a34ac93-2228-47b8-b6c4-178e9f33a5b6 req-4bd1e617-03dc-4e73-8646-f4c121abe4fc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0509865 Dec 24 05:04:24.081987 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0a34ac93-2228-47b8-b6c4-178e9f33a5b6 req-29c167fe-af48-441a-bb97-412d3428d2df tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403330 Dec 24 05:04:24.562096 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-96d275b1-b8d3-406f-939d-d3fc33358655 req-155cc5f6-00cd-4239-9ae6-b56807cd6040 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 210 time: 0.0301483 Dec 24 05:04:25.222473 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aff297b0-964f-4169-b6af-cd6c3ed2e86f req-4aef367d-c66d-427a-bc3a-a2516ccc5b8f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:25.223854 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-aff297b0-964f-4169-b6af-cd6c3ed2e86f req-4aef367d-c66d-427a-bc3a-a2516ccc5b8f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0562084 Dec 24 05:04:25.253117 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-98f01824-eb5b-4866-a34b-e9932b4d7e7a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:25.271833 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-aff297b0-964f-4169-b6af-cd6c3ed2e86f req-13473039-8da8-4301-9f29-21ff477ef91c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420086 Dec 24 05:04:25.374280 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fad2312-b95a-4c40-b3d0-545cc29bdbbf req-c1408f90-e7c2-4c7c-8bd2-ddf602f7f300 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:25.375822 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7fad2312-b95a-4c40-b3d0-545cc29bdbbf req-c1408f90-e7c2-4c7c-8bd2-ddf602f7f300 service neutron] 10.222.0.46 "GET /v2.0/networks?id=c908572e-3b6b-470c-8b88-35b51f1472c6 HTTP/1.1" status: 200 len: 917 time: 0.0892735 Dec 24 05:04:25.665753 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-95cadd83-bf62-4a76-a403-50cee3563e2a req-25e39f59-fb7e-4407-a5ba-9263264b94a3 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 210 time: 0.0303946 Dec 24 05:04:26.401860 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1581163b-9f6b-43e8-be04-2840d38cb349 req-4c91a355-822b-40bd-b79e-4b1999447406 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:26.403458 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1581163b-9f6b-43e8-be04-2840d38cb349 req-4c91a355-822b-40bd-b79e-4b1999447406 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0545008 Dec 24 05:04:26.453784 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1581163b-9f6b-43e8-be04-2840d38cb349 req-78f271d6-dac9-4e7e-bf57-af74cec8bc81 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417211 Dec 24 05:04:26.467331 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:26.769785 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-af961666-8495-4e1f-ae3e-e4cab2338ae5 req-37a22471-fb18-4201-8f3e-06b46174c688 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 210 time: 0.0314252 Dec 24 05:04:26.948066 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7fad2312-b95a-4c40-b3d0-545cc29bdbbf req-b5ff3278-f5ac-4028-a5ac-0eb8f0858b06 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=61ec3441-5b75-4c07-b8ad-4174450d6a55 HTTP/1.1" status: 200 len: 1000 time: 0.1122599 Dec 24 05:04:27.005603 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fad2312-b95a-4c40-b3d0-545cc29bdbbf req-30c1e0e5-cf3f-4af5-9b33-bff28e927abb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:27.007057 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7fad2312-b95a-4c40-b3d0-545cc29bdbbf req-30c1e0e5-cf3f-4af5-9b33-bff28e927abb service neutron] 10.222.0.46 "GET /v2.0/subnets?id=699b398d-7f9d-4acb-bc18-ac32f35377c3 HTTP/1.1" status: 200 len: 855 time: 0.0475235 Dec 24 05:04:27.062218 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fad2312-b95a-4c40-b3d0-545cc29bdbbf req-a4316c50-8e22-419e-9997-8c66fe13ec37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:27.063727 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7fad2312-b95a-4c40-b3d0-545cc29bdbbf req-a4316c50-8e22-419e-9997-8c66fe13ec37 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=c908572e-3b6b-470c-8b88-35b51f1472c6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0448332 Dec 24 05:04:27.161662 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7fad2312-b95a-4c40-b3d0-545cc29bdbbf req-ca6ef164-8cdd-4aec-aa2c-854072d11657 service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0891726 Dec 24 05:04:27.268827 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7fad2312-b95a-4c40-b3d0-545cc29bdbbf req-a87fdca2-7e28-4088-9558-4633c64ce7af service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0980718 Dec 24 05:04:27.595511 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec175353-7aff-4ba4-bd1b-ccdc6d73aced req-e27621db-89c2-4f48-b2d3-935bf245f545 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:27.597008 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ec175353-7aff-4ba4-bd1b-ccdc6d73aced req-e27621db-89c2-4f48-b2d3-935bf245f545 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0621932 Dec 24 05:04:27.647945 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ec175353-7aff-4ba4-bd1b-ccdc6d73aced req-c2726ecb-122c-4cf4-9bb1-943b17ccaf40 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448728 Dec 24 05:04:27.867176 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c8305ac2-67dd-42ac-8bc9-e03cdb751d55 req-66ac0a5d-4e2f-4179-9c08-496d45c8fb20 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 210 time: 0.0263758 Dec 24 05:04:27.909417 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:28.245771 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-6d5c1715-e7fc-4a3f-9d3c-372e6d738f73 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:28.247438 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-6d5c1715-e7fc-4a3f-9d3c-372e6d738f73 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.46 "GET /v2.0/networks?id=7d6d1704-2ca9-4ba7-a7ef-cd394e15a741 HTTP/1.1" status: 200 len: 814 time: 0.1215820 Dec 24 05:04:28.274336 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-9206d10f-797d-4eed-ac7f-09821816b640 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Request body: {'port': {'device_id': '153cfba1-0ed2-49c8-9da9-c34aa958b46b', 'network_id': '7d6d1704-2ca9-4ba7-a7ef-cd394e15a741', 'admin_state_up': True, 'tenant_id': '122a6a1d32d648c6938f0b159bb3641c'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:04:28.381628 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-9206d10f-797d-4eed-ac7f-09821816b640 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Made reservation on behalf of 122a6a1d32d648c6938f0b159bb3641c for: {'port': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:04:28.385115 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-9206d10f-797d-4eed-ac7f-09821816b640 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:28.577278 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:28.767686 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-9206d10f-797d-4eed-ac7f-09821816b640 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Allocated IP 172.20.0.4 (7d6d1704-2ca9-4ba7-a7ef-cd394e15a741/42c4f72c-ce3e-4cb1-9111-06a2ac0d1641/39c2b5d9-53b6-46c0-9a86-f5429051b77c) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:04:28.781047 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fee993be-69e0-48f9-ab01-e7e61b2b88d1 req-12678ee6-8c30-4f77-9c01-df376dd93d07 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:28.783884 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-fee993be-69e0-48f9-ab01-e7e61b2b88d1 req-12678ee6-8c30-4f77-9c01-df376dd93d07 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0571587 Dec 24 05:04:28.837708 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-fee993be-69e0-48f9-ab01-e7e61b2b88d1 req-d18cdd35-5573-4b7d-a431-4105641260d9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0465271 Dec 24 05:04:28.957941 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-9206d10f-797d-4eed-ac7f-09821816b640 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:28.986060 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-00c153dc-e53b-4825-8503-c697e69eec20 req-b8b46860-dde2-41d8-be70-e2f64585ad60 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 210 time: 0.0423298 Dec 24 05:04:29.009994 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-9206d10f-797d-4eed-ac7f-09821816b640 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:29.061070 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-9206d10f-797d-4eed-ac7f-09821816b640 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Network 7d6d1704-2ca9-4ba7-a7ef-cd394e15a741 is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:04:29.064178 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-9206d10f-797d-4eed-ac7f-09821816b640 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:04:29.067669 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-9206d10f-797d-4eed-ac7f-09821816b640 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:04:29.098792 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9206d10f-797d-4eed-ac7f-09821816b640 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Pushing event updated for resources: {'Port': ['ID=39c2b5d9-53b6-46c0-9a86-f5429051b77c,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:29.126592 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-9206d10f-797d-4eed-ac7f-09821816b640 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:29.127449 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-9206d10f-797d-4eed-ac7f-09821816b640 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:29.151384 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-9206d10f-797d-4eed-ac7f-09821816b640 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.46 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8807538 Dec 24 05:04:29.178072 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-034534cd-fefc-48b1-8c7b-3d1684a0cd82 service neutron] Request body: {'port': {'device_id': '153cfba1-0ed2-49c8-9da9-c34aa958b46b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81644'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:04:29.216658 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4fd4126-15b3-4a45-b3c4-df6345bad5e9 req-e4aa7153-9af3-45d4-b2c3-434522631610 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:29.218114 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a4fd4126-15b3-4a45-b3c4-df6345bad5e9 req-e4aa7153-9af3-45d4-b2c3-434522631610 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=6c9c47f70b8d4da5827a8ef4349559ab&device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 1098 time: 0.0785055 Dec 24 05:04:29.260768 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-034534cd-fefc-48b1-8c7b-3d1684a0cd82 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:29.364841 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4fd4126-15b3-4a45-b3c4-df6345bad5e9 req-66a88f78-fdd1-43e0-9f0e-822d71290719 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:29.366314 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a4fd4126-15b3-4a45-b3c4-df6345bad5e9 req-66a88f78-fdd1-43e0-9f0e-822d71290719 service neutron] 10.222.0.46 "GET /v2.0/networks?id=c908572e-3b6b-470c-8b88-35b51f1472c6 HTTP/1.1" status: 200 len: 917 time: 0.1349354 Dec 24 05:04:29.498396 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a4fd4126-15b3-4a45-b3c4-df6345bad5e9 req-b24d260e-4ada-4897-b8c1-0989e1169bcc service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=61ec3441-5b75-4c07-b8ad-4174450d6a55 HTTP/1.1" status: 200 len: 1000 time: 0.0932040 Dec 24 05:04:29.596986 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4fd4126-15b3-4a45-b3c4-df6345bad5e9 req-f3945b98-ef60-496f-9112-2f874f38f8eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:29.599771 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a4fd4126-15b3-4a45-b3c4-df6345bad5e9 req-f3945b98-ef60-496f-9112-2f874f38f8eb service neutron] 10.222.0.46 "GET /v2.0/subnets?id=699b398d-7f9d-4acb-bc18-ac32f35377c3 HTTP/1.1" status: 200 len: 855 time: 0.0713189 Dec 24 05:04:29.685602 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-034534cd-fefc-48b1-8c7b-3d1684a0cd82 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 39c2b5d9-53b6-46c0-9a86-f5429051b77c {{(pid=102476) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:04:29.690783 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4fd4126-15b3-4a45-b3c4-df6345bad5e9 req-69bf6f4e-2f27-421f-a923-6f7c51bed554 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:29.692360 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a4fd4126-15b3-4a45-b3c4-df6345bad5e9 req-69bf6f4e-2f27-421f-a923-6f7c51bed554 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=c908572e-3b6b-470c-8b88-35b51f1472c6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0844896 Dec 24 05:04:29.696193 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-034534cd-fefc-48b1-8c7b-3d1684a0cd82 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:29.723929 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.provisioning_blocks [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-034534cd-fefc-48b1-8c7b-3d1684a0cd82 service neutron] Transition to ACTIVE for port object 39c2b5d9-53b6-46c0-9a86-f5429051b77c will not be triggered until provisioned by entity L2. {{(pid=102476) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 24 05:04:29.730481 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-034534cd-fefc-48b1-8c7b-3d1684a0cd82 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:29.822570 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-034534cd-fefc-48b1-8c7b-3d1684a0cd82 service neutron] Pushing event updated for resources: {'Port': ['ID=39c2b5d9-53b6-46c0-9a86-f5429051b77c,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:29.859718 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a4fd4126-15b3-4a45-b3c4-df6345bad5e9 req-bf59e528-7bd9-466b-aa54-c417d1c6afd4 service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1573381 Dec 24 05:04:29.964671 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-034534cd-fefc-48b1-8c7b-3d1684a0cd82 service neutron] Attempting to bind port 39c2b5d9-53b6-46c0-9a86-f5429051b77c on host hv-cinder-81644 for vnic_type normal with profile {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:04:29.965372 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-034534cd-fefc-48b1-8c7b-3d1684a0cd82 service neutron] Attempting to bind port 39c2b5d9-53b6-46c0-9a86-f5429051b77c by drivers openvswitch,hyperv on host hv-cinder-81644 at level 0 using segments [{'id': '45cba16b-d4c1-40eb-8945-69769d27d2b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '7d6d1704-2ca9-4ba7-a7ef-cd394e15a741'}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:04:29.965372 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-034534cd-fefc-48b1-8c7b-3d1684a0cd82 service neutron] Attempting to bind port 39c2b5d9-53b6-46c0-9a86-f5429051b77c on network 7d6d1704-2ca9-4ba7-a7ef-cd394e15a741 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:04:29.972317 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-034534cd-fefc-48b1-8c7b-3d1684a0cd82 service neutron] Port 39c2b5d9-53b6-46c0-9a86-f5429051b77c on network 7d6d1704-2ca9-4ba7-a7ef-cd394e15a741 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81644 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 24 05:04:29.972697 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-034534cd-fefc-48b1-8c7b-3d1684a0cd82 service neutron] Attempting to bind port 39c2b5d9-53b6-46c0-9a86-f5429051b77c on network 7d6d1704-2ca9-4ba7-a7ef-cd394e15a741 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:04:29.983209 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-034534cd-fefc-48b1-8c7b-3d1684a0cd82 service neutron] Checking agent: {'id': '7a2ffd19-371f-4f7b-a239-eea3b5cfd55b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81644', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'started_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 4, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:04:29.983513 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c0bf85d-9346-4edb-9df6-a0eee58b0b2b req-a5f4d7d9-4664-4c15-ac3a-a2271a01e93a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:29.983974 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-034534cd-fefc-48b1-8c7b-3d1684a0cd82 service neutron] Checking segment: {'id': '45cba16b-d4c1-40eb-8945-69769d27d2b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '7d6d1704-2ca9-4ba7-a7ef-cd394e15a741'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:04:29.983974 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-034534cd-fefc-48b1-8c7b-3d1684a0cd82 service neutron] Bound using segment: {'id': '45cba16b-d4c1-40eb-8945-69769d27d2b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '7d6d1704-2ca9-4ba7-a7ef-cd394e15a741'} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:04:29.984336 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-034534cd-fefc-48b1-8c7b-3d1684a0cd82 service neutron] Bound port: 39c2b5d9-53b6-46c0-9a86-f5429051b77c, host: hv-cinder-81644, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '45cba16b-d4c1-40eb-8945-69769d27d2b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '7d6d1704-2ca9-4ba7-a7ef-cd394e15a741'}}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:04:29.984731 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-034534cd-fefc-48b1-8c7b-3d1684a0cd82 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:29.986483 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0c0bf85d-9346-4edb-9df6-a0eee58b0b2b req-a5f4d7d9-4664-4c15-ac3a-a2271a01e93a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0531023 Dec 24 05:04:30.005254 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a4fd4126-15b3-4a45-b3c4-df6345bad5e9 req-f3019897-43de-4cfa-b927-c3aa0c4c99ff service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1246984 Dec 24 05:04:30.041190 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0c0bf85d-9346-4edb-9df6-a0eee58b0b2b req-e5521869-d9c4-4534-b7ac-2f1406349bfa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0497563 Dec 24 05:04:30.068125 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-034534cd-fefc-48b1-8c7b-3d1684a0cd82 service neutron] For port 39c2b5d9-53b6-46c0-9a86-f5429051b77c, host hv-cinder-81644, cleared binding levels {{(pid=102476) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:04:30.071435 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-034534cd-fefc-48b1-8c7b-3d1684a0cd82 service neutron] For port 39c2b5d9-53b6-46c0-9a86-f5429051b77c, host hv-cinder-81644, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=39c2b5d9-53b6-46c0-9a86-f5429051b77c,segment=NetworkSegment(45cba16b-d4c1-40eb-8945-69769d27d2b7),segment_id=45cba16b-d4c1-40eb-8945-69769d27d2b7)] {{(pid=102476) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:04:30.076570 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-034534cd-fefc-48b1-8c7b-3d1684a0cd82 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:30.115237 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-034534cd-fefc-48b1-8c7b-3d1684a0cd82 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:30.115854 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-034534cd-fefc-48b1-8c7b-3d1684a0cd82 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:30.117236 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-034534cd-fefc-48b1-8c7b-3d1684a0cd82 service neutron] 10.222.0.46 "PUT /v2.0/ports/39c2b5d9-53b6-46c0-9a86-f5429051b77c HTTP/1.1" status: 200 len: 1093 time: 0.9446809 Dec 24 05:04:30.120075 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '153cfba1-0ed2-49c8-9da9-c34aa958b46b', 'tag': '39c2b5d9-53b6-46c0-9a86-f5429051b77c'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:04:30.122475 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c02f1593-53b6-46a8-a17f-f501e7e1d340" -d '{"events": [{"name": "network-changed", "server_uuid": "153cfba1-0ed2-49c8-9da9-c34aa958b46b", "tag": "39c2b5d9-53b6-46c0-9a86-f5429051b77c"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:04:30.170220 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-034534cd-fefc-48b1-8c7b-3d1684a0cd82 service neutron] Pushing event updated for resources: {'Port': ['ID=39c2b5d9-53b6-46c0-9a86-f5429051b77c,revision_number=3']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:30.180915 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:04:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4af5ab5c-56db-4eae-8927-9a070c81569c x-openstack-request-id: req-4af5ab5c-56db-4eae-8927-9a070c81569c {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:04:30.181263 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "153cfba1-0ed2-49c8-9da9-c34aa958b46b", "tag": "39c2b5d9-53b6-46c0-9a86-f5429051b77c", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:04:30.181575 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-4af5ab5c-56db-4eae-8927-9a070c81569c {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:04:30.182019 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '153cfba1-0ed2-49c8-9da9-c34aa958b46b', 'tag': '39c2b5d9-53b6-46c0-9a86-f5429051b77c', 'status': 'completed', 'code': 200} Dec 24 05:04:30.189963 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db86a9c3-4ac2-456b-b2bc-73f8c86d1e66 req-4f18957a-3f6c-47e8-9c25-39e1d711542c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:30.191679 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-db86a9c3-4ac2-456b-b2bc-73f8c86d1e66 req-4f18957a-3f6c-47e8-9c25-39e1d711542c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 943 time: 0.0780227 Dec 24 05:04:30.277529 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-db86a9c3-4ac2-456b-b2bc-73f8c86d1e66 req-3ebdbee2-65fd-4627-b3f9-8cdda33d0daf tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0788944 Dec 24 05:04:30.292757 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-b99ec13d-615d-497a-a00b-86acaf0d4499 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:30.294310 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-b99ec13d-615d-497a-a00b-86acaf0d4499 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=122a6a1d32d648c6938f0b159bb3641c&device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 1096 time: 0.0676539 Dec 24 05:04:30.345235 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-ebdbaa23-501d-4295-8de5-211249ce7d46 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=39c2b5d9-53b6-46c0-9a86-f5429051b77c HTTP/1.1" status: 200 len: 217 time: 0.0359955 Dec 24 05:04:31.160378 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a12a4cf6-fd68-406e-95ed-90ed2c0880c0 req-f83ae5e4-694c-482c-94ae-67dacc14029d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:31.162153 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a12a4cf6-fd68-406e-95ed-90ed2c0880c0 req-f83ae5e4-694c-482c-94ae-67dacc14029d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0490072 Dec 24 05:04:31.212703 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a12a4cf6-fd68-406e-95ed-90ed2c0880c0 req-883f5373-cd79-4da8-abb6-4ecf58729989 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444648 Dec 24 05:04:31.405851 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd8e8345-9813-4560-935f-c0410eb66a0d req-5d1b4cc4-247f-4307-bd2c-de4b91630812 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:31.408222 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-dd8e8345-9813-4560-935f-c0410eb66a0d req-5d1b4cc4-247f-4307-bd2c-de4b91630812 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 943 time: 0.0543165 Dec 24 05:04:31.458287 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-dd8e8345-9813-4560-935f-c0410eb66a0d req-96702967-b09d-4280-8c6c-853f621bb13d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440996 Dec 24 05:04:31.573435 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-7b6b1696-cdd5-467f-829c-15397be3b321 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:31.574925 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-7b6b1696-cdd5-467f-829c-15397be3b321 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=42c4f72c-ce3e-4cb1-9111-06a2ac0d1641 HTTP/1.1" status: 200 len: 854 time: 0.0464675 Dec 24 05:04:32.343491 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33967d40-70a4-40df-9bad-a131aebea8d2 req-8c397c0c-60bd-4943-ad61-80216cea1169 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:32.345050 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-33967d40-70a4-40df-9bad-a131aebea8d2 req-8c397c0c-60bd-4943-ad61-80216cea1169 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 945 time: 0.0512435 Dec 24 05:04:32.393397 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-33967d40-70a4-40df-9bad-a131aebea8d2 req-1e09e20f-09a2-4390-b3fa-abbffc78b3c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424018 Dec 24 05:04:32.517961 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 61ec3441-5b75-4c07-b8ad-4174450d6a55 no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:04:32.566395 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-49008bac-2c76-426a-a288-666bcec58bb9 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=7d6d1704-2ca9-4ba7-a7ef-cd394e15a741&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0507255 Dec 24 05:04:32.604331 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:32.625147 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ae4a9cb-2268-47f8-878d-be917e51e750 req-139d570e-0b47-4f14-ba8e-e9978f538b0b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:32.627118 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6485c286-d5e3-42e7-bf58-c4685f8c3066', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '61ec3441-5b75-4c07-b8ad-4174450d6a55'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:04:32.627328 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6ae4a9cb-2268-47f8-878d-be917e51e750 req-139d570e-0b47-4f14-ba8e-e9978f538b0b tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 943 time: 0.0736961 Dec 24 05:04:32.629337 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-efe55665-89b1-44b2-9700-bd3c827dbf48" -d '{"events": [{"server_uuid": "6485c286-d5e3-42e7-bf58-c4685f8c3066", "name": "network-vif-unplugged", "status": "completed", "tag": "61ec3441-5b75-4c07-b8ad-4174450d6a55"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:04:32.642389 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 61ec3441-5b75-4c07-b8ad-4174450d6a55, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=61ec3441-5b75-4c07-b8ad-4174450d6a55,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:04:32.648101 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:32.679772 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Fri, 24 Dec 2021 05:04:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d7ac57a8-909f-4cb3-bc54-5b54f46b1edf x-openstack-request-id: req-d7ac57a8-909f-4cb3-bc54-5b54f46b1edf {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:04:32.680086 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6485c286-d5e3-42e7-bf58-c4685f8c3066", "name": "network-vif-unplugged", "status": "completed", "tag": "61ec3441-5b75-4c07-b8ad-4174450d6a55", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:04:32.680332 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-d7ac57a8-909f-4cb3-bc54-5b54f46b1edf {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:04:32.680911 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6485c286-d5e3-42e7-bf58-c4685f8c3066', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '61ec3441-5b75-4c07-b8ad-4174450d6a55', 'code': 200} Dec 24 05:04:32.684465 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6ae4a9cb-2268-47f8-878d-be917e51e750 req-52a70f41-cb03-4f82-bbd9-e90df05886cf tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501232 Dec 24 05:04:32.707195 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=61ec3441-5b75-4c07-b8ad-4174450d6a55,revision_number=8']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:33.530947 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00ead7f5-30e7-46d2-a276-3662de6a9903 req-177d482c-79d3-4891-8ed3-60a74f4cd4fd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:33.532413 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-00ead7f5-30e7-46d2-a276-3662de6a9903 req-177d482c-79d3-4891-8ed3-60a74f4cd4fd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0513153 Dec 24 05:04:33.586660 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-00ead7f5-30e7-46d2-a276-3662de6a9903 req-6d8e9ac1-6254-4043-aaff-6850d8bb8463 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453832 Dec 24 05:04:33.824197 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-453099da-cdde-40dc-ac49-aa0b5c1ce28e req-fe7503d4-896c-404b-b6be-41502721ed5d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:33.825895 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-453099da-cdde-40dc-ac49-aa0b5c1ce28e req-fe7503d4-896c-404b-b6be-41502721ed5d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 943 time: 0.0558119 Dec 24 05:04:33.878024 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-453099da-cdde-40dc-ac49-aa0b5c1ce28e req-50b8d82f-5a6c-488b-9fd2-fcdaa3c253e6 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428879 Dec 24 05:04:33.997202 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-3aa0c805-908c-440d-9053-366d660b0499 service neutron] 10.222.0.46 "GET /v2.0/networks/7d6d1704-2ca9-4ba7-a7ef-cd394e15a741?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1015573 Dec 24 05:04:34.122083 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e581ad07-320d-4660-9bba-0a9629c80a9e req-c891d786-6f7c-4fe6-8fbb-0fdc37da6951 service neutron] 10.222.0.46 "GET /v2.0/networks/7d6d1704-2ca9-4ba7-a7ef-cd394e15a741?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0925009 Dec 24 05:04:34.276009 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c02f1593-53b6-46a8-a17f-f501e7e1d340 req-e23276a7-246b-42f4-9ef0-7871f5905eb4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:34.277939 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c02f1593-53b6-46a8-a17f-f501e7e1d340 req-e23276a7-246b-42f4-9ef0-7871f5905eb4 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=122a6a1d32d648c6938f0b159bb3641c&device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 1096 time: 0.0495527 Dec 24 05:04:34.373016 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c02f1593-53b6-46a8-a17f-f501e7e1d340 req-d0c7cf6a-7fa4-47fd-9d29-e03f8e46694e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:34.374462 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c02f1593-53b6-46a8-a17f-f501e7e1d340 req-d0c7cf6a-7fa4-47fd-9d29-e03f8e46694e service neutron] 10.222.0.46 "GET /v2.0/networks?id=7d6d1704-2ca9-4ba7-a7ef-cd394e15a741 HTTP/1.1" status: 200 len: 915 time: 0.0881810 Dec 24 05:04:34.416276 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c02f1593-53b6-46a8-a17f-f501e7e1d340 req-bca93f1a-3fab-4e9f-801e-de66387b4a37 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=39c2b5d9-53b6-46c0-9a86-f5429051b77c HTTP/1.1" status: 200 len: 217 time: 0.0338414 Dec 24 05:04:34.466253 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c02f1593-53b6-46a8-a17f-f501e7e1d340 req-60bad5b1-39ec-4b85-acaf-ef519ba2a50d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:34.467733 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c02f1593-53b6-46a8-a17f-f501e7e1d340 req-60bad5b1-39ec-4b85-acaf-ef519ba2a50d service neutron] 10.222.0.46 "GET /v2.0/subnets?id=42c4f72c-ce3e-4cb1-9111-06a2ac0d1641 HTTP/1.1" status: 200 len: 854 time: 0.0438981 Dec 24 05:04:34.504762 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c02f1593-53b6-46a8-a17f-f501e7e1d340 req-d1f1fc68-4f7d-436d-b62f-193f1c33e3ab service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=7d6d1704-2ca9-4ba7-a7ef-cd394e15a741&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0287101 Dec 24 05:04:34.595911 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c02f1593-53b6-46a8-a17f-f501e7e1d340 req-18af5fa5-24ec-4594-bd15-1bee7e5d3499 service neutron] 10.222.0.46 "GET /v2.0/networks/7d6d1704-2ca9-4ba7-a7ef-cd394e15a741?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0829451 Dec 24 05:04:34.694314 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c02f1593-53b6-46a8-a17f-f501e7e1d340 req-d1cdf771-e4a1-4d7a-8187-f962ed5d0534 service neutron] 10.222.0.46 "GET /v2.0/networks/7d6d1704-2ca9-4ba7-a7ef-cd394e15a741?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0907452 Dec 24 05:04:34.714459 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d0951ec-da98-4b34-b73a-1822e96f9543 req-2c78354c-7255-4b71-8272-11e1d1f518d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:34.715993 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-2d0951ec-da98-4b34-b73a-1822e96f9543 req-2c78354c-7255-4b71-8272-11e1d1f518d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0548108 Dec 24 05:04:34.763677 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-2d0951ec-da98-4b34-b73a-1822e96f9543 req-f7bdd2a6-23e0-4399-9262-244a6593720f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414562 Dec 24 05:04:35.019363 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af5e9b11-31b2-4fea-a561-b77a1d447547 req-2aa4248d-51de-4706-aaf2-25dd8ced9332 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:35.020858 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-af5e9b11-31b2-4fea-a561-b77a1d447547 req-2aa4248d-51de-4706-aaf2-25dd8ced9332 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 943 time: 0.0584252 Dec 24 05:04:35.077315 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-af5e9b11-31b2-4fea-a561-b77a1d447547 req-a8a1b285-9710-4bd8-b293-ebdc8fbe1f1c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471599 Dec 24 05:04:35.884409 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5458c6a5-6b16-4126-80aa-00906e25ebab req-33828ae4-931d-42c0-a385-a6590d98560b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:35.885832 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5458c6a5-6b16-4126-80aa-00906e25ebab req-33828ae4-931d-42c0-a385-a6590d98560b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0497727 Dec 24 05:04:35.934399 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5458c6a5-6b16-4126-80aa-00906e25ebab req-108d2de2-ac5f-475b-9b35-840ee029fdd9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421631 Dec 24 05:04:36.213286 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79141ddf-6cfd-4b75-9371-d1c77d580583 req-d95fe0e6-28bc-453b-953c-35e5158a9929 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:36.214816 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-79141ddf-6cfd-4b75-9371-d1c77d580583 req-d95fe0e6-28bc-453b-953c-35e5158a9929 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 943 time: 0.0600431 Dec 24 05:04:36.274137 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-79141ddf-6cfd-4b75-9371-d1c77d580583 req-36ff57b7-4c9e-43bb-abd8-f30b1e5c77a8 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524681 Dec 24 05:04:36.483187 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [req-022ff066-2de7-4b32-86ff-17c4ec5de8ee req-5bbb5f72-5755-4985-ab41-cd237b6e86f5 service neutron] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102476) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 24 05:04:36.484220 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-022ff066-2de7-4b32-86ff-17c4ec5de8ee req-5bbb5f72-5755-4985-ab41-cd237b6e86f5 service neutron] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0495403 Dec 24 05:04:36.645790 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f48a2728-2725-45db-817e-4881c763988a req-fa016a37-b6eb-477c-9fd7-782647583523 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:36.647309 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f48a2728-2725-45db-817e-4881c763988a req-fa016a37-b6eb-477c-9fd7-782647583523 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0507972 Dec 24 05:04:36.700693 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f48a2728-2725-45db-817e-4881c763988a req-277fc820-1d3e-4bbc-bd6e-0ab690e43be4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0469582 Dec 24 05:04:36.764991 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 59550) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:36.916719 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c809f9cd-c19a-4519-973b-b52d4c3cc472 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:37.017178 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c809f9cd-c19a-4519-973b-b52d4c3cc472 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:37.021784 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c809f9cd-c19a-4519-973b-b52d4c3cc472 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:37.022591 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 59574) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:37.074417 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-c809f9cd-c19a-4519-973b-b52d4c3cc472 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=14dbbfb9f9ff412591de834421fa4027&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3048754 Dec 24 05:04:37.075516 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 59580) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:37.094041 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c809f9cd-c19a-4519-973b-b52d4c3cc472 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=670c880f-dd6f-40f1-9399-0f8c3dc46603,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:37.191369 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-2ea3aaa0-baac-4016-8d24-8460398e29f8 req-e09a7be1-5944-4c0e-9bb6-59657966572b service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1674473 Dec 24 05:04:37.194156 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-0070b9b9-68a3-401b-9e36-1c3031bdc147 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:37.201831 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [req-2ea3aaa0-baac-4016-8d24-8460398e29f8 req-525024cd-0048-42ca-8627-3fd528c9a10d service neutron] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102477) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 24 05:04:37.202621 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-2ea3aaa0-baac-4016-8d24-8460398e29f8 req-525024cd-0048-42ca-8627-3fd528c9a10d service neutron] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0056846 Dec 24 05:04:37.224125 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-0070b9b9-68a3-401b-9e36-1c3031bdc147 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:37.274241 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-0070b9b9-68a3-401b-9e36-1c3031bdc147 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:37.277938 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-0070b9b9-68a3-401b-9e36-1c3031bdc147 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:37.279381 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-0070b9b9-68a3-401b-9e36-1c3031bdc147 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/670c880f-dd6f-40f1-9399-0f8c3dc46603 HTTP/1.1" status: 204 len: 168 time: 0.2027912 Dec 24 05:04:37.288576 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0070b9b9-68a3-401b-9e36-1c3031bdc147 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=670c880f-dd6f-40f1-9399-0f8c3dc46603,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:37.421387 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fb0293c-4dc0-4a44-9243-4cb2541e34e9 req-d6783318-30a3-45cd-adf5-2a93db74a6c9 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:37.423004 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2fb0293c-4dc0-4a44-9243-4cb2541e34e9 req-d6783318-30a3-45cd-adf5-2a93db74a6c9 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 943 time: 0.0552402 Dec 24 05:04:37.472866 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2fb0293c-4dc0-4a44-9243-4cb2541e34e9 req-fbd0fe6d-7ade-4903-9647-66b3b48a5285 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427670 Dec 24 05:04:37.595999 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 59594) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:37.609853 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-046d22bf-58d6-45e8-b1af-22777b243ad5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:37.686149 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-046d22bf-58d6-45e8-b1af-22777b243ad5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:37.692218 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-046d22bf-58d6-45e8-b1af-22777b243ad5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:37.729330 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-046d22bf-58d6-45e8-b1af-22777b243ad5 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=71d146aaf6b841b58a60f1438af6749d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1321571 Dec 24 05:04:37.729942 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-046d22bf-58d6-45e8-b1af-22777b243ad5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=342ee5b8-f2da-4704-9a55-f509d663f4a7,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:37.732201 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 59598) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:37.791893 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-9fb7255f-9b27-4481-a5a2-301769f4b762 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:37.830178 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-9fb7255f-9b27-4481-a5a2-301769f4b762 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:37.866141 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87d1fdaf-7a41-4e8c-9efa-a07c81bfbcce req-227fcdc8-c235-40ba-be37-278ace026dbc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:37.867626 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-87d1fdaf-7a41-4e8c-9efa-a07c81bfbcce req-227fcdc8-c235-40ba-be37-278ace026dbc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0890179 Dec 24 05:04:37.922466 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-87d1fdaf-7a41-4e8c-9efa-a07c81bfbcce req-229b7e01-1382-4b40-95b2-08c98e567606 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0479918 Dec 24 05:04:37.923052 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-9fb7255f-9b27-4481-a5a2-301769f4b762 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:37.925781 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-9fb7255f-9b27-4481-a5a2-301769f4b762 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:37.930770 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-9fb7255f-9b27-4481-a5a2-301769f4b762 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/342ee5b8-f2da-4704-9a55-f509d663f4a7 HTTP/1.1" status: 204 len: 168 time: 0.1950302 Dec 24 05:04:37.936720 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fb7255f-9b27-4481-a5a2-301769f4b762 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=342ee5b8-f2da-4704-9a55-f509d663f4a7,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:38.267712 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 59612) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:38.281489 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-58eb6d1b-fdfe-43f2-8c94-31f5f33968b5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:38.356316 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-58eb6d1b-fdfe-43f2-8c94-31f5f33968b5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:38.362634 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-58eb6d1b-fdfe-43f2-8c94-31f5f33968b5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:38.408267 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-58eb6d1b-fdfe-43f2-8c94-31f5f33968b5 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=8dc46d97433a404fb543419127996385&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1394446 Dec 24 05:04:38.409116 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58eb6d1b-fdfe-43f2-8c94-31f5f33968b5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=32893b03-99d4-450b-ae03-f026f7e45107,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:38.411128 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 59614) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:38.464005 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9ff47c66-6df1-4f29-87b5-56427e1a21fd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:38.485014 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9ff47c66-6df1-4f29-87b5-56427e1a21fd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:38.538438 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9ff47c66-6df1-4f29-87b5-56427e1a21fd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:38.541011 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9ff47c66-6df1-4f29-87b5-56427e1a21fd admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:38.542242 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-9ff47c66-6df1-4f29-87b5-56427e1a21fd admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/32893b03-99d4-450b-ae03-f026f7e45107 HTTP/1.1" status: 204 len: 168 time: 0.1301160 Dec 24 05:04:38.562407 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ff47c66-6df1-4f29-87b5-56427e1a21fd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=32893b03-99d4-450b-ae03-f026f7e45107,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:38.599822 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-090a56be-22b3-48d1-a408-9e53c9d5a58d req-5ef545ed-acf2-4ba2-b617-c5169b55a7ca tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:38.601358 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-090a56be-22b3-48d1-a408-9e53c9d5a58d req-5ef545ed-acf2-4ba2-b617-c5169b55a7ca tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 943 time: 0.0535188 Dec 24 05:04:38.648750 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-090a56be-22b3-48d1-a408-9e53c9d5a58d req-2fb239ff-851f-45a5-8bff-bd5ffa4b95e0 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413311 Dec 24 05:04:39.073924 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbea22d7-f644-4c40-a02e-0d938a5a0197 req-2d305e20-28f8-4253-8897-ebfa52794887 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:39.075419 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-cbea22d7-f644-4c40-a02e-0d938a5a0197 req-2d305e20-28f8-4253-8897-ebfa52794887 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0515110 Dec 24 05:04:39.133783 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-cbea22d7-f644-4c40-a02e-0d938a5a0197 req-9a8b6208-5ba5-4fca-9de7-b74be0d731b9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0508308 Dec 24 05:04:39.769354 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22060656-7337-4293-9164-b324dd9cdb6b req-0c4c3df1-8733-419b-84e4-afe2a5bc4387 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:39.771688 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-22060656-7337-4293-9164-b324dd9cdb6b req-0c4c3df1-8733-419b-84e4-afe2a5bc4387 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 943 time: 0.0508778 Dec 24 05:04:39.822425 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-22060656-7337-4293-9164-b324dd9cdb6b req-f7a5a3e4-6739-4204-9af1-dcadcec823ea tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446036 Dec 24 05:04:40.262129 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b31c800b-6e76-48b0-91b3-ca3e1a6dc7a7 req-34f7dfd6-ba95-4cc5-8978-8fb7dbf6c4fd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:40.263751 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b31c800b-6e76-48b0-91b3-ca3e1a6dc7a7 req-34f7dfd6-ba95-4cc5-8978-8fb7dbf6c4fd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0492504 Dec 24 05:04:40.313065 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-b31c800b-6e76-48b0-91b3-ca3e1a6dc7a7 req-634d88db-54f2-44d8-852d-2a6e6bc0a366 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429156 Dec 24 05:04:40.319211 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 39c2b5d9-53b6-46c0-9a86-f5429051b77c details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 05:04:40.420626 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 39c2b5d9-53b6-46c0-9a86-f5429051b77c, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=39c2b5d9-53b6-46c0-9a86-f5429051b77c,segment=NetworkSegment(45cba16b-d4c1-40eb-8945-69769d27d2b7),segment_id=45cba16b-d4c1-40eb-8945-69769d27d2b7)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:04:40.431852 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': '39c2b5d9-53b6-46c0-9a86-f5429051b77c', 'network_id': '7d6d1704-2ca9-4ba7-a7ef-cd394e15a741', 'port_id': '39c2b5d9-53b6-46c0-9a86-f5429051b77c', 'mac_address': 'fa:16:3e:84:a3:41', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 122, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '42c4f72c-ce3e-4cb1-9111-06a2ac0d1641', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 05:04:40.469704 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:40.482778 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 39c2b5d9-53b6-46c0-9a86-f5429051b77c {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:04:40.502646 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 39c2b5d9-53b6-46c0-9a86-f5429051b77c, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=39c2b5d9-53b6-46c0-9a86-f5429051b77c,segment=NetworkSegment(45cba16b-d4c1-40eb-8945-69769d27d2b7),segment_id=45cba16b-d4c1-40eb-8945-69769d27d2b7)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:04:40.507333 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:40.554591 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=39c2b5d9-53b6-46c0-9a86-f5429051b77c,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:40.955223 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7e17db0-0295-46b6-a3eb-8b25c5d19f6f req-172c3bcb-9559-4095-8503-4025351a9e72 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:40.956806 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c7e17db0-0295-46b6-a3eb-8b25c5d19f6f req-172c3bcb-9559-4095-8503-4025351a9e72 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 944 time: 0.0618677 Dec 24 05:04:41.005094 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c7e17db0-0295-46b6-a3eb-8b25c5d19f6f req-1ee452ad-a87f-463a-aeef-51304c994d0c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399754 Dec 24 05:04:41.434972 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-704004cd-b31c-4fa4-a242-df0247ba39ec req-1088604d-43c4-4202-b56b-d2700ef529ac tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:41.436346 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-704004cd-b31c-4fa4-a242-df0247ba39ec req-1088604d-43c4-4202-b56b-d2700ef529ac tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0517149 Dec 24 05:04:41.489001 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-704004cd-b31c-4fa4-a242-df0247ba39ec req-09aa52e6-4cf2-4d28-b813-344663b15447 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441496 Dec 24 05:04:42.126376 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1397ff-ea1a-4440-8423-ddececbe9cb7 req-71421d45-9ecc-42fc-a744-502f6cefc64f tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:42.127766 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-df1397ff-ea1a-4440-8423-ddececbe9cb7 req-71421d45-9ecc-42fc-a744-502f6cefc64f tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 944 time: 0.0504601 Dec 24 05:04:42.176005 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-df1397ff-ea1a-4440-8423-ddececbe9cb7 req-c45dc556-300f-41f1-8f02-42912717b076 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422053 Dec 24 05:04:42.623710 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77d1af07-99ad-41c7-b82b-affcfea62600 req-f0b5a8d5-6b45-47df-abea-e9850b5bebbc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:42.625226 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-77d1af07-99ad-41c7-b82b-affcfea62600 req-f0b5a8d5-6b45-47df-abea-e9850b5bebbc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0560076 Dec 24 05:04:42.676215 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-77d1af07-99ad-41c7-b82b-affcfea62600 req-2f06855e-b95a-4934-a75b-e513076e4c19 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420194 Dec 24 05:04:42.901920 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['39c2b5d9-53b6-46c0-9a86-f5429051b77c'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:04:43.306203 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72a7974a-5766-4fee-8d58-4bcb225c3f95 req-c2076a7d-4210-4d63-9c3f-b18efd2a7a5d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:43.315974 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-72a7974a-5766-4fee-8d58-4bcb225c3f95 req-c2076a7d-4210-4d63-9c3f-b18efd2a7a5d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 944 time: 0.0557928 Dec 24 05:04:43.370665 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-72a7974a-5766-4fee-8d58-4bcb225c3f95 req-8e0c348f-6945-405c-b399-c146711f2ed5 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454180 Dec 24 05:04:43.803447 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b00c830-2211-4fca-b885-b2dbfcd1c8a5 req-0f41f1b3-3a9b-4c9d-b77d-b996b08a7eb0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:43.804950 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6b00c830-2211-4fca-b885-b2dbfcd1c8a5 req-0f41f1b3-3a9b-4c9d-b77d-b996b08a7eb0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0499961 Dec 24 05:04:43.861323 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6b00c830-2211-4fca-b885-b2dbfcd1c8a5 req-c87e91ba-0462-4f42-823c-e4754f54b723 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0497141 Dec 24 05:04:43.864811 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 39c2b5d9-53b6-46c0-9a86-f5429051b77c up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:04:43.919119 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning for port 39c2b5d9-53b6-46c0-9a86-f5429051b77c completed by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 24 05:04:43.923722 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port 39c2b5d9-53b6-46c0-9a86-f5429051b77c triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:04:43.924500 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:44.005091 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:44.033150 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '153cfba1-0ed2-49c8-9da9-c34aa958b46b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '39c2b5d9-53b6-46c0-9a86-f5429051b77c'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:04:44.035568 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fb01515c-271c-44d4-93ff-3aefacbb3997" -d '{"events": [{"server_uuid": "153cfba1-0ed2-49c8-9da9-c34aa958b46b", "name": "network-vif-plugged", "status": "completed", "tag": "39c2b5d9-53b6-46c0-9a86-f5429051b77c"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:04:44.047813 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 39c2b5d9-53b6-46c0-9a86-f5429051b77c, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=39c2b5d9-53b6-46c0-9a86-f5429051b77c,segment=NetworkSegment(45cba16b-d4c1-40eb-8945-69769d27d2b7),segment_id=45cba16b-d4c1-40eb-8945-69769d27d2b7)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:04:44.053921 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:44.054815 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 61ec3441-5b75-4c07-b8ad-4174450d6a55 no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:04:44.103054 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:04:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7e72da18-b477-4e7b-815b-5ef3a1cf681a x-openstack-request-id: req-7e72da18-b477-4e7b-815b-5ef3a1cf681a {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:04:44.103336 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "153cfba1-0ed2-49c8-9da9-c34aa958b46b", "name": "network-vif-plugged", "status": "completed", "tag": "39c2b5d9-53b6-46c0-9a86-f5429051b77c", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:04:44.103682 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-7e72da18-b477-4e7b-815b-5ef3a1cf681a {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:04:44.103966 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '153cfba1-0ed2-49c8-9da9-c34aa958b46b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '39c2b5d9-53b6-46c0-9a86-f5429051b77c', 'code': 200} Dec 24 05:04:44.134305 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=39c2b5d9-53b6-46c0-9a86-f5429051b77c,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:44.396401 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dfa7b0a-b321-486f-917d-8ad68e8185a3 req-db9f8ab6-1525-4bbb-9b7e-d674a9e7cf8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:44.397974 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9dfa7b0a-b321-486f-917d-8ad68e8185a3 req-db9f8ab6-1525-4bbb-9b7e-d674a9e7cf8d service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 1098 time: 0.0455554 Dec 24 05:04:44.462961 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9dfa7b0a-b321-486f-917d-8ad68e8185a3 req-2a75c6eb-9bb8-45e1-83b8-e2d061ac0d8a service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0559771 Dec 24 05:04:44.501105 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d91914c-65f9-4a0c-b7cc-1175eeac71ae req-38a4cc88-b6a6-4fdb-9bf4-d0cc99a88c74 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:44.505439 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5d91914c-65f9-4a0c-b7cc-1175eeac71ae req-38a4cc88-b6a6-4fdb-9bf4-d0cc99a88c74 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 945 time: 0.0567183 Dec 24 05:04:44.566393 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5d91914c-65f9-4a0c-b7cc-1175eeac71ae req-5826c492-6684-43fe-aa79-aee7233ebb46 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0545301 Dec 24 05:04:44.648942 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 59774) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:44.773443 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-cf83d490-6e4f-4559-93a3-ef7f5ff55de4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:44.855823 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-cf83d490-6e4f-4559-93a3-ef7f5ff55de4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:44.861691 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-cf83d490-6e4f-4559-93a3-ef7f5ff55de4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:44.904408 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-cf83d490-6e4f-4559-93a3-ef7f5ff55de4 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=d8349f37b35345c4a0e662431f5ddf08&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2518246 Dec 24 05:04:44.904940 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 59798) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:44.913847 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf83d490-6e4f-4559-93a3-ef7f5ff55de4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9ebb3e61-8073-4ffe-9152-c9b051d817b4,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:44.972907 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d0180e46-bbff-4210-a88f-ae89451f04ea admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:44.994647 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d0180e46-bbff-4210-a88f-ae89451f04ea admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:45.043061 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d0180e46-bbff-4210-a88f-ae89451f04ea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:45.045748 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d0180e46-bbff-4210-a88f-ae89451f04ea admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:45.046898 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-d0180e46-bbff-4210-a88f-ae89451f04ea admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/9ebb3e61-8073-4ffe-9152-c9b051d817b4 HTTP/1.1" status: 204 len: 168 time: 0.1411650 Dec 24 05:04:45.056147 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0180e46-bbff-4210-a88f-ae89451f04ea admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9ebb3e61-8073-4ffe-9152-c9b051d817b4,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:45.067012 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ea3aaa0-baac-4016-8d24-8460398e29f8 req-aab1845b-c569-4f48-b0e2-3b3623ac90e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:45.068549 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2ea3aaa0-baac-4016-8d24-8460398e29f8 req-aab1845b-c569-4f48-b0e2-3b3623ac90e8 service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066&tenant_id=6c9c47f70b8d4da5827a8ef4349559ab HTTP/1.1" status: 200 len: 1096 time: 0.1104805 Dec 24 05:04:45.080461 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2154a0a-3186-412e-9306-39b256b1fd28 req-b935d9e1-fd38-4b87-8cb3-d7e990e3f1bf tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:45.081797 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d2154a0a-3186-412e-9306-39b256b1fd28 req-b935d9e1-fd38-4b87-8cb3-d7e990e3f1bf tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0951352 Dec 24 05:04:45.158631 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d2154a0a-3186-412e-9306-39b256b1fd28 req-ac201876-670a-4741-a8b5-abc4022268ac tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0693827 Dec 24 05:04:45.170646 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ea3aaa0-baac-4016-8d24-8460398e29f8 req-8961ec7d-8fe0-4b7a-a018-f9b9daefedcc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:45.170646 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2ea3aaa0-baac-4016-8d24-8460398e29f8 req-8961ec7d-8fe0-4b7a-a018-f9b9daefedcc service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=6c9c47f70b8d4da5827a8ef4349559ab&device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 1096 time: 0.0619061 Dec 24 05:04:45.269536 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ea3aaa0-baac-4016-8d24-8460398e29f8 req-193de182-3b4d-4329-bb17-2c71acfd0ace service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:45.271046 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2ea3aaa0-baac-4016-8d24-8460398e29f8 req-193de182-3b4d-4329-bb17-2c71acfd0ace service neutron] 10.222.0.46 "GET /v2.0/networks?id=c908572e-3b6b-470c-8b88-35b51f1472c6 HTTP/1.1" status: 200 len: 917 time: 0.0920558 Dec 24 05:04:45.343746 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2ea3aaa0-baac-4016-8d24-8460398e29f8 req-8c84023a-e20c-4f98-8db5-86f0a2ec9a9f service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=61ec3441-5b75-4c07-b8ad-4174450d6a55 HTTP/1.1" status: 200 len: 998 time: 0.0650549 Dec 24 05:04:45.395377 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ea3aaa0-baac-4016-8d24-8460398e29f8 req-01367cd4-3c95-4e89-8fff-be66015f5b9b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:45.396894 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2ea3aaa0-baac-4016-8d24-8460398e29f8 req-01367cd4-3c95-4e89-8fff-be66015f5b9b service neutron] 10.222.0.46 "GET /v2.0/subnets?id=699b398d-7f9d-4acb-bc18-ac32f35377c3 HTTP/1.1" status: 200 len: 855 time: 0.0438333 Dec 24 05:04:45.458012 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ea3aaa0-baac-4016-8d24-8460398e29f8 req-8e237fe7-64f6-4606-ac8d-02f549fd1214 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:45.459524 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2ea3aaa0-baac-4016-8d24-8460398e29f8 req-8e237fe7-64f6-4606-ac8d-02f549fd1214 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=c908572e-3b6b-470c-8b88-35b51f1472c6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0439045 Dec 24 05:04:45.561589 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2ea3aaa0-baac-4016-8d24-8460398e29f8 req-7909e027-cd3f-48f3-b9af-7031d4c0098d service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0920918 Dec 24 05:04:45.683290 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aeacfe0-dc0c-4251-b4d8-b2c322fbee0e req-9f3493a7-38b4-4fc7-8641-dd76c8b12a9d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:45.691176 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0aeacfe0-dc0c-4251-b4d8-b2c322fbee0e req-9f3493a7-38b4-4fc7-8641-dd76c8b12a9d tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 945 time: 0.0606334 Dec 24 05:04:45.695739 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2ea3aaa0-baac-4016-8d24-8460398e29f8 req-91a0bf07-df6d-42ad-8102-d547e57ac315 service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1224964 Dec 24 05:04:45.745365 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0aeacfe0-dc0c-4251-b4d8-b2c322fbee0e req-52d06d2c-53d1-48e5-8708-352af7fd92ac tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0530679 Dec 24 05:04:45.807104 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 59838) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:45.937693 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e5eaa42d-678f-4b37-b868-98da402f4808 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:46.045822 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e5eaa42d-678f-4b37-b868-98da402f4808 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:46.050820 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e5eaa42d-678f-4b37-b868-98da402f4808 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:46.079702 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5eaa42d-678f-4b37-b868-98da402f4808 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=28784f31-a7e2-4870-8919-66b4a9e6b05c,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:46.110580 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-e5eaa42d-678f-4b37-b868-98da402f4808 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=94b0efa3b1b943729e07087056f4d018&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3023465 Dec 24 05:04:46.114087 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 59868) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:46.165897 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3a5c5d50-b1cf-45c0-a2b2-4dc8db352e1d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:46.187770 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3a5c5d50-b1cf-45c0-a2b2-4dc8db352e1d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:46.277846 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3a5c5d50-b1cf-45c0-a2b2-4dc8db352e1d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:46.280836 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3a5c5d50-b1cf-45c0-a2b2-4dc8db352e1d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:46.286519 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-3a5c5d50-b1cf-45c0-a2b2-4dc8db352e1d admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/28784f31-a7e2-4870-8919-66b4a9e6b05c HTTP/1.1" status: 204 len: 168 time: 0.1709363 Dec 24 05:04:46.307356 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a5c5d50-b1cf-45c0-a2b2-4dc8db352e1d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=28784f31-a7e2-4870-8919-66b4a9e6b05c,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:46.331014 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3973f51-71f0-4f90-af20-9df5b6f0a9c3 req-161882fa-9038-4c67-8877-58e2ab1d9390 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:46.332757 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e3973f51-71f0-4f90-af20-9df5b6f0a9c3 req-161882fa-9038-4c67-8877-58e2ab1d9390 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0914228 Dec 24 05:04:46.420612 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e3973f51-71f0-4f90-af20-9df5b6f0a9c3 req-f4484d4e-084b-457d-b769-e72b5ec895fd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0775838 Dec 24 05:04:46.773322 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 59890) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:46.788467 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-f8829c8a-3294-4ab0-a6e1-876503bc3305 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:46.884303 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fe577c9-3a51-4d51-af5c-2323a43d0ec2 req-952913bd-950c-40bd-8cd3-c334107a6e62 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:46.889033 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6fe577c9-3a51-4d51-af5c-2323a43d0ec2 req-952913bd-950c-40bd-8cd3-c334107a6e62 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 945 time: 0.0598578 Dec 24 05:04:46.898820 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-f8829c8a-3294-4ab0-a6e1-876503bc3305 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:46.903129 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-f8829c8a-3294-4ab0-a6e1-876503bc3305 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:46.946438 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-f8829c8a-3294-4ab0-a6e1-876503bc3305 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=cdf88440ef9d48faa4d040ef02c72e80&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1720362 Dec 24 05:04:46.947466 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8829c8a-3294-4ab0-a6e1-876503bc3305 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aa490e0b-a928-4f63-9086-396d41577905,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:46.949968 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 59894) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:46.970984 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6fe577c9-3a51-4d51-af5c-2323a43d0ec2 req-b44ffcc3-a955-42ee-9d88-cc5f2b2d4262 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0786548 Dec 24 05:04:47.002059 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-96e87add-c6e6-4c30-a04a-ffa4d1da10c1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:47.025130 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-96e87add-c6e6-4c30-a04a-ffa4d1da10c1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:47.069934 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-96e87add-c6e6-4c30-a04a-ffa4d1da10c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:47.072478 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-96e87add-c6e6-4c30-a04a-ffa4d1da10c1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:47.073681 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-96e87add-c6e6-4c30-a04a-ffa4d1da10c1 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/aa490e0b-a928-4f63-9086-396d41577905 HTTP/1.1" status: 204 len: 168 time: 0.1226366 Dec 24 05:04:47.081535 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96e87add-c6e6-4c30-a04a-ffa4d1da10c1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa490e0b-a928-4f63-9086-396d41577905,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:47.388365 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 59910) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:47.535474 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e0523f3a-ff93-4cb7-821e-6343ae07e05e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:47.540845 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 59918) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:47.566360 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca89abdc-2028-4467-9dcd-7ed0146c10c8 req-8032f73f-5975-40cc-b00a-eec615ab3722 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:47.566921 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-361e94ce-4e30-4f1e-ab20-8c44610b6ddd admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:47.571049 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ca89abdc-2028-4467-9dcd-7ed0146c10c8 req-8032f73f-5975-40cc-b00a-eec615ab3722 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0666389 Dec 24 05:04:47.637167 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ca89abdc-2028-4467-9dcd-7ed0146c10c8 req-0e2dbcb4-b83a-4e2c-8916-58cd9d837fa6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0593340 Dec 24 05:04:47.697873 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e0523f3a-ff93-4cb7-821e-6343ae07e05e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:47.716775 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-361e94ce-4e30-4f1e-ab20-8c44610b6ddd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:47.719555 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e0523f3a-ff93-4cb7-821e-6343ae07e05e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:47.736448 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-361e94ce-4e30-4f1e-ab20-8c44610b6ddd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:47.785189 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-e0523f3a-ff93-4cb7-821e-6343ae07e05e admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=8ddb1ed7045a4c87a30d01df75e67fe4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3956556 Dec 24 05:04:47.787420 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-361e94ce-4e30-4f1e-ab20-8c44610b6ddd admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=052dff1f296648fd8700c9e2e4077c63&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2449284 Dec 24 05:04:47.788267 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0523f3a-ff93-4cb7-821e-6343ae07e05e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=23c944ff-def2-4ea3-81ab-e959e1ff1b1b,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:47.788659 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 59920) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:47.790643 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 59922) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:47.857805 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361e94ce-4e30-4f1e-ab20-8c44610b6ddd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8396e009-2265-4955-9ff3-c65f2d770739,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:47.858724 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-617dc9ac-6392-4090-8657-72e2be88d3a2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:47.863437 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-94a54768-239e-47a2-9dc9-935c97fe89df admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:47.886973 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-617dc9ac-6392-4090-8657-72e2be88d3a2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:47.889731 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-94a54768-239e-47a2-9dc9-935c97fe89df admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:47.943639 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-94a54768-239e-47a2-9dc9-935c97fe89df admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:47.946877 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-94a54768-239e-47a2-9dc9-935c97fe89df admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:47.948782 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-94a54768-239e-47a2-9dc9-935c97fe89df admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/8396e009-2265-4955-9ff3-c65f2d770739 HTTP/1.1" status: 204 len: 168 time: 0.1571522 Dec 24 05:04:47.959580 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94a54768-239e-47a2-9dc9-935c97fe89df admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8396e009-2265-4955-9ff3-c65f2d770739,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:47.961207 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-617dc9ac-6392-4090-8657-72e2be88d3a2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:47.977010 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-617dc9ac-6392-4090-8657-72e2be88d3a2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:47.989544 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-617dc9ac-6392-4090-8657-72e2be88d3a2 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/23c944ff-def2-4ea3-81ab-e959e1ff1b1b HTTP/1.1" status: 204 len: 168 time: 0.1994510 Dec 24 05:04:48.007988 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-617dc9ac-6392-4090-8657-72e2be88d3a2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=23c944ff-def2-4ea3-81ab-e959e1ff1b1b,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:48.371700 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 59938) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:48.389437 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1822219a-6219-4ab8-9601-0a98ca1dc188 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:48.492634 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1822219a-6219-4ab8-9601-0a98ca1dc188 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:48.497845 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1822219a-6219-4ab8-9601-0a98ca1dc188 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:48.541381 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1822219a-6219-4ab8-9601-0a98ca1dc188 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=71310487-2647-41f0-b1cc-9ca326275fc2,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:48.555267 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-1822219a-6219-4ab8-9601-0a98ca1dc188 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=059ea550185c4d8496de18d643d02f50&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1824844 Dec 24 05:04:48.558221 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 59942) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:48.621041 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e1f11d4e-2d48-4d24-b8a5-d7f36bd5c64a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:48.652852 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e1f11d4e-2d48-4d24-b8a5-d7f36bd5c64a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:48.819896 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15cb0075-df6a-4a21-8ea7-8c1235f4a77b req-0528f2fb-625e-44d6-ae58-170b6f9b0c74 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:48.825120 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-15cb0075-df6a-4a21-8ea7-8c1235f4a77b req-0528f2fb-625e-44d6-ae58-170b6f9b0c74 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0977340 Dec 24 05:04:48.837852 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e1f11d4e-2d48-4d24-b8a5-d7f36bd5c64a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:48.840358 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e1f11d4e-2d48-4d24-b8a5-d7f36bd5c64a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:48.841531 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-e1f11d4e-2d48-4d24-b8a5-d7f36bd5c64a admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/71310487-2647-41f0-b1cc-9ca326275fc2 HTTP/1.1" status: 204 len: 168 time: 0.2822232 Dec 24 05:04:48.871225 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1f11d4e-2d48-4d24-b8a5-d7f36bd5c64a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=71310487-2647-41f0-b1cc-9ca326275fc2,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:48.903292 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-15cb0075-df6a-4a21-8ea7-8c1235f4a77b req-b96296dd-edb7-43da-9257-f8b14deb7dd3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0752091 Dec 24 05:04:49.447035 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:49.658467 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 59986) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:49.888787 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2a77d214-0ffe-4149-94cf-b3f9c9105285 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:50.077939 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2a77d214-0ffe-4149-94cf-b3f9c9105285 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:50.093079 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2a77d214-0ffe-4149-94cf-b3f9c9105285 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:50.158704 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a77d214-0ffe-4149-94cf-b3f9c9105285 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8334c2bc-0947-4460-848d-9a4661a02ee7,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:50.167835 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 60006) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:50.168286 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-2a77d214-0ffe-4149-94cf-b3f9c9105285 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=31ca92c4af5e4e50862744de075270b0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5081933 Dec 24 05:04:50.183677 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79e93e45-62ff-4039-9b5b-2af473726bb7 req-0264abe7-0e9e-4fd9-be46-8403c16825c1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:50.185641 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-79e93e45-62ff-4039-9b5b-2af473726bb7 req-0264abe7-0e9e-4fd9-be46-8403c16825c1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.1061513 Dec 24 05:04:50.235890 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-725a59cd-39ee-4e35-b5ed-0f5709e1cc84 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:50.263677 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-79e93e45-62ff-4039-9b5b-2af473726bb7 req-3d851a3c-a25a-4c6a-8178-bc013e1efd65 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0705070 Dec 24 05:04:50.276290 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-725a59cd-39ee-4e35-b5ed-0f5709e1cc84 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:50.340714 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-725a59cd-39ee-4e35-b5ed-0f5709e1cc84 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:50.345348 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-725a59cd-39ee-4e35-b5ed-0f5709e1cc84 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:50.346988 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-725a59cd-39ee-4e35-b5ed-0f5709e1cc84 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/8334c2bc-0947-4460-848d-9a4661a02ee7 HTTP/1.1" status: 204 len: 168 time: 0.1781411 Dec 24 05:04:50.383317 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-725a59cd-39ee-4e35-b5ed-0f5709e1cc84 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8334c2bc-0947-4460-848d-9a4661a02ee7,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:51.250867 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 60026) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:51.393274 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-52c250bc-8a83-43a6-a90a-f9126349a343 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:51.428764 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e61c75e-d6f5-4fe0-aa51-2f62edfc92b4 req-0064a0da-0bc8-4012-8135-a88e609578f5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:51.430175 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8e61c75e-d6f5-4fe0-aa51-2f62edfc92b4 req-0064a0da-0bc8-4012-8135-a88e609578f5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0733044 Dec 24 05:04:51.504935 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8e61c75e-d6f5-4fe0-aa51-2f62edfc92b4 req-2287b35d-23bc-4373-bd19-9276e10bd049 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0675757 Dec 24 05:04:51.527482 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-52c250bc-8a83-43a6-a90a-f9126349a343 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:51.534651 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-52c250bc-8a83-43a6-a90a-f9126349a343 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:51.570002 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52c250bc-8a83-43a6-a90a-f9126349a343 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c40be2a0-fe0f-4c03-a8c4-7eca24de7d59,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:51.575463 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-52c250bc-8a83-43a6-a90a-f9126349a343 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=480ff26f36fb43d1b248b431968dac6d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3235519 Dec 24 05:04:51.578392 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 60032) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:51.631401 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-12dab379-cca2-4a92-bce2-a663aa4dc47c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:51.658888 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-12dab379-cca2-4a92-bce2-a663aa4dc47c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:51.709306 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-12dab379-cca2-4a92-bce2-a663aa4dc47c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:51.712198 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-12dab379-cca2-4a92-bce2-a663aa4dc47c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:51.713423 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-12dab379-cca2-4a92-bce2-a663aa4dc47c admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/c40be2a0-fe0f-4c03-a8c4-7eca24de7d59 HTTP/1.1" status: 204 len: 168 time: 0.1337998 Dec 24 05:04:51.721398 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12dab379-cca2-4a92-bce2-a663aa4dc47c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c40be2a0-fe0f-4c03-a8c4-7eca24de7d59,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:52.004508 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 60038) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:52.017653 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c550ad4f-194a-4567-a5d1-40afd8b99ea9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:52.094164 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c550ad4f-194a-4567-a5d1-40afd8b99ea9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:52.099692 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c550ad4f-194a-4567-a5d1-40afd8b99ea9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:52.138489 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-c550ad4f-194a-4567-a5d1-40afd8b99ea9 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=62dee193b02046ae99be1b2435f49125&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1328580 Dec 24 05:04:52.139343 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c550ad4f-194a-4567-a5d1-40afd8b99ea9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ef5dc4b2-5c86-494d-9d6f-cd397898c40a,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:52.141174 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 60042) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:52.193736 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4e03738d-89ae-457a-8819-7a05a9b425a8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:52.216190 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4e03738d-89ae-457a-8819-7a05a9b425a8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:52.267997 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4e03738d-89ae-457a-8819-7a05a9b425a8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:52.270583 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4e03738d-89ae-457a-8819-7a05a9b425a8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:52.271736 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-4e03738d-89ae-457a-8819-7a05a9b425a8 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/ef5dc4b2-5c86-494d-9d6f-cd397898c40a HTTP/1.1" status: 204 len: 168 time: 0.1294277 Dec 24 05:04:52.279886 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e03738d-89ae-457a-8819-7a05a9b425a8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ef5dc4b2-5c86-494d-9d6f-cd397898c40a,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:52.657137 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f396bf8e-fa05-4804-bf62-62ced5951dc9 req-747f26b8-52f3-4da0-a779-460f35fce2d6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:52.659320 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f396bf8e-fa05-4804-bf62-62ced5951dc9 req-747f26b8-52f3-4da0-a779-460f35fce2d6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0579643 Dec 24 05:04:52.716163 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f396bf8e-fa05-4804-bf62-62ced5951dc9 req-0022870e-608b-4cb7-ac2e-af456311b76a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0507150 Dec 24 05:04:53.024697 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 60066) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:53.128873 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-4f0e3b71-a565-48d9-8433-138b24c52bb6 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1360962144-network', 'tenant_id': 'a5968fe3a7c34a8683d72c203e5f9ee8'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:04:53.156023 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4f0e3b71-a565-48d9-8433-138b24c52bb6 admin admin] Made reservation on behalf of a5968fe3a7c34a8683d72c203e5f9ee8 for: {'network': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:04:53.159051 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4f0e3b71-a565-48d9-8433-138b24c52bb6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for network, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:53.167889 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4f0e3b71-a565-48d9-8433-138b24c52bb6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:53.206216 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-f35f37a6-9444-4f6b-ad55-2989da05abc8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:53.269537 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4f0e3b71-a565-48d9-8433-138b24c52bb6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:53.275710 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4f0e3b71-a565-48d9-8433-138b24c52bb6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:53.304060 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4f0e3b71-a565-48d9-8433-138b24c52bb6 admin admin] vlan segment allocate from pool success with {'vlan_id': 102, 'physical_network': 'physnet1'} {{(pid=102476) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 24 05:04:53.310479 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f0e3b71-a565-48d9-8433-138b24c52bb6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cb44576f-2546-4e20-afab-407eb6c97d1f,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:53.319726 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4f0e3b71-a565-48d9-8433-138b24c52bb6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:53.320375 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.segments_db [None req-4f0e3b71-a565-48d9-8433-138b24c52bb6 admin admin] Added segment 506734a7-0b1d-4335-ba20-33de1fdd20e1 of type vlan for network 87b88184-35d6-4767-9645-5b011933f8bc Dec 24 05:04:53.362935 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4f0e3b71-a565-48d9-8433-138b24c52bb6 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750577486812'] for network, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:53.387637 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4f0e3b71-a565-48d9-8433-138b24c52bb6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for network, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:53.388676 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4f0e3b71-a565-48d9-8433-138b24c52bb6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:53.389331 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4f0e3b71-a565-48d9-8433-138b24c52bb6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:53.422181 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-4f0e3b71-a565-48d9-8433-138b24c52bb6 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.3963661 Dec 24 05:04:53.425496 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 60072) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:53.430676 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-acb23046-0c4c-48bd-ad2f-49fca2a9971a admin admin] Request body: {'subnet': {'network_id': '87b88184-35d6-4767-9645-5b011933f8bc', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1360962144-subnet', 'tenant_id': 'a5968fe3a7c34a8683d72c203e5f9ee8', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:04:53.454623 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f0e3b71-a565-48d9-8433-138b24c52bb6 admin admin] Pushing event updated for resources: {'Network': ['ID=87b88184-35d6-4767-9645-5b011933f8bc,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:53.470642 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-acb23046-0c4c-48bd-ad2f-49fca2a9971a admin admin] Made reservation on behalf of a5968fe3a7c34a8683d72c203e5f9ee8 for: {'subnet': 1} {{(pid=102477) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:04:53.470836 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Network 87b88184-35d6-4767-9645-5b011933f8bc details requested by agent ovs-agent-dv-cinder-816443-2-iscsi with host dv-cinder-816443-2-iscsi {{(pid=102478) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 24 05:04:53.474817 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-acb23046-0c4c-48bd-ad2f-49fca2a9971a admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-29853115'] for subnet, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:53.656776 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-acb23046-0c4c-48bd-ad2f-49fca2a9971a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-29535722', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-29853097'] for subnet, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:53.727209 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acb23046-0c4c-48bd-ad2f-49fca2a9971a admin admin] Pushing event updated for resources: {'Subnet': ['ID=4d500966-7a89-4c72-8648-e3e88308c2c1,revision_number=0']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:53.737794 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acb23046-0c4c-48bd-ad2f-49fca2a9971a admin admin] Checking segment: {'id': '506734a7-0b1d-4335-ba20-33de1fdd20e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '87b88184-35d6-4767-9645-5b011933f8bc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102477) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:04:53.738314 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-acb23046-0c4c-48bd-ad2f-49fca2a9971a admin admin] Network hostable DHCP agents. Network: 87b88184-35d6-4767-9645-5b011933f8bc, hostable agents: ['01bc2530-0600-4d1b-b486-2fd9d63a2d51'], hosted agents: [] {{(pid=102477) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 24 05:04:53.758475 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-acb23046-0c4c-48bd-ad2f-49fca2a9971a admin admin] Network 87b88184-35d6-4767-9645-5b011933f8bc is scheduled to be hosted by DHCP agent 01bc2530-0600-4d1b-b486-2fd9d63a2d51 with binding_index 1 {{(pid=102477) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 24 05:04:53.771226 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-acb23046-0c4c-48bd-ad2f-49fca2a9971a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816443-2-iscsi, 87b88184-35d6-4767-9645-5b011933f8bc) {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:04:53.778357 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-acb23046-0c4c-48bd-ad2f-49fca2a9971a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:53.779089 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-acb23046-0c4c-48bd-ad2f-49fca2a9971a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:53.784682 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a377310-098c-4add-acc4-14562d3ad00d None None] Network 87b88184-35d6-4767-9645-5b011933f8bc requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:04:53.801473 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-acb23046-0c4c-48bd-ad2f-49fca2a9971a admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.3743460 Dec 24 05:04:53.872411 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-661453f5-523c-45c2-9f94-6ec19fd9cc26 req-7c9af84d-4b59-4ef9-b2ec-30da0a5a89c0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:53.879007 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-661453f5-523c-45c2-9f94-6ec19fd9cc26 req-7c9af84d-4b59-4ef9-b2ec-30da0a5a89c0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0573509 Dec 24 05:04:53.932174 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-40afe93f-2d2e-4616-9832-314534997cb9 None None] Network 87b88184-35d6-4767-9645-5b011933f8bc requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:04:53.967888 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-661453f5-523c-45c2-9f94-6ec19fd9cc26 req-6d034c55-787b-43ee-8d0e-08802e0037b2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0864279 Dec 24 05:04:54.465434 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 60092) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:54.471380 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-f660e215-8367-4d5b-a30a-88656aec8727 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1415101796-network', 'tenant_id': '82613f7722894bd39bc3541c53541933'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:04:54.498426 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f660e215-8367-4d5b-a30a-88656aec8727 admin admin] Made reservation on behalf of 82613f7722894bd39bc3541c53541933 for: {'network': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:04:54.501218 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-f660e215-8367-4d5b-a30a-88656aec8727 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for network, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:54.513684 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-f660e215-8367-4d5b-a30a-88656aec8727 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:54.596027 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-f660e215-8367-4d5b-a30a-88656aec8727 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:54.600652 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-f660e215-8367-4d5b-a30a-88656aec8727 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:54.623888 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f660e215-8367-4d5b-a30a-88656aec8727 admin admin] vlan segment allocate from pool success with {'vlan_id': 123, 'physical_network': 'physnet1'} {{(pid=102476) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 24 05:04:54.633400 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f660e215-8367-4d5b-a30a-88656aec8727 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2fa1108c-a223-4137-b8d4-32d998eecec5,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:54.637955 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-f660e215-8367-4d5b-a30a-88656aec8727 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:54.638257 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.segments_db [None req-f660e215-8367-4d5b-a30a-88656aec8727 admin admin] Added segment 1d96c283-f043-47b9-a7db-7331f32cd917 of type vlan for network d89b1f85-fbaf-4ece-8117-3005fa7d9614 Dec 24 05:04:54.677392 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-f660e215-8367-4d5b-a30a-88656aec8727 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750577486812'] for network, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:54.702062 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-f660e215-8367-4d5b-a30a-88656aec8727 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for network, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:54.703038 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f660e215-8367-4d5b-a30a-88656aec8727 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:54.703603 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-f660e215-8367-4d5b-a30a-88656aec8727 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:54.736869 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-f660e215-8367-4d5b-a30a-88656aec8727 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.2695603 Dec 24 05:04:54.739746 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 60094) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:54.744665 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-5f561f1a-5edc-407a-a158-0aa77bb8cf7b admin admin] Request body: {'subnet': {'network_id': 'd89b1f85-fbaf-4ece-8117-3005fa7d9614', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1415101796-subnet', 'tenant_id': '82613f7722894bd39bc3541c53541933', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:04:54.762316 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f660e215-8367-4d5b-a30a-88656aec8727 admin admin] Pushing event updated for resources: {'Network': ['ID=d89b1f85-fbaf-4ece-8117-3005fa7d9614,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:54.769276 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5f561f1a-5edc-407a-a158-0aa77bb8cf7b admin admin] Made reservation on behalf of 82613f7722894bd39bc3541c53541933 for: {'subnet': 1} {{(pid=102477) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:04:54.771575 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-5f561f1a-5edc-407a-a158-0aa77bb8cf7b admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-29853115'] for subnet, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:54.774528 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Network d89b1f85-fbaf-4ece-8117-3005fa7d9614 details requested by agent ovs-agent-dv-cinder-816443-2-iscsi with host dv-cinder-816443-2-iscsi {{(pid=102478) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 24 05:04:54.949601 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-5f561f1a-5edc-407a-a158-0aa77bb8cf7b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-29535722', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-29853097'] for subnet, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:55.011353 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f561f1a-5edc-407a-a158-0aa77bb8cf7b admin admin] Pushing event updated for resources: {'Subnet': ['ID=dcabeee5-831d-43a4-8903-5ce73fbc4953,revision_number=0']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:04:55.028028 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f561f1a-5edc-407a-a158-0aa77bb8cf7b admin admin] Checking segment: {'id': '1d96c283-f043-47b9-a7db-7331f32cd917', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'd89b1f85-fbaf-4ece-8117-3005fa7d9614'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102477) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:04:55.028401 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f561f1a-5edc-407a-a158-0aa77bb8cf7b admin admin] Network hostable DHCP agents. Network: d89b1f85-fbaf-4ece-8117-3005fa7d9614, hostable agents: ['01bc2530-0600-4d1b-b486-2fd9d63a2d51'], hosted agents: [] {{(pid=102477) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 24 05:04:55.055672 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f561f1a-5edc-407a-a158-0aa77bb8cf7b admin admin] Network d89b1f85-fbaf-4ece-8117-3005fa7d9614 is scheduled to be hosted by DHCP agent 01bc2530-0600-4d1b-b486-2fd9d63a2d51 with binding_index 1 {{(pid=102477) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 24 05:04:55.080881 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-5f561f1a-5edc-407a-a158-0aa77bb8cf7b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816443-2-iscsi, d89b1f85-fbaf-4ece-8117-3005fa7d9614) {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:04:55.086350 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f561f1a-5edc-407a-a158-0aa77bb8cf7b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:55.087171 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-5f561f1a-5edc-407a-a158-0aa77bb8cf7b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:55.090217 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d4554d30-3766-4b02-a7f3-0731bbc10061 None None] Network d89b1f85-fbaf-4ece-8117-3005fa7d9614 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:04:55.108294 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b2d50dd-da42-4451-a3f3-0fb569fb0952 req-2a68a3bd-a61d-42c4-af13-847af5898276 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:55.109805 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5b2d50dd-da42-4451-a3f3-0fb569fb0952 req-2a68a3bd-a61d-42c4-af13-847af5898276 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0651355 Dec 24 05:04:55.121524 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-5f561f1a-5edc-407a-a158-0aa77bb8cf7b admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.3732467 Dec 24 05:04:55.159682 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5b2d50dd-da42-4451-a3f3-0fb569fb0952 req-bf06ea74-f770-41a4-8344-2b94641fa292 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434914 Dec 24 05:04:55.201846 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-abcac088-6126-4ed9-9b32-38ae12433354 None None] Network d89b1f85-fbaf-4ece-8117-3005fa7d9614 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:04:55.288697 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-144e5c8f-82e9-4e6c-93b4-bbd1ca74094e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:56.293020 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61b2eff6-30a9-4064-b8d3-23a1513e5c85 req-9b6da726-e684-4298-b9de-ddb432cc652b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:56.294550 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-61b2eff6-30a9-4064-b8d3-23a1513e5c85 req-9b6da726-e684-4298-b9de-ddb432cc652b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0551476 Dec 24 05:04:56.352874 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-61b2eff6-30a9-4064-b8d3-23a1513e5c85 req-d6f29120-2a84-4a3e-82ea-c2075fb941f6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0516229 Dec 24 05:04:56.473243 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:57.483278 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-089a8405-e424-48b2-9a33-161dae5ac37e req-e893b5aa-4524-4a7d-8eaf-90a2e4b27c0f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:57.484816 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-089a8405-e424-48b2-9a33-161dae5ac37e req-e893b5aa-4524-4a7d-8eaf-90a2e4b27c0f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0545785 Dec 24 05:04:57.534016 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-089a8405-e424-48b2-9a33-161dae5ac37e req-7a878253-4698-4e90-81d2-0666bccd34e9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427551 Dec 24 05:04:57.943236 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:58.579518 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:04:58.667924 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e287637-3f13-4247-a323-92e68ba8e6ca req-0bfc0d6d-e981-4ceb-8856-18d0b5a8760e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:58.669469 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4e287637-3f13-4247-a323-92e68ba8e6ca req-0bfc0d6d-e981-4ceb-8856-18d0b5a8760e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0574508 Dec 24 05:04:58.722213 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4e287637-3f13-4247-a323-92e68ba8e6ca req-102772ac-2b0f-430e-9fd2-2490f4262bfa tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0464897 Dec 24 05:04:59.849543 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 60166) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:04:59.865389 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d0d6237-4c41-4520-a311-9cd5d2e65963 req-d64943f4-224d-472b-a504-f6d5c4e1b610 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:04:59.867705 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-2d0d6237-4c41-4520-a311-9cd5d2e65963 req-d64943f4-224d-472b-a504-f6d5c4e1b610 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0569265 Dec 24 05:04:59.922533 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-2d0d6237-4c41-4520-a311-9cd5d2e65963 req-982bc42d-c9b9-4066-ab9b-d237ad850fb4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452511 Dec 24 05:04:59.970392 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-db6c69bf-894b-4809-90a5-1baa2c4b59d9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:00.056632 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-db6c69bf-894b-4809-90a5-1baa2c4b59d9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:00.062132 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-db6c69bf-894b-4809-90a5-1baa2c4b59d9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:00.100002 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db6c69bf-894b-4809-90a5-1baa2c4b59d9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=325031e3-4cc3-4097-b1f7-8d1c16a433e3,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:05:00.105711 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-db6c69bf-894b-4809-90a5-1baa2c4b59d9 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=581598bc4d7e480daf6c17055df54a58&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2551188 Dec 24 05:05:00.108857 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 60170) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:05:00.158539 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-8f17278f-495b-4e2f-a29c-33192e6bb79e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:00.182992 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-8f17278f-495b-4e2f-a29c-33192e6bb79e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:00.238036 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-8f17278f-495b-4e2f-a29c-33192e6bb79e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:00.241496 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-8f17278f-495b-4e2f-a29c-33192e6bb79e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:00.245228 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-8f17278f-495b-4e2f-a29c-33192e6bb79e admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/325031e3-4cc3-4097-b1f7-8d1c16a433e3 HTTP/1.1" status: 204 len: 168 time: 0.1326978 Dec 24 05:05:00.255051 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f17278f-495b-4e2f-a29c-33192e6bb79e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=325031e3-4cc3-4097-b1f7-8d1c16a433e3,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:05:00.413335 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:05:01.052263 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b155405-9f12-4743-9244-11d44e5696f7 req-4209ef87-c9f5-4842-97c4-a84da133ef26 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:01.053808 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1b155405-9f12-4743-9244-11d44e5696f7 req-4209ef87-c9f5-4842-97c4-a84da133ef26 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0565596 Dec 24 05:05:01.115661 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1b155405-9f12-4743-9244-11d44e5696f7 req-aee62391-99f1-46d0-b92e-765933c29b55 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0555856 Dec 24 05:05:02.240989 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ecca4ea-4ae3-46b0-b4cb-2d50856a1560 req-c68cef1a-f5a2-43cd-8ad9-8b60cb86d05e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:02.242349 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5ecca4ea-4ae3-46b0-b4cb-2d50856a1560 req-c68cef1a-f5a2-43cd-8ad9-8b60cb86d05e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0533197 Dec 24 05:05:02.291314 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5ecca4ea-4ae3-46b0-b4cb-2d50856a1560 req-36d6c467-ab5e-4f59-bd73-ea7809a46eb4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430486 Dec 24 05:05:03.413269 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b0ecc3e-93c4-40e4-95e6-50ca0d499113 req-0f45c0e4-0231-454c-8c6d-84b57a6c20c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:03.414720 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8b0ecc3e-93c4-40e4-95e6-50ca0d499113 req-0f45c0e4-0231-454c-8c6d-84b57a6c20c8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0515499 Dec 24 05:05:03.467575 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8b0ecc3e-93c4-40e4-95e6-50ca0d499113 req-eab10f7e-1e14-4756-b4c9-ea5dd83ce4b1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444708 Dec 24 05:05:04.602096 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-330af937-82fa-4030-860f-87603354e8e9 req-2605ffeb-b1c4-4c35-9a33-15528f012207 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:04.603743 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-330af937-82fa-4030-860f-87603354e8e9 req-2605ffeb-b1c4-4c35-9a33-15528f012207 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0512850 Dec 24 05:05:04.652052 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-330af937-82fa-4030-860f-87603354e8e9 req-9cc62611-531e-4990-92c1-fd694d013f33 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416772 Dec 24 05:05:05.778167 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec12e7ff-4d20-4207-91e7-6770f6446483 req-63868b01-6863-4e99-91dc-9bfd6099f24e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:05.779663 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ec12e7ff-4d20-4207-91e7-6770f6446483 req-63868b01-6863-4e99-91dc-9bfd6099f24e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0521815 Dec 24 05:05:05.831196 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ec12e7ff-4d20-4207-91e7-6770f6446483 req-cae83c62-63f7-4667-8041-2840c7f45c20 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454633 Dec 24 05:05:06.968385 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c7ff225-1e15-4a3a-b721-cb8395397e8f req-bd6bf9ec-bf09-4e9c-87e0-10dc5fa431d8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:06.969898 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5c7ff225-1e15-4a3a-b721-cb8395397e8f req-bd6bf9ec-bf09-4e9c-87e0-10dc5fa431d8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0512025 Dec 24 05:05:07.017514 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5c7ff225-1e15-4a3a-b721-cb8395397e8f req-81fa9209-e3d8-410f-9d8b-015a1b5f0444 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415385 Dec 24 05:05:08.139920 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76a2ff0e-4d7e-42a1-8976-f9144e05cfea req-b4d96680-aa77-4cdf-8d92-1af77cba0252 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:08.141380 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-76a2ff0e-4d7e-42a1-8976-f9144e05cfea req-b4d96680-aa77-4cdf-8d92-1af77cba0252 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0475130 Dec 24 05:05:08.188943 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-76a2ff0e-4d7e-42a1-8976-f9144e05cfea req-fe35c363-47f2-43c8-b1ed-2f2c8f59a49e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412471 Dec 24 05:05:09.310680 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d112a27-b477-4fab-b7f5-3322ef224772 req-4c0e9f0a-513d-441a-ad90-d04f9a4325a7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:09.312172 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7d112a27-b477-4fab-b7f5-3322ef224772 req-4c0e9f0a-513d-441a-ad90-d04f9a4325a7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0488634 Dec 24 05:05:09.362684 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7d112a27-b477-4fab-b7f5-3322ef224772 req-a0619bb7-9b2b-4c74-a8ff-891d2cc6e896 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442946 Dec 24 05:05:09.924330 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 60294) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:05:09.980093 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.db_base_plugin_v2 [None req-e569e955-7150-40fb-b232-bf843527deaf admin admin] Deleting subnet 4d500966-7a89-4c72-8648-e3e88308c2c1 {{(pid=102477) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Dec 24 05:05:09.984933 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e569e955-7150-40fb-b232-bf843527deaf admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:10.026575 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e569e955-7150-40fb-b232-bf843527deaf admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-29535554'] for subnet, precommit_delete_associations {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:10.066066 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e569e955-7150-40fb-b232-bf843527deaf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3590439'] for subnet, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:10.122776 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e569e955-7150-40fb-b232-bf843527deaf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3590440', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-29535541', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-29853072'] for subnet, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:10.154311 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e569e955-7150-40fb-b232-bf843527deaf admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4d500966-7a89-4c72-8648-e3e88308c2c1,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:05:10.163191 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e569e955-7150-40fb-b232-bf843527deaf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:10.166348 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-e569e955-7150-40fb-b232-bf843527deaf admin admin] 10.222.0.43 "DELETE /v2.0/subnets/4d500966-7a89-4c72-8648-e3e88308c2c1 HTTP/1.1" status: 204 len: 168 time: 0.2399054 Dec 24 05:05:10.167852 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e569e955-7150-40fb-b232-bf843527deaf admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.168202 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e569e955-7150-40fb-b232-bf843527deaf admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.168562 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e569e955-7150-40fb-b232-bf843527deaf admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.168901 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e569e955-7150-40fb-b232-bf843527deaf admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.169231 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e569e955-7150-40fb-b232-bf843527deaf admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.169352 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 60300) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:05:10.169556 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e569e955-7150-40fb-b232-bf843527deaf admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.169881 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e569e955-7150-40fb-b232-bf843527deaf admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.170204 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e569e955-7150-40fb-b232-bf843527deaf admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.170524 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e569e955-7150-40fb-b232-bf843527deaf admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.170847 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e569e955-7150-40fb-b232-bf843527deaf admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.171172 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e569e955-7150-40fb-b232-bf843527deaf admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.171485 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e569e955-7150-40fb-b232-bf843527deaf admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.171825 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e569e955-7150-40fb-b232-bf843527deaf admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.494100 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66145f81-f854-41c1-aa54-f20a824758a3 req-cdf015d2-8731-48c1-9b0e-e9deb25c9d41 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:10.495677 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-66145f81-f854-41c1-aa54-f20a824758a3 req-cdf015d2-8731-48c1-9b0e-e9deb25c9d41 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0564017 Dec 24 05:05:10.503474 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3741433'] for network, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:10.548221 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-66145f81-f854-41c1-aa54-f20a824758a3 req-d5d543cb-803f-4df7-bcb8-a2b16811c5af tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458512 Dec 24 05:05:10.580567 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3595960', 'neutron.services.segments.db._delete_segments_for_network-8750577966942'] for network, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:10.601139 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['87b88184-35d6-4767-9645-5b011933f8bc']}} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:05:10.610947 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '506734a7-0b1d-4335-ba20-33de1fdd20e1') {'for_net_delete': True} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:05:10.611238 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '506734a7-0b1d-4335-ba20-33de1fdd20e1') {} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:05:10.621123 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750577970535', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-32509733'] for segment, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:10.634713 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:10.642384 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] Releasing vlan 102 on physical network physnet1 to pool {{(pid=102476) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 24 05:05:10.642860 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-32528320'] for segment, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: Traceback (most recent call last): Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: timer() Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: cb(*args, **kw) Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: return func(*args, **kwargs) Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: self._notify() Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: self.callback(batched_events) Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: event.method(event) Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: aggregate_uuid = self.p_client.list_aggregates( Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: return f(self, *a, **k) Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: return self._get(url).json() Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: return self.request(url, 'GET', **kwargs) Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: base_url = self.get_endpoint(auth, allow=allow, Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 24 05:05:10.645042 dv-cinder-816443-2-iscsi neutron-server[102476]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 24 05:05:10.709654 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3595937', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-546046'] for network, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:10.714388 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:10.717829 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] 10.222.0.43 "DELETE /v2.0/networks/87b88184-35d6-4767-9645-5b011933f8bc HTTP/1.1" status: 204 len: 168 time: 0.5475056 Dec 24 05:05:10.720790 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 60306) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:05:10.729905 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] Pushing event deleted for resources: {'Network': ['ID=87b88184-35d6-4767-9645-5b011933f8bc,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:05:10.736764 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.737111 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.737448 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.737778 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.738103 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.738425 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.738746 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.739064 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.739382 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.739700 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.740013 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.740348 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.740689 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e867aaa8-ba13-4f8e-9a1b-8b3668e8289b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:10.766710 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.db_base_plugin_v2 [None req-cde1cfb0-e311-4627-a3f5-e2a43075aea4 admin admin] Deleting subnet dcabeee5-831d-43a4-8903-5ce73fbc4953 {{(pid=102477) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Dec 24 05:05:10.770958 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-cde1cfb0-e311-4627-a3f5-e2a43075aea4 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:10.807876 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-cde1cfb0-e311-4627-a3f5-e2a43075aea4 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-29535554'] for subnet, precommit_delete_associations {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:10.853677 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-cde1cfb0-e311-4627-a3f5-e2a43075aea4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3590439'] for subnet, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:10.913022 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-cde1cfb0-e311-4627-a3f5-e2a43075aea4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3590440', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-29535541', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-29853072'] for subnet, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:10.938880 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cde1cfb0-e311-4627-a3f5-e2a43075aea4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=dcabeee5-831d-43a4-8903-5ce73fbc4953,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:05:10.943475 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-cde1cfb0-e311-4627-a3f5-e2a43075aea4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:10.947180 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-cde1cfb0-e311-4627-a3f5-e2a43075aea4 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/dcabeee5-831d-43a4-8903-5ce73fbc4953 HTTP/1.1" status: 204 len: 168 time: 0.2252846 Dec 24 05:05:10.950717 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 60308) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:05:11.018635 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eea1cff5-d236-4cae-88cc-9b11982ffbad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3741433'] for network, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:11.098036 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eea1cff5-d236-4cae-88cc-9b11982ffbad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3595960', 'neutron.services.segments.db._delete_segments_for_network-8750577966942'] for network, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:11.117383 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.services.segments.db [None req-eea1cff5-d236-4cae-88cc-9b11982ffbad admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d89b1f85-fbaf-4ece-8117-3005fa7d9614']}} {{(pid=102477) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:05:11.126485 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.services.segments.db [None req-eea1cff5-d236-4cae-88cc-9b11982ffbad admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1d96c283-f043-47b9-a7db-7331f32cd917') {'for_net_delete': True} {{(pid=102477) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:05:11.126785 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.services.segments.db [None req-eea1cff5-d236-4cae-88cc-9b11982ffbad admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1d96c283-f043-47b9-a7db-7331f32cd917') {} {{(pid=102477) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:05:11.135963 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eea1cff5-d236-4cae-88cc-9b11982ffbad admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750577970535', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-29535605'] for segment, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:11.151176 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eea1cff5-d236-4cae-88cc-9b11982ffbad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:11.157558 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-eea1cff5-d236-4cae-88cc-9b11982ffbad admin admin] Releasing vlan 123 on physical network physnet1 to pool {{(pid=102477) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 24 05:05:11.157934 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eea1cff5-d236-4cae-88cc-9b11982ffbad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29532823'] for segment, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: Traceback (most recent call last): Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: timer() Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: cb(*args, **kw) Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: return func(*args, **kwargs) Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: self._notify() Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: self.callback(batched_events) Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: event.method(event) Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: aggregate_uuid = self.p_client.list_aggregates( Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: return f(self, *a, **k) Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: return self._get(url).json() Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: return self.request(url, 'GET', **kwargs) Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: base_url = self.get_endpoint(auth, allow=allow, Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 24 05:05:11.159554 dv-cinder-816443-2-iscsi neutron-server[102477]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 24 05:05:11.216416 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eea1cff5-d236-4cae-88cc-9b11982ffbad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3595937', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-546046'] for network, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:11.221652 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eea1cff5-d236-4cae-88cc-9b11982ffbad admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:11.224810 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-eea1cff5-d236-4cae-88cc-9b11982ffbad admin admin] 10.222.0.43 "DELETE /v2.0/networks/d89b1f85-fbaf-4ece-8117-3005fa7d9614 HTTP/1.1" status: 204 len: 168 time: 0.2731543 Dec 24 05:05:11.235737 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eea1cff5-d236-4cae-88cc-9b11982ffbad admin admin] Pushing event deleted for resources: {'Network': ['ID=d89b1f85-fbaf-4ece-8117-3005fa7d9614,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:05:11.398987 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 60314) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:05:11.440386 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-3b5e7daf-9b5e-4b79-be75-60a5954d741d admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=a5968fe3a7c34a8683d72c203e5f9ee8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0401497 Dec 24 05:05:11.443082 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 60316) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:05:11.501483 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c5401abe-cc10-4e53-96d0-7241a36fd3bc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:11.524329 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c5401abe-cc10-4e53-96d0-7241a36fd3bc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:11.573995 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c5401abe-cc10-4e53-96d0-7241a36fd3bc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:11.577214 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c5401abe-cc10-4e53-96d0-7241a36fd3bc admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:11.579097 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-c5401abe-cc10-4e53-96d0-7241a36fd3bc admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/cb44576f-2546-4e20-afab-407eb6c97d1f HTTP/1.1" status: 204 len: 168 time: 0.1348410 Dec 24 05:05:11.588089 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5401abe-cc10-4e53-96d0-7241a36fd3bc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cb44576f-2546-4e20-afab-407eb6c97d1f,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:05:11.679639 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a3f0f59-9b24-4e5a-9a06-4105f3af29c5 req-c5f458f3-20e1-4abd-9cbd-827eb8545fe6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:11.681245 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5a3f0f59-9b24-4e5a-9a06-4105f3af29c5 req-c5f458f3-20e1-4abd-9cbd-827eb8545fe6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0481749 Dec 24 05:05:11.736801 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5a3f0f59-9b24-4e5a-9a06-4105f3af29c5 req-2a57501d-4bdc-44e9-860f-b3820a0ba4d6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0486088 Dec 24 05:05:11.924639 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 60324) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:05:11.966987 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-442ec870-b863-472c-8da1-cb3c70fb4493 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=82613f7722894bd39bc3541c53541933&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0411756 Dec 24 05:05:11.969668 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 60326) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:05:12.018959 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d5f2dfaf-65f5-4a44-9a90-f0d5a4c33048 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:12.041535 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d5f2dfaf-65f5-4a44-9a90-f0d5a4c33048 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:12.274395 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d5f2dfaf-65f5-4a44-9a90-f0d5a4c33048 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:12.277482 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d5f2dfaf-65f5-4a44-9a90-f0d5a4c33048 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:12.278642 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-d5f2dfaf-65f5-4a44-9a90-f0d5a4c33048 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/2fa1108c-a223-4137-b8d4-32d998eecec5 HTTP/1.1" status: 204 len: 168 time: 0.3080120 Dec 24 05:05:12.286417 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5f2dfaf-65f5-4a44-9a90-f0d5a4c33048 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2fa1108c-a223-4137-b8d4-32d998eecec5,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:05:12.863947 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a46f74b1-9c6b-4b00-a027-53129943301e req-1ee53e26-401c-46b6-a9cd-707266346a89 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:12.865544 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a46f74b1-9c6b-4b00-a027-53129943301e req-1ee53e26-401c-46b6-a9cd-707266346a89 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0506809 Dec 24 05:05:12.914149 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a46f74b1-9c6b-4b00-a027-53129943301e req-32333461-45c6-46ef-9819-4e48b15d2fc2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411479 Dec 24 05:05:14.045697 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89a1a581-329c-48ae-9a15-5770af83bfe4 req-116d8850-8264-43b1-912c-f8094c8cf5c6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:14.047191 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-89a1a581-329c-48ae-9a15-5770af83bfe4 req-116d8850-8264-43b1-912c-f8094c8cf5c6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0559523 Dec 24 05:05:14.105244 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-89a1a581-329c-48ae-9a15-5770af83bfe4 req-07d3031b-657d-4cbc-98dc-d2930d418a2e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0495517 Dec 24 05:05:15.238811 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15f39c9d-3ab7-49f6-b4d4-b657a3bb5009 req-cbc20453-1cc6-4da2-989e-754c320ccf0b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:15.240976 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-15f39c9d-3ab7-49f6-b4d4-b657a3bb5009 req-cbc20453-1cc6-4da2-989e-754c320ccf0b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0514450 Dec 24 05:05:15.302396 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-15f39c9d-3ab7-49f6-b4d4-b657a3bb5009 req-4583d0e7-1cc6-432b-acb0-d8277a35476c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0540254 Dec 24 05:05:16.433661 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c6e2513-a85a-4f82-bdb3-877c8c0d92c4 req-a9fbdc4c-d1fe-44af-8142-c56f1b00beec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:16.435518 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2c6e2513-a85a-4f82-bdb3-877c8c0d92c4 req-a9fbdc4c-d1fe-44af-8142-c56f1b00beec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 943 time: 0.0532806 Dec 24 05:05:16.489371 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2c6e2513-a85a-4f82-bdb3-877c8c0d92c4 req-dd594cb2-6b8c-4186-aef6-7bdecfe90a8c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0478547 Dec 24 05:05:16.974731 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 61ec3441-5b75-4c07-b8ad-4174450d6a55 details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 05:05:17.070677 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 61ec3441-5b75-4c07-b8ad-4174450d6a55, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=61ec3441-5b75-4c07-b8ad-4174450d6a55,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:05:17.081462 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': '61ec3441-5b75-4c07-b8ad-4174450d6a55', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'port_id': '61ec3441-5b75-4c07-b8ad-4174450d6a55', 'mac_address': 'fa:16:3e:41:aa:aa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 05:05:17.117187 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:17.129877 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 61ec3441-5b75-4c07-b8ad-4174450d6a55 {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:05:17.152938 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 61ec3441-5b75-4c07-b8ad-4174450d6a55, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=61ec3441-5b75-4c07-b8ad-4174450d6a55,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:05:17.160400 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:17.210422 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=61ec3441-5b75-4c07-b8ad-4174450d6a55,revision_number=9']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:05:17.217648 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:17.217995 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:17.218330 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:17.218661 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:17.218983 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:17.219303 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:17.219626 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:17.219945 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:17.220264 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:17.220581 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:17.220911 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:17.221269 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:17.221591 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:05:17.618768 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbcb3ce0-823e-4553-8a53-12553f40c051 req-30506282-a658-437c-9312-b927e7e78362 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:17.620207 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-bbcb3ce0-823e-4553-8a53-12553f40c051 req-30506282-a658-437c-9312-b927e7e78362 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 944 time: 0.0517597 Dec 24 05:05:17.670686 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-bbcb3ce0-823e-4553-8a53-12553f40c051 req-0ec486bb-2df5-4d1e-886e-cbe0c6950661 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441287 Dec 24 05:05:18.822166 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a4128ee-42b6-489d-959d-af9350802072 req-67f99330-7c98-4133-807e-8996694f5a3d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:18.823660 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3a4128ee-42b6-489d-959d-af9350802072 req-67f99330-7c98-4133-807e-8996694f5a3d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 944 time: 0.0600770 Dec 24 05:05:18.874891 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3a4128ee-42b6-489d-959d-af9350802072 req-825d8acd-c818-4605-9f3e-e849ee2305cd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452609 Dec 24 05:05:20.006984 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05f413a4-8da4-4908-9feb-7553dc2c5a14 req-4bfd433e-29fb-463e-b60f-8191c21aaa2e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:20.008447 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-05f413a4-8da4-4908-9feb-7553dc2c5a14 req-4bfd433e-29fb-463e-b60f-8191c21aaa2e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 944 time: 0.0593562 Dec 24 05:05:20.054664 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-05f413a4-8da4-4908-9feb-7553dc2c5a14 req-70a59c2d-f53b-4db5-940f-eb45b5933c8a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401499 Dec 24 05:05:20.421390 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:21.175856 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-669b029e-c634-4aed-84af-6fd7bdb79322 req-e2379e15-a17f-4f7d-8560-9584ed4e6e41 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:21.177352 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-669b029e-c634-4aed-84af-6fd7bdb79322 req-e2379e15-a17f-4f7d-8560-9584ed4e6e41 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 944 time: 0.0497212 Dec 24 05:05:21.227246 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-669b029e-c634-4aed-84af-6fd7bdb79322 req-ef38c9b6-2985-4495-948a-8c418f9033d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403798 Dec 24 05:05:22.357553 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a691464a-a130-4d5e-963b-b13be993bfa3 req-35bbf489-d6e4-46cb-8b71-71e96fcc61db tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:22.359038 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a691464a-a130-4d5e-963b-b13be993bfa3 req-35bbf489-d6e4-46cb-8b71-71e96fcc61db tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 944 time: 0.0541978 Dec 24 05:05:22.409078 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a691464a-a130-4d5e-963b-b13be993bfa3 req-1649551a-2ce1-4bf2-a556-4a90386a4beb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414577 Dec 24 05:05:23.207009 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-5c87c811-f777-42d9-bc2d-ff4311cc25fe None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:23.470163 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['61ec3441-5b75-4c07-b8ad-4174450d6a55'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:05:23.532727 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b7f9b63-cea4-4f7d-b497-9997b43fa013 req-5790a1ce-74fe-4e0c-afa7-fbd7e74337ec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:23.534195 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3b7f9b63-cea4-4f7d-b497-9997b43fa013 req-5790a1ce-74fe-4e0c-afa7-fbd7e74337ec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 944 time: 0.0526993 Dec 24 05:05:23.581156 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3b7f9b63-cea4-4f7d-b497-9997b43fa013 req-a40dcb59-c81d-4f39-962f-5e3ef79530a7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406611 Dec 24 05:05:24.008443 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c5f9c45-68be-4983-ae38-19bd4a87c930 req-ee981b5d-fd18-4e14-bb91-28e8e1be3a16 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:24.009959 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7c5f9c45-68be-4983-ae38-19bd4a87c930 req-ee981b5d-fd18-4e14-bb91-28e8e1be3a16 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=6c9c47f70b8d4da5827a8ef4349559ab&device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 1097 time: 0.0462964 Dec 24 05:05:24.124785 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c5f9c45-68be-4983-ae38-19bd4a87c930 req-b5bf368b-7ce1-4c67-9243-37d6e4135506 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:24.126189 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7c5f9c45-68be-4983-ae38-19bd4a87c930 req-b5bf368b-7ce1-4c67-9243-37d6e4135506 service neutron] 10.222.0.46 "GET /v2.0/networks?id=c908572e-3b6b-470c-8b88-35b51f1472c6 HTTP/1.1" status: 200 len: 917 time: 0.0909035 Dec 24 05:05:24.194407 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7c5f9c45-68be-4983-ae38-19bd4a87c930 req-eff77d12-f6ad-48dc-8935-1cf2ca128033 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=61ec3441-5b75-4c07-b8ad-4174450d6a55 HTTP/1.1" status: 200 len: 999 time: 0.0605326 Dec 24 05:05:24.252752 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c5f9c45-68be-4983-ae38-19bd4a87c930 req-cf5860c6-95c3-47b6-9d30-708409e69a4b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:24.254246 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7c5f9c45-68be-4983-ae38-19bd4a87c930 req-cf5860c6-95c3-47b6-9d30-708409e69a4b service neutron] 10.222.0.46 "GET /v2.0/subnets?id=699b398d-7f9d-4acb-bc18-ac32f35377c3 HTTP/1.1" status: 200 len: 855 time: 0.0480382 Dec 24 05:05:24.304881 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c5f9c45-68be-4983-ae38-19bd4a87c930 req-e1ad0c99-460e-43f5-a1c0-6b3c2d8b5066 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:24.306380 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7c5f9c45-68be-4983-ae38-19bd4a87c930 req-e1ad0c99-460e-43f5-a1c0-6b3c2d8b5066 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=c908572e-3b6b-470c-8b88-35b51f1472c6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0444999 Dec 24 05:05:24.401581 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7c5f9c45-68be-4983-ae38-19bd4a87c930 req-bf86ddbd-f464-4782-8043-1e9fb39e1a8e service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860445 Dec 24 05:05:24.415791 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 61ec3441-5b75-4c07-b8ad-4174450d6a55 up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:05:24.465154 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port 61ec3441-5b75-4c07-b8ad-4174450d6a55 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:05:24.465569 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:24.501431 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7c5f9c45-68be-4983-ae38-19bd4a87c930 req-45047113-f31d-41ba-9d4f-399442ca592d service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0921447 Dec 24 05:05:24.551209 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:24.575137 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6485c286-d5e3-42e7-bf58-c4685f8c3066', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '61ec3441-5b75-4c07-b8ad-4174450d6a55'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:05:24.577477 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-16b8820d-20f9-4e43-ba38-5aa449ce473f" -d '{"events": [{"server_uuid": "6485c286-d5e3-42e7-bf58-c4685f8c3066", "name": "network-vif-plugged", "status": "completed", "tag": "61ec3441-5b75-4c07-b8ad-4174450d6a55"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:05:24.590032 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 61ec3441-5b75-4c07-b8ad-4174450d6a55, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=61ec3441-5b75-4c07-b8ad-4174450d6a55,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:05:24.595336 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:24.642599 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=61ec3441-5b75-4c07-b8ad-4174450d6a55,revision_number=10']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:05:24.716465 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2711533d-84eb-4cbf-b583-4ba9b0945c66 req-45da7521-4652-4a76-b303-fbf927259abb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:24.718060 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2711533d-84eb-4cbf-b583-4ba9b0945c66 req-45da7521-4652-4a76-b303-fbf927259abb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 946 time: 0.0535049 Dec 24 05:05:24.742964 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:05:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-64af7c91-5e23-4e05-9ca6-963bd33c872c x-openstack-request-id: req-64af7c91-5e23-4e05-9ca6-963bd33c872c {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:05:24.743260 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6485c286-d5e3-42e7-bf58-c4685f8c3066", "name": "network-vif-plugged", "status": "completed", "tag": "61ec3441-5b75-4c07-b8ad-4174450d6a55", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:05:24.744269 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-64af7c91-5e23-4e05-9ca6-963bd33c872c {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:05:24.744269 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6485c286-d5e3-42e7-bf58-c4685f8c3066', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '61ec3441-5b75-4c07-b8ad-4174450d6a55', 'code': 200} Dec 24 05:05:24.772421 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2711533d-84eb-4cbf-b583-4ba9b0945c66 req-1f883f53-602d-48bf-a426-cc58eacce308 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0484130 Dec 24 05:05:25.256067 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-13eed089-7f99-475c-b1ab-4a07d76129ac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:25.431083 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b7a9ad0-1b5b-4278-a8f2-844091183d5c req-5e17a782-c5aa-41fb-ab5e-85903eb4d49f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:25.432647 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8b7a9ad0-1b5b-4278-a8f2-844091183d5c req-5e17a782-c5aa-41fb-ab5e-85903eb4d49f service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 1099 time: 0.0420787 Dec 24 05:05:25.485523 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8b7a9ad0-1b5b-4278-a8f2-844091183d5c req-3eebd2b8-ada5-4c42-a79d-dd9c9fbe4953 service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455265 Dec 24 05:05:25.896806 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f47d93a-7e1c-43ee-bb2d-4d280166f10c req-0e78cc60-97c5-4f5a-bbe7-f9ea30f06659 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:25.898267 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3f47d93a-7e1c-43ee-bb2d-4d280166f10c req-0e78cc60-97c5-4f5a-bbe7-f9ea30f06659 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 946 time: 0.0510812 Dec 24 05:05:25.954014 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3f47d93a-7e1c-43ee-bb2d-4d280166f10c req-26170b46-2a2f-4bb4-8647-ad7698fbd894 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0495796 Dec 24 05:05:26.471996 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:27.086671 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e34eb0f3-b069-4869-a7e7-226532246d78 req-7b4d329d-c916-44ca-8cc7-7ed295d0b8cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:27.088192 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e34eb0f3-b069-4869-a7e7-226532246d78 req-7b4d329d-c916-44ca-8cc7-7ed295d0b8cb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 946 time: 0.0497520 Dec 24 05:05:27.139535 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e34eb0f3-b069-4869-a7e7-226532246d78 req-4063fbf5-5d74-4fca-9378-12a89ac07845 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444386 Dec 24 05:05:27.915785 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:28.283520 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76194800-3c3b-4e45-bbd8-63a8efbd5689 req-3e1d9d1b-f24e-436a-9b76-5114ad7684ec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:28.286168 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-76194800-3c3b-4e45-bbd8-63a8efbd5689 req-3e1d9d1b-f24e-436a-9b76-5114ad7684ec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 946 time: 0.0612333 Dec 24 05:05:28.340760 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-76194800-3c3b-4e45-bbd8-63a8efbd5689 req-4485b435-3712-4f21-a55b-b0209039c1c1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424783 Dec 24 05:05:28.576251 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:28.632361 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de3191ab-4f58-49fc-a993-6600ad24fcda req-2797c2a9-b021-4aae-b56b-40ff5cd3635f tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:28.633869 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-de3191ab-4f58-49fc-a993-6600ad24fcda req-2797c2a9-b021-4aae-b56b-40ff5cd3635f tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 945 time: 0.0534499 Dec 24 05:05:28.683234 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-de3191ab-4f58-49fc-a993-6600ad24fcda req-a9376839-4e14-4a52-97d3-bd35ebba4810 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405955 Dec 24 05:05:29.813072 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16966163-e8eb-4caf-85a7-c45f63ccc59c req-def56ec8-e32c-449b-a5b4-06f715e89131 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:29.814519 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-16966163-e8eb-4caf-85a7-c45f63ccc59c req-def56ec8-e32c-449b-a5b4-06f715e89131 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 945 time: 0.0494974 Dec 24 05:05:29.864904 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-16966163-e8eb-4caf-85a7-c45f63ccc59c req-21c6e481-096a-41f7-abd8-36131a159a69 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442669 Dec 24 05:05:30.736646 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a36f5c99-9b3b-4fde-863b-f74303420054 req-a4fe0381-341a-499c-a1e8-8e691aaf5390 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:30.738354 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a36f5c99-9b3b-4fde-863b-f74303420054 req-a4fe0381-341a-499c-a1e8-8e691aaf5390 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.46 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 945 time: 0.0675480 Dec 24 05:05:30.839365 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-a36f5c99-9b3b-4fde-863b-f74303420054 req-60ffc91e-d5ec-49e5-a1c9-40b2bd491444 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Deleting port 39c2b5d9-53b6-46c0-9a86-f5429051b77c {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:05:30.839666 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-a36f5c99-9b3b-4fde-863b-f74303420054 req-60ffc91e-d5ec-49e5-a1c9-40b2bd491444 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:30.926691 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-a36f5c99-9b3b-4fde-863b-f74303420054 req-60ffc91e-d5ec-49e5-a1c9-40b2bd491444 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] For port 39c2b5d9-53b6-46c0-9a86-f5429051b77c, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=39c2b5d9-53b6-46c0-9a86-f5429051b77c,segment=NetworkSegment(45cba16b-d4c1-40eb-8945-69769d27d2b7),segment_id=45cba16b-d4c1-40eb-8945-69769d27d2b7)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:05:30.927056 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-a36f5c99-9b3b-4fde-863b-f74303420054 req-60ffc91e-d5ec-49e5-a1c9-40b2bd491444 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:30.940717 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-a36f5c99-9b3b-4fde-863b-f74303420054 req-60ffc91e-d5ec-49e5-a1c9-40b2bd491444 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Calling delete_port for 39c2b5d9-53b6-46c0-9a86-f5429051b77c owned by compute:nova {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:05:31.034890 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47982791-9c55-4a62-b711-89d280cd4fb7 req-50a16f9c-977c-4eef-bd5e-d019c20ac2d9 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:05:31.036371 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-47982791-9c55-4a62-b711-89d280cd4fb7 req-50a16f9c-977c-4eef-bd5e-d019c20ac2d9 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/ports?device_id=153cfba1-0ed2-49c8-9da9-c34aa958b46b HTTP/1.1" status: 200 len: 945 time: 0.0968981 Dec 24 05:05:31.119777 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-47982791-9c55-4a62-b711-89d280cd4fb7 req-26473136-c598-44c2-8403-b9c14a505c5c tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.43 "GET /v2.0/security-groups?id=38ca9ba3-47e8-40b7-b947-05d8baaead6e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0738719 Dec 24 05:05:31.139371 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-a36f5c99-9b3b-4fde-863b-f74303420054 req-60ffc91e-d5ec-49e5-a1c9-40b2bd491444 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:31.172046 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60ffc91e-d5ec-49e5-a1c9-40b2bd491444 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Pushing event deleted for resources: {'Port': ['ID=39c2b5d9-53b6-46c0-9a86-f5429051b77c,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:05:31.175147 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['39c2b5d9-53b6-46c0-9a86-f5429051b77c'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:05:31.212010 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-a36f5c99-9b3b-4fde-863b-f74303420054 req-60ffc91e-d5ec-49e5-a1c9-40b2bd491444 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] No DVR routers for this DVR port 39c2b5d9-53b6-46c0-9a86-f5429051b77c on host hv-cinder-81644 {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:05:31.214428 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-a36f5c99-9b3b-4fde-863b-f74303420054 req-60ffc91e-d5ec-49e5-a1c9-40b2bd491444 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:31.217866 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a36f5c99-9b3b-4fde-863b-f74303420054 req-60ffc91e-d5ec-49e5-a1c9-40b2bd491444 tempest-VolumesSnapshotTestJSON-2009104120 tempest-VolumesSnapshotTestJSON-2009104120-project] 10.222.0.46 "DELETE /v2.0/ports/39c2b5d9-53b6-46c0-9a86-f5429051b77c HTTP/1.1" status: 204 len: 173 time: 0.4712203 Dec 24 05:05:31.218339 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '153cfba1-0ed2-49c8-9da9-c34aa958b46b', 'name': 'network-vif-deleted', 'tag': '39c2b5d9-53b6-46c0-9a86-f5429051b77c'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:05:31.220655 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-65095dcf-65a8-4760-9895-88554969a51c" -d '{"events": [{"server_uuid": "153cfba1-0ed2-49c8-9da9-c34aa958b46b", "name": "network-vif-deleted", "tag": "39c2b5d9-53b6-46c0-9a86-f5429051b77c"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:05:31.319323 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:05:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8e36a34a-d866-4bd6-b5d2-79cf171a716b x-openstack-request-id: req-8e36a34a-d866-4bd6-b5d2-79cf171a716b {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:05:31.320736 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "153cfba1-0ed2-49c8-9da9-c34aa958b46b", "name": "network-vif-deleted", "tag": "39c2b5d9-53b6-46c0-9a86-f5429051b77c", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:05:31.321075 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-8e36a34a-d866-4bd6-b5d2-79cf171a716b {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:05:31.321540 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '153cfba1-0ed2-49c8-9da9-c34aa958b46b', 'name': 'network-vif-deleted', 'tag': '39c2b5d9-53b6-46c0-9a86-f5429051b77c', 'status': 'completed', 'code': 200} Dec 24 05:05:37.417246 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:05:37.725406 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 39c2b5d9-53b6-46c0-9a86-f5429051b77c no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:05:37.754829 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] No Port match for: 39c2b5d9-53b6-46c0-9a86-f5429051b77c {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:05:37.755187 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 39c2b5d9-53b6-46c0-9a86-f5429051b77c not bound to the agent host hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:05:50.413171 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:53.204140 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-d506e128-3472-40a9-bf09-4e5c7877d3c9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:54.258130 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 60744) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:05:54.369111 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-37a8b3ff-d739-4622-a4a4-d6fbf91fd67e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:54.442485 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-37a8b3ff-d739-4622-a4a4-d6fbf91fd67e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:54.448453 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-37a8b3ff-d739-4622-a4a4-d6fbf91fd67e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:54.486669 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-37a8b3ff-d739-4622-a4a4-d6fbf91fd67e admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=0c2e4d26df6942dc8eb2702d706f7230&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2275040 Dec 24 05:05:54.487549 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37a8b3ff-d739-4622-a4a4-d6fbf91fd67e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2f957681-e931-4419-a72c-f602359d11ae,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:05:54.489398 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 60748) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:05:54.537303 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-04c92be0-c915-4ce1-a0ae-a2d7fddc91df admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:54.558015 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-04c92be0-c915-4ce1-a0ae-a2d7fddc91df admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:54.610147 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-04c92be0-c915-4ce1-a0ae-a2d7fddc91df admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:54.613006 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-04c92be0-c915-4ce1-a0ae-a2d7fddc91df admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:54.614110 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-04c92be0-c915-4ce1-a0ae-a2d7fddc91df admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/2f957681-e931-4419-a72c-f602359d11ae HTTP/1.1" status: 204 len: 168 time: 0.1231914 Dec 24 05:05:54.622442 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04c92be0-c915-4ce1-a0ae-a2d7fddc91df admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f957681-e931-4419-a72c-f602359d11ae,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:05:55.259759 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-21830a00-c0ce-47e1-b761-a08709280827 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:56.479727 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:57.918817 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:58.569396 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:59.574420 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 60876) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:05:59.624007 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_v2 [None req-f1fcfe9a-4927-4f27-9fdf-2000423d8e55 admin admin] Deleting subnet 42c4f72c-ce3e-4cb1-9111-06a2ac0d1641 {{(pid=102476) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Dec 24 05:05:59.627520 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-f1fcfe9a-4927-4f27-9fdf-2000423d8e55 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:59.661923 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-f1fcfe9a-4927-4f27-9fdf-2000423d8e55 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-32509714'] for subnet, precommit_delete_associations {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:59.701082 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-f1fcfe9a-4927-4f27-9fdf-2000423d8e55 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3590439'] for subnet, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:59.760071 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-f1fcfe9a-4927-4f27-9fdf-2000423d8e55 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3590440', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-32528482', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-32970397'] for subnet, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:59.783014 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1fcfe9a-4927-4f27-9fdf-2000423d8e55 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=42c4f72c-ce3e-4cb1-9111-06a2ac0d1641,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:05:59.790900 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-f1fcfe9a-4927-4f27-9fdf-2000423d8e55 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:59.794933 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-f1fcfe9a-4927-4f27-9fdf-2000423d8e55 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/42c4f72c-ce3e-4cb1-9111-06a2ac0d1641 HTTP/1.1" status: 204 len: 168 time: 0.2194517 Dec 24 05:05:59.797860 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 60880) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:05:59.870197 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7a4bd6b5-6f2d-4a01-9fac-3f14148c2bc9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3741433'] for network, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:59.952048 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7a4bd6b5-6f2d-4a01-9fac-3f14148c2bc9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3595960', 'neutron.services.segments.db._delete_segments_for_network-8750577966942'] for network, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:05:59.971680 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-7a4bd6b5-6f2d-4a01-9fac-3f14148c2bc9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7d6d1704-2ca9-4ba7-a7ef-cd394e15a741']}} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:05:59.981762 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-7a4bd6b5-6f2d-4a01-9fac-3f14148c2bc9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '45cba16b-d4c1-40eb-8945-69769d27d2b7') {'for_net_delete': True} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:05:59.982039 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-7a4bd6b5-6f2d-4a01-9fac-3f14148c2bc9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '45cba16b-d4c1-40eb-8945-69769d27d2b7') {} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:05:59.992145 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7a4bd6b5-6f2d-4a01-9fac-3f14148c2bc9 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750577970535', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-32509733'] for segment, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:00.007277 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7a4bd6b5-6f2d-4a01-9fac-3f14148c2bc9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:00.013945 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7a4bd6b5-6f2d-4a01-9fac-3f14148c2bc9 admin admin] Releasing vlan 122 on physical network physnet1 to pool {{(pid=102476) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 24 05:06:00.014365 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7a4bd6b5-6f2d-4a01-9fac-3f14148c2bc9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-32528320'] for segment, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: Traceback (most recent call last): Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: timer() Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: cb(*args, **kw) Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: return func(*args, **kwargs) Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: self._notify() Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: self.callback(batched_events) Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: event.method(event) Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: aggregate_uuid = self.p_client.list_aggregates( Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: return f(self, *a, **k) Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: return self._get(url).json() Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: return self.request(url, 'GET', **kwargs) Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: base_url = self.get_endpoint(auth, allow=allow, Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 24 05:06:00.015996 dv-cinder-816443-2-iscsi neutron-server[102476]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 24 05:06:00.070886 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7a4bd6b5-6f2d-4a01-9fac-3f14148c2bc9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3595937', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-546046'] for network, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:00.075879 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7a4bd6b5-6f2d-4a01-9fac-3f14148c2bc9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:00.078976 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-7a4bd6b5-6f2d-4a01-9fac-3f14148c2bc9 admin admin] 10.222.0.43 "DELETE /v2.0/networks/7d6d1704-2ca9-4ba7-a7ef-cd394e15a741 HTTP/1.1" status: 204 len: 168 time: 0.2799795 Dec 24 05:06:00.093681 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a4bd6b5-6f2d-4a01-9fac-3f14148c2bc9 admin admin] Pushing event deleted for resources: {'Network': ['ID=7d6d1704-2ca9-4ba7-a7ef-cd394e15a741,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:00.258204 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 60890) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:00.299136 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-3ea9dec0-b07d-476f-a1f6-4bfe323d8958 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=122a6a1d32d648c6938f0b159bb3641c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0397742 Dec 24 05:06:00.301785 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 60892) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:00.357721 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-b4888781-ad16-4859-858b-64d5751ecd3d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:00.379294 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-b4888781-ad16-4859-858b-64d5751ecd3d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:00.431270 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-b4888781-ad16-4859-858b-64d5751ecd3d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:00.435626 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-b4888781-ad16-4859-858b-64d5751ecd3d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:00.437622 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-b4888781-ad16-4859-858b-64d5751ecd3d admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/38ca9ba3-47e8-40b7-b947-05d8baaead6e HTTP/1.1" status: 204 len: 168 time: 0.1345897 Dec 24 05:06:00.449166 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4888781-ad16-4859-858b-64d5751ecd3d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=38ca9ba3-47e8-40b7-b947-05d8baaead6e,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:01.150414 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 60918) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:01.248837 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-a3d06f65-ebdc-430c-aff9-886ddc4d3526 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-953343402-network', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:01.271095 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a3d06f65-ebdc-430c-aff9-886ddc4d3526 admin admin] Made reservation on behalf of f081e71a66b74c3bb12e1bec9d9a5cd1 for: {'network': 1} {{(pid=102477) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:06:01.273494 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a3d06f65-ebdc-430c-aff9-886ddc4d3526 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for network, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:01.285016 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a3d06f65-ebdc-430c-aff9-886ddc4d3526 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:01.361531 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a3d06f65-ebdc-430c-aff9-886ddc4d3526 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:01.365906 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a3d06f65-ebdc-430c-aff9-886ddc4d3526 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:01.389936 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a3d06f65-ebdc-430c-aff9-886ddc4d3526 admin admin] vlan segment allocate from pool success with {'vlan_id': 123, 'physical_network': 'physnet1'} {{(pid=102477) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 24 05:06:01.402450 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3d06f65-ebdc-430c-aff9-886ddc4d3526 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:01.408633 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a3d06f65-ebdc-430c-aff9-886ddc4d3526 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:01.408980 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.db.segments_db [None req-a3d06f65-ebdc-430c-aff9-886ddc4d3526 admin admin] Added segment 2d8c6ac9-499a-46a9-971d-99edaae74aeb of type vlan for network f6c8eead-66df-4cba-abce-78ee3b037ee2 Dec 24 05:06:01.448376 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a3d06f65-ebdc-430c-aff9-886ddc4d3526 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750577486812'] for network, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:01.476074 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a3d06f65-ebdc-430c-aff9-886ddc4d3526 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for network, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:01.477401 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3d06f65-ebdc-430c-aff9-886ddc4d3526 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:01.478151 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a3d06f65-ebdc-430c-aff9-886ddc4d3526 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:01.518872 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-a3d06f65-ebdc-430c-aff9-886ddc4d3526 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.3673050 Dec 24 05:06:01.521750 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 60936) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:01.526632 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-35b14c3f-111f-406f-b21e-a8251928fb25 admin admin] Request body: {'subnet': {'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-953343402-subnet', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'ip_version': 4}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:01.547153 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3d06f65-ebdc-430c-aff9-886ddc4d3526 admin admin] Pushing event updated for resources: {'Network': ['ID=f6c8eead-66df-4cba-abce-78ee3b037ee2,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:01.549908 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-35b14c3f-111f-406f-b21e-a8251928fb25 admin admin] Made reservation on behalf of f081e71a66b74c3bb12e1bec9d9a5cd1 for: {'subnet': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:06:01.552463 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-35b14c3f-111f-406f-b21e-a8251928fb25 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-32970422'] for subnet, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:01.558649 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Network f6c8eead-66df-4cba-abce-78ee3b037ee2 details requested by agent ovs-agent-dv-cinder-816443-2-iscsi with host dv-cinder-816443-2-iscsi {{(pid=102478) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 24 05:06:01.727490 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-35b14c3f-111f-406f-b21e-a8251928fb25 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-32528573', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-32970404'] for subnet, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:01.780922 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35b14c3f-111f-406f-b21e-a8251928fb25 admin admin] Pushing event updated for resources: {'Subnet': ['ID=11836946-2718-402d-9e36-6ad89714906f,revision_number=0']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:01.808065 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-35b14c3f-111f-406f-b21e-a8251928fb25 admin admin] Checking segment: {'id': '2d8c6ac9-499a-46a9-971d-99edaae74aeb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:06:01.808603 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-35b14c3f-111f-406f-b21e-a8251928fb25 admin admin] Network hostable DHCP agents. Network: f6c8eead-66df-4cba-abce-78ee3b037ee2, hostable agents: ['01bc2530-0600-4d1b-b486-2fd9d63a2d51'], hosted agents: [] {{(pid=102476) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 24 05:06:01.829635 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-35b14c3f-111f-406f-b21e-a8251928fb25 admin admin] Network f6c8eead-66df-4cba-abce-78ee3b037ee2 is scheduled to be hosted by DHCP agent 01bc2530-0600-4d1b-b486-2fd9d63a2d51 with binding_index 1 {{(pid=102476) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 24 05:06:01.839384 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-35b14c3f-111f-406f-b21e-a8251928fb25 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816443-2-iscsi, f6c8eead-66df-4cba-abce-78ee3b037ee2) {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:06:01.843629 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-35b14c3f-111f-406f-b21e-a8251928fb25 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:01.844254 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-35b14c3f-111f-406f-b21e-a8251928fb25 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:01.848625 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ff17e85f-10d0-4aa4-9463-7e4fae2529e9 None None] Network f6c8eead-66df-4cba-abce-78ee3b037ee2 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:06:01.861127 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-35b14c3f-111f-406f-b21e-a8251928fb25 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.3382838 Dec 24 05:06:01.863739 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 60938) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:01.867951 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-83178e58-96a2-4908-b239-e49f295f14b4 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-953343402-router', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:01.890225 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-83178e58-96a2-4908-b239-e49f295f14b4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-546186', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2070334'] for router, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:01.891346 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-83178e58-96a2-4908-b239-e49f295f14b4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-546302', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-549497', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-553463', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2070311'] for router, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:01.949047 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-83178e58-96a2-4908-b239-e49f295f14b4 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:01.953310 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-77a732ba-91d2-4ee4-9e27-f9da441c0bde None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpd2866d45-53d6-5577-9724-7d7a303c375f-f6c8eead-66df-4cba-abce-78ee3b037ee2', 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2', 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'fixed_ips': [{'subnet_id': '11836946-2718-402d-9e36-6ad89714906f'}]}} from dv-cinder-816443-2-iscsi. {{(pid=102478) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 24 05:06:01.954625 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-77a732ba-91d2-4ee4-9e27-f9da441c0bde None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:02.089630 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-83178e58-96a2-4908-b239-e49f295f14b4 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:02.101784 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.db_base_plugin_common [None req-77a732ba-91d2-4ee4-9e27-f9da441c0bde None None] Allocated IP 172.20.0.2 (f6c8eead-66df-4cba-abce-78ee3b037ee2/11836946-2718-402d-9e36-6ad89714906f/b11ddfbb-e4cc-4cb8-95c9-92c0260890d3) {{(pid=102478) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:06:02.250151 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-77a732ba-91d2-4ee4-9e27-f9da441c0bde None None] Publish callbacks [] for port, precommit_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:02.256805 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-77a732ba-91d2-4ee4-9e27-f9da441c0bde None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001'] for port, after_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:02.296784 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-83178e58-96a2-4908-b239-e49f295f14b4 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:02.298495 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-77a732ba-91d2-4ee4-9e27-f9da441c0bde None None] Network f6c8eead-66df-4cba-abce-78ee3b037ee2 is already hosted by enough agents. {{(pid=102478) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:06:02.301502 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.scheduler.base_scheduler [None req-77a732ba-91d2-4ee4-9e27-f9da441c0bde None None] Resources bound (agent type, host, resource id): {{(pid=102478) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:06:02.304097 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77a732ba-91d2-4ee4-9e27-f9da441c0bde None None] Received port after_create {{(pid=102478) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:06:02.314221 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77a732ba-91d2-4ee4-9e27-f9da441c0bde None None] Pushing event updated for resources: {'Port': ['ID=b11ddfbb-e4cc-4cb8-95c9-92c0260890d3,revision_number=1']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:02.318180 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-83178e58-96a2-4908-b239-e49f295f14b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:02.369402 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-77a732ba-91d2-4ee4-9e27-f9da441c0bde None None] Attempting to bind port b11ddfbb-e4cc-4cb8-95c9-92c0260890d3 on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:06:02.369898 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-77a732ba-91d2-4ee4-9e27-f9da441c0bde None None] Attempting to bind port b11ddfbb-e4cc-4cb8-95c9-92c0260890d3 by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': '2d8c6ac9-499a-46a9-971d-99edaae74aeb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2'}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:06:02.370273 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77a732ba-91d2-4ee4-9e27-f9da441c0bde None None] Attempting to bind port b11ddfbb-e4cc-4cb8-95c9-92c0260890d3 on network f6c8eead-66df-4cba-abce-78ee3b037ee2 {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:06:02.376273 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77a732ba-91d2-4ee4-9e27-f9da441c0bde None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 5, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:06:02.376702 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77a732ba-91d2-4ee4-9e27-f9da441c0bde None None] Checking segment: {'id': '2d8c6ac9-499a-46a9-971d-99edaae74aeb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102478) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:06:02.377111 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-77a732ba-91d2-4ee4-9e27-f9da441c0bde None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:02.377503 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77a732ba-91d2-4ee4-9e27-f9da441c0bde None None] Bound using segment: {'id': '2d8c6ac9-499a-46a9-971d-99edaae74aeb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2'} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:06:02.377976 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-77a732ba-91d2-4ee4-9e27-f9da441c0bde None None] Bound port: b11ddfbb-e4cc-4cb8-95c9-92c0260890d3, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2d8c6ac9-499a-46a9-971d-99edaae74aeb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2'}}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:06:02.378353 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-77a732ba-91d2-4ee4-9e27-f9da441c0bde None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:02.425121 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [None req-83178e58-96a2-4908-b239-e49f295f14b4 admin admin] Allocated IP 172.27.1.248 (9b4e4b31-551f-45a9-b26a-cb44ee20a17d/f277b899-8779-420e-8a8d-bfcd5eb7f012/4f7b3b5c-bf57-4538-9238-3f613a19c560) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:06:02.444091 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-77a732ba-91d2-4ee4-9e27-f9da441c0bde None None] For port b11ddfbb-e4cc-4cb8-95c9-92c0260890d3, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102478) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:06:02.447260 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-77a732ba-91d2-4ee4-9e27-f9da441c0bde None None] For port b11ddfbb-e4cc-4cb8-95c9-92c0260890d3, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=b11ddfbb-e4cc-4cb8-95c9-92c0260890d3,segment=NetworkSegment(2d8c6ac9-499a-46a9-971d-99edaae74aeb),segment_id=2d8c6ac9-499a-46a9-971d-99edaae74aeb)] {{(pid=102478) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:06:02.451728 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-77a732ba-91d2-4ee4-9e27-f9da441c0bde None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:02.511802 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77a732ba-91d2-4ee4-9e27-f9da441c0bde None None] Pushing event updated for resources: {'Port': ['ID=b11ddfbb-e4cc-4cb8-95c9-92c0260890d3,revision_number=2']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:02.560169 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-83178e58-96a2-4908-b239-e49f295f14b4 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:02.601168 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-83178e58-96a2-4908-b239-e49f295f14b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:02.640859 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83178e58-96a2-4908-b239-e49f295f14b4 admin admin] Network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:06:02.644062 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-83178e58-96a2-4908-b239-e49f295f14b4 admin admin] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:06:02.647689 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83178e58-96a2-4908-b239-e49f295f14b4 admin admin] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:06:02.688970 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83178e58-96a2-4908-b239-e49f295f14b4 admin admin] Pushing event updated for resources: {'Port': ['ID=4f7b3b5c-bf57-4538-9238-3f613a19c560,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:02.789318 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 60950) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:02.906642 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f90c5131-d29c-428c-8227-a250b3fbf108 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:02.948848 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-83178e58-96a2-4908-b239-e49f295f14b4 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:02.985420 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f90c5131-d29c-428c-8227-a250b3fbf108 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:02.992640 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f90c5131-d29c-428c-8227-a250b3fbf108 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:03.033376 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-f90c5131-d29c-428c-8227-a250b3fbf108 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=706321d3719a489391056adcf33a1953&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2428579 Dec 24 05:06:03.035347 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f90c5131-d29c-428c-8227-a250b3fbf108 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=60762c16-b795-4f84-a309-00ded55fd6e0,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:03.037006 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 60954) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:03.142374 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-07c8d62f-0d15-440f-913d-d7d62c42b236 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:03.204486 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-07c8d62f-0d15-440f-913d-d7d62c42b236 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:03.216144 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-83178e58-96a2-4908-b239-e49f295f14b4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-546295', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-545958'] for router, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:03.439587 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5f9d704-1811-458b-b6d3-23428ed3dcca None None] Network f6c8eead-66df-4cba-abce-78ee3b037ee2 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:06:03.502029 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device b11ddfbb-e4cc-4cb8-95c9-92c0260890d3 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:03.563011 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-be942f6a-858a-4b7e-b5f1-624cb692a3b7 None None] Provisioning complete for port b11ddfbb-e4cc-4cb8-95c9-92c0260890d3 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:03.563384 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-be942f6a-858a-4b7e-b5f1-624cb692a3b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:03.596993 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-07c8d62f-0d15-440f-913d-d7d62c42b236 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:03.599522 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-07c8d62f-0d15-440f-913d-d7d62c42b236 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:03.600694 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-07c8d62f-0d15-440f-913d-d7d62c42b236 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/60762c16-b795-4f84-a309-00ded55fd6e0 HTTP/1.1" status: 204 len: 168 time: 0.5626755 Dec 24 05:06:03.613745 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07c8d62f-0d15-440f-913d-d7d62c42b236 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=60762c16-b795-4f84-a309-00ded55fd6e0,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:03.652420 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-83178e58-96a2-4908-b239-e49f295f14b4 admin admin] Router a17d8253-42dc-43b3-b8fe-d8352c4bfc8f is scheduled to L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 with binding_index 1 {{(pid=102476) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 24 05:06:03.659194 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port b11ddfbb-e4cc-4cb8-95c9-92c0260890d3 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:03.659566 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:03.734600 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-be942f6a-858a-4b7e-b5f1-624cb692a3b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:03.787442 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-83178e58-96a2-4908-b239-e49f295f14b4 admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:06:03.826111 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-83178e58-96a2-4908-b239-e49f295f14b4 admin admin] Publish callbacks [] for router, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:03.831653 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-83178e58-96a2-4908-b239-e49f295f14b4 admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 1.9668279 Dec 24 05:06:03.834537 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 60962) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:03.934274 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] Sync routers for ids ['a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'] in dv-cinder-816443-2-iscsi {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:06:03.937510 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-be942f6a-858a-4b7e-b5f1-624cb692a3b7 None None] For port b11ddfbb-e4cc-4cb8-95c9-92c0260890d3, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=b11ddfbb-e4cc-4cb8-95c9-92c0260890d3,segment=NetworkSegment(2d8c6ac9-499a-46a9-971d-99edaae74aeb),segment_id=2d8c6ac9-499a-46a9-971d-99edaae74aeb)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:06:03.948835 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-be942f6a-858a-4b7e-b5f1-624cb692a3b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:03.953180 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:03.971509 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 60964) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:03.984211 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] Routers {'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:06:03.984873 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:05:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:03.992336 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-04050e35-0126-4400-ad56-5f2b985682dd admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.070250 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-04050e35-0126-4400-ad56-5f2b985682dd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.075437 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-04050e35-0126-4400-ad56-5f2b985682dd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.091566 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be942f6a-858a-4b7e-b5f1-624cb692a3b7 None None] Pushing event updated for resources: {'Port': ['ID=b11ddfbb-e4cc-4cb8-95c9-92c0260890d3,revision_number=3']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:04.114178 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04050e35-0126-4400-ad56-5f2b985682dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c40db8e9-c0f4-41f4-96c1-0ebfdc5b69ce,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:04.118812 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-04050e35-0126-4400-ad56-5f2b985682dd admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=7f903a397bba4a76959a12440840513a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1461725 Dec 24 05:06:04.122023 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 60966) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:04.140894 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.db.api [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102478) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 24 05:06:04.141238 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG oslo_db.api [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 24 05:06:04.149230 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-9090b012-266e-407a-a428-c7d84d389530 None None] Provisioning complete for port b11ddfbb-e4cc-4cb8-95c9-92c0260890d3 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:04.149602 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-9090b012-266e-407a-a428-c7d84d389530 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.178119 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-388faf38-e9f8-4414-944a-93ca4490ff77 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.189501 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] Set router a17d8253-42dc-43b3-b8fe-d8352c4bfc8f gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:06:04.202788 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-388faf38-e9f8-4414-944a-93ca4490ff77 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.262873 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-388faf38-e9f8-4414-944a-93ca4490ff77 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.265684 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-388faf38-e9f8-4414-944a-93ca4490ff77 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.270580 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-388faf38-e9f8-4414-944a-93ca4490ff77 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/c40db8e9-c0f4-41f4-96c1-0ebfdc5b69ce HTTP/1.1" status: 204 len: 168 time: 0.1444666 Dec 24 05:06:04.280912 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-388faf38-e9f8-4414-944a-93ca4490ff77 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c40db8e9-c0f4-41f4-96c1-0ebfdc5b69ce,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:04.325617 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-194d4443-7eb4-4072-a462-f2b7a9f2afe7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.456655 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'name': 'tempest-TestMinimumBasicScenario-953343402-router', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248'}], 'enable_snat': True}, 'gw_port_id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:01Z', 'updated_at': '2021-12-24T05:06:02Z', 'revision_number': 3, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'gw_port': {'id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:e8:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 488, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:02Z', 'updated_at': '2021-12-24T05:06:02Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:04.489146 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] Checking router: a17d8253-42dc-43b3-b8fe-d8352c4bfc8f for host: dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:06:04.489743 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] Updating router a17d8253-42dc-43b3-b8fe-d8352c4bfc8f port 4f7b3b5c-bf57-4538-9238-3f613a19c560 binding host dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 24 05:06:04.506386 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.db_base_plugin_common [None req-194d4443-7eb4-4072-a462-f2b7a9f2afe7 admin admin] Allocated IP 172.20.0.1 (f6c8eead-66df-4cba-abce-78ee3b037ee2/11836946-2718-402d-9e36-6ad89714906f/6dd40189-9984-4e72-8831-3e9d864c65b9) {{(pid=102477) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:06:04.515818 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.622512 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-194d4443-7eb4-4072-a462-f2b7a9f2afe7 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.640346 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 60972) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:04.654087 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6953ba7b-a1e2-4e51-911e-e64c4365dad0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.662207 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-194d4443-7eb4-4072-a462-f2b7a9f2afe7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.709471 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-194d4443-7eb4-4072-a462-f2b7a9f2afe7 admin admin] Network f6c8eead-66df-4cba-abce-78ee3b037ee2 is already hosted by enough agents. {{(pid=102477) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:06:04.713320 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-194d4443-7eb4-4072-a462-f2b7a9f2afe7 admin admin] Resources bound (agent type, host, resource id): {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:06:04.716295 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.l3_dvrscheduler_db [None req-194d4443-7eb4-4072-a462-f2b7a9f2afe7 admin admin] Received port after_create {{(pid=102477) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:06:04.723230 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-194d4443-7eb4-4072-a462-f2b7a9f2afe7 admin admin] Pushing event updated for resources: {'Port': ['ID=6dd40189-9984-4e72-8831-3e9d864c65b9,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:04.741179 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6953ba7b-a1e2-4e51-911e-e64c4365dad0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.747649 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6953ba7b-a1e2-4e51-911e-e64c4365dad0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.768015 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-194d4443-7eb4-4072-a462-f2b7a9f2afe7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-545913'] for router_interface, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.788858 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-6953ba7b-a1e2-4e51-911e-e64c4365dad0 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=015aa8b2f1884bcf8407634c4a01cc22&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1470990 Dec 24 05:06:04.790082 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6953ba7b-a1e2-4e51-911e-e64c4365dad0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2826876e-7cef-487b-b133-929ef074c94a,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:04.792452 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 60974) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:04.828384 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] Publish callbacks [] for port, precommit_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.841570 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.864487 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-69873263-042d-40be-aec8-10e4af384b44 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.887556 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] Attempting to bind port 4f7b3b5c-bf57-4538-9238-3f613a19c560 on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:06:04.888075 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] Attempting to bind port 4f7b3b5c-bf57-4538-9238-3f613a19c560 by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:06:04.888585 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] Attempting to bind port 4f7b3b5c-bf57-4538-9238-3f613a19c560 on network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:06:04.890419 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-69873263-042d-40be-aec8-10e4af384b44 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.901691 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 5, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:06:04.902223 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] Checking segment: {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102478) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:06:04.902752 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.903245 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] Bound using segment: {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:06:04.903832 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] Bound port: 4f7b3b5c-bf57-4538-9238-3f613a19c560, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:06:04.904359 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.939793 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf75b049-2a5c-4e3e-be0b-a56b52026612 None None] Pushing event updated for resources: {'Port': ['ID=4f7b3b5c-bf57-4538-9238-3f613a19c560,revision_number=2']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:04.943488 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-194d4443-7eb4-4072-a462-f2b7a9f2afe7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.954337 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-69873263-042d-40be-aec8-10e4af384b44 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.957381 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-69873263-042d-40be-aec8-10e4af384b44 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:04.958655 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-69873263-042d-40be-aec8-10e4af384b44 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/2826876e-7cef-487b-b133-929ef074c94a HTTP/1.1" status: 204 len: 168 time: 0.1651902 Dec 24 05:06:04.968210 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69873263-042d-40be-aec8-10e4af384b44 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2826876e-7cef-487b-b133-929ef074c94a,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:04.975551 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] For port 4f7b3b5c-bf57-4538-9238-3f613a19c560, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102478) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:06:04.979089 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] For port 4f7b3b5c-bf57-4538-9238-3f613a19c560, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=4f7b3b5c-bf57-4538-9238-3f613a19c560,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102478) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:06:04.992852 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:05.072859 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf75b049-2a5c-4e3e-be0b-a56b52026612 None None] Pushing event updated for resources: {'Port': ['ID=4f7b3b5c-bf57-4538-9238-3f613a19c560,revision_number=3']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:05.075379 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8710f886-4838-412e-a1a4-7df94bb25d91 None None] Provisioning complete for port 6dd40189-9984-4e72-8831-3e9d864c65b9 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:05.075753 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8710f886-4838-412e-a1a4-7df94bb25d91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:05.078807 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] Routers {'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:06:05.079977 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:05:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:05.153646 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8710f886-4838-412e-a1a4-7df94bb25d91 None None] Port 6dd40189-9984-4e72-8831-3e9d864c65b9 cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 05:06:05.160984 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-194d4443-7eb4-4072-a462-f2b7a9f2afe7 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:05.166180 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-194d4443-7eb4-4072-a462-f2b7a9f2afe7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29535615'] for port, after_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:05.220920 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] Set router a17d8253-42dc-43b3-b8fe-d8352c4bfc8f gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:06:05.239884 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-194d4443-7eb4-4072-a462-f2b7a9f2afe7 admin admin] Pushing event updated for resources: {'Port': ['ID=6dd40189-9984-4e72-8831-3e9d864c65b9,revision_number=2']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:05.243140 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-194d4443-7eb4-4072-a462-f2b7a9f2afe7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-627486', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-548585'] for router_interface, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:05.338729 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-194d4443-7eb4-4072-a462-f2b7a9f2afe7 admin admin] Network f6c8eead-66df-4cba-abce-78ee3b037ee2 is already hosted by enough agents. {{(pid=102477) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:06:05.340281 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-194d4443-7eb4-4072-a462-f2b7a9f2afe7 admin admin] Resources bound (agent type, host, resource id): {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:06:05.459445 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'name': 'tempest-TestMinimumBasicScenario-953343402-router', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248'}], 'enable_snat': True}, 'gw_port_id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:01Z', 'updated_at': '2021-12-24T05:06:04Z', 'revision_number': 4, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'gw_port': {'id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:e8:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 488, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:02Z', 'updated_at': '2021-12-24T05:06:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '6dd40189-9984-4e72-8831-3e9d864c65b9', 'name': '', 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'mac_address': 'fa:16:3e:cf:37:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '11836946-2718-402d-9e36-6ad89714906f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:04Z', 'updated_at': '2021-12-24T05:06:04Z', 'revision_number': 1, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'subnets': [{'id': '11836946-2718-402d-9e36-6ad89714906f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:05.481406 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-194d4443-7eb4-4072-a462-f2b7a9f2afe7 admin admin] Router a17d8253-42dc-43b3-b8fe-d8352c4bfc8f has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102477) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:06:05.499516 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa6abb6a-fddb-419a-8915-29535a1894f3 None None] The sync data for ids ['a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'] in dv-cinder-816443-2-iscsi is: [{'id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'name': 'tempest-TestMinimumBasicScenario-953343402-router', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248'}], 'enable_snat': True}, 'gw_port_id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:01Z', 'updated_at': '2021-12-24T05:06:04Z', 'revision_number': 4, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'gw_port': {'id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:e8:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 488, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:02Z', 'updated_at': '2021-12-24T05:06:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '6dd40189-9984-4e72-8831-3e9d864c65b9', 'name': '', 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'mac_address': 'fa:16:3e:cf:37:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '11836946-2718-402d-9e36-6ad89714906f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:04Z', 'updated_at': '2021-12-24T05:06:04Z', 'revision_number': 1, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'subnets': [{'id': '11836946-2718-402d-9e36-6ad89714906f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:06:05.510185 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device b11ddfbb-e4cc-4cb8-95c9-92c0260890d3 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:05.572139 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port b11ddfbb-e4cc-4cb8-95c9-92c0260890d3 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:05.572939 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:05.627253 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-194d4443-7eb4-4072-a462-f2b7a9f2afe7 admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102477) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:06:05.640473 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-194d4443-7eb4-4072-a462-f2b7a9f2afe7 admin admin] 10.222.0.43 "PUT /v2.0/routers/a17d8253-42dc-43b3-b8fe-d8352c4bfc8f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7967041 Dec 24 05:06:05.688500 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-f6f073a4-7e7f-4c95-8952-d30a9824b18d None None] Provisioning complete for port 6dd40189-9984-4e72-8831-3e9d864c65b9 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:05.688915 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-f6f073a4-7e7f-4c95-8952-d30a9824b18d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:05.738800 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-f6f073a4-7e7f-4c95-8952-d30a9824b18d None None] Port 6dd40189-9984-4e72-8831-3e9d864c65b9 cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 05:06:06.279285 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 32784) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:06.285762 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-3f9aeaed-bc37-4a8d-b560-9dd587f56d23 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1787144168-network', 'tenant_id': '3f3829205cff4830ba6b76ce6b6a8469'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:06.312628 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3f9aeaed-bc37-4a8d-b560-9dd587f56d23 admin admin] Made reservation on behalf of 3f3829205cff4830ba6b76ce6b6a8469 for: {'network': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:06:06.315572 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3f9aeaed-bc37-4a8d-b560-9dd587f56d23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for network, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:06.326147 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3f9aeaed-bc37-4a8d-b560-9dd587f56d23 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:06.418315 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3f9aeaed-bc37-4a8d-b560-9dd587f56d23 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:06.424359 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3f9aeaed-bc37-4a8d-b560-9dd587f56d23 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:06.447722 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3f9aeaed-bc37-4a8d-b560-9dd587f56d23 admin admin] vlan segment allocate from pool success with {'vlan_id': 128, 'physical_network': 'physnet1'} {{(pid=102476) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 24 05:06:06.462955 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f9aeaed-bc37-4a8d-b560-9dd587f56d23 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6c4cb6b8-ed95-43af-8165-474468789016,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:06.468067 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3f9aeaed-bc37-4a8d-b560-9dd587f56d23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:06.468405 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.segments_db [None req-3f9aeaed-bc37-4a8d-b560-9dd587f56d23 admin admin] Added segment 63a704c8-cd79-481c-a952-c0af6930f29a of type vlan for network 99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc Dec 24 05:06:06.516904 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3f9aeaed-bc37-4a8d-b560-9dd587f56d23 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750577486812'] for network, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:06.549799 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3f9aeaed-bc37-4a8d-b560-9dd587f56d23 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for network, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:06.550944 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f9aeaed-bc37-4a8d-b560-9dd587f56d23 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:06.551527 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3f9aeaed-bc37-4a8d-b560-9dd587f56d23 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:06.597358 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-3f9aeaed-bc37-4a8d-b560-9dd587f56d23 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.3162272 Dec 24 05:06:06.600301 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 32790) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:06.606140 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-3f1fe7ca-b3e1-4172-9bb1-1f3acc51d750 admin admin] Request body: {'subnet': {'network_id': '99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1787144168-subnet', 'tenant_id': '3f3829205cff4830ba6b76ce6b6a8469', 'ip_version': 4}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:06.631945 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f9aeaed-bc37-4a8d-b560-9dd587f56d23 admin admin] Pushing event updated for resources: {'Network': ['ID=99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:06.638231 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3f1fe7ca-b3e1-4172-9bb1-1f3acc51d750 admin admin] Made reservation on behalf of 3f3829205cff4830ba6b76ce6b6a8469 for: {'subnet': 1} {{(pid=102477) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:06:06.642060 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-3f1fe7ca-b3e1-4172-9bb1-1f3acc51d750 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-29853115'] for subnet, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:06.643065 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Network 99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc details requested by agent ovs-agent-dv-cinder-816443-2-iscsi with host dv-cinder-816443-2-iscsi {{(pid=102478) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 24 05:06:06.824160 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-3f1fe7ca-b3e1-4172-9bb1-1f3acc51d750 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-29535722', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-29853097'] for subnet, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:06.878795 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f1fe7ca-b3e1-4172-9bb1-1f3acc51d750 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4606dd6c-9937-42c0-8f9a-596cea367298,revision_number=0']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:06.891403 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f1fe7ca-b3e1-4172-9bb1-1f3acc51d750 admin admin] Checking segment: {'id': '63a704c8-cd79-481c-a952-c0af6930f29a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102477) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:06:06.891757 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3f1fe7ca-b3e1-4172-9bb1-1f3acc51d750 admin admin] Network hostable DHCP agents. Network: 99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc, hostable agents: ['01bc2530-0600-4d1b-b486-2fd9d63a2d51'], hosted agents: [] {{(pid=102477) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 24 05:06:06.910871 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3f1fe7ca-b3e1-4172-9bb1-1f3acc51d750 admin admin] Network 99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc is scheduled to be hosted by DHCP agent 01bc2530-0600-4d1b-b486-2fd9d63a2d51 with binding_index 1 {{(pid=102477) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 24 05:06:06.921257 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-3f1fe7ca-b3e1-4172-9bb1-1f3acc51d750 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816443-2-iscsi, 99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc) {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:06:06.925633 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f1fe7ca-b3e1-4172-9bb1-1f3acc51d750 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:06.926245 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-3f1fe7ca-b3e1-4172-9bb1-1f3acc51d750 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:06.931914 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f46738b1-4126-408e-add7-a45eea9cedfb None None] Network 99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:06:06.942409 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-3f1fe7ca-b3e1-4172-9bb1-1f3acc51d750 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.3403201 Dec 24 05:06:06.945002 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 32792) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:06.949957 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-ed0a6dd1-5fde-480f-87e4-9153b9bc435a admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1787144168-router', 'tenant_id': '3f3829205cff4830ba6b76ce6b6a8469', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:06.972793 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ed0a6dd1-5fde-480f-87e4-9153b9bc435a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-546186', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2070334'] for router, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:06.973702 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ed0a6dd1-5fde-480f-87e4-9153b9bc435a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-546302', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-549497', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-553463', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2070311'] for router, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:07.043049 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ed0a6dd1-5fde-480f-87e4-9153b9bc435a admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:07.056918 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0133a46b-59ff-4ece-b51b-423a9396fb33 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpd2866d45-53d6-5577-9724-7d7a303c375f-99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc', 'network_id': '99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc', 'project_id': '3f3829205cff4830ba6b76ce6b6a8469', 'fixed_ips': [{'subnet_id': '4606dd6c-9937-42c0-8f9a-596cea367298'}]}} from dv-cinder-816443-2-iscsi. {{(pid=102478) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 24 05:06:07.058110 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-0133a46b-59ff-4ece-b51b-423a9396fb33 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:07.198273 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.db_base_plugin_common [None req-0133a46b-59ff-4ece-b51b-423a9396fb33 None None] Allocated IP 172.20.0.2 (99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc/4606dd6c-9937-42c0-8f9a-596cea367298/bf00b6e0-0969-4774-9fb3-82159f213fbc) {{(pid=102478) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:06:07.357020 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-0133a46b-59ff-4ece-b51b-423a9396fb33 None None] Publish callbacks [] for port, precommit_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:07.365974 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-0133a46b-59ff-4ece-b51b-423a9396fb33 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001'] for port, after_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:07.379111 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ed0a6dd1-5fde-480f-87e4-9153b9bc435a admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:07.408456 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0133a46b-59ff-4ece-b51b-423a9396fb33 None None] Network 99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc is already hosted by enough agents. {{(pid=102478) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:06:07.416892 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.scheduler.base_scheduler [None req-0133a46b-59ff-4ece-b51b-423a9396fb33 None None] Resources bound (agent type, host, resource id): {{(pid=102478) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:06:07.421795 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0133a46b-59ff-4ece-b51b-423a9396fb33 None None] Received port after_create {{(pid=102478) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:06:07.455344 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0133a46b-59ff-4ece-b51b-423a9396fb33 None None] Pushing event updated for resources: {'Port': ['ID=bf00b6e0-0969-4774-9fb3-82159f213fbc,revision_number=1']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:07.483077 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-0133a46b-59ff-4ece-b51b-423a9396fb33 None None] Attempting to bind port bf00b6e0-0969-4774-9fb3-82159f213fbc on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:06:07.483430 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-0133a46b-59ff-4ece-b51b-423a9396fb33 None None] Attempting to bind port bf00b6e0-0969-4774-9fb3-82159f213fbc by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': '63a704c8-cd79-481c-a952-c0af6930f29a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc'}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:06:07.483797 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0133a46b-59ff-4ece-b51b-423a9396fb33 None None] Attempting to bind port bf00b6e0-0969-4774-9fb3-82159f213fbc on network 99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:06:07.490590 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0133a46b-59ff-4ece-b51b-423a9396fb33 None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 5, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:06:07.490968 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0133a46b-59ff-4ece-b51b-423a9396fb33 None None] Checking segment: {'id': '63a704c8-cd79-481c-a952-c0af6930f29a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102478) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:06:07.491364 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-0133a46b-59ff-4ece-b51b-423a9396fb33 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:07.491752 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0133a46b-59ff-4ece-b51b-423a9396fb33 None None] Bound using segment: {'id': '63a704c8-cd79-481c-a952-c0af6930f29a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc'} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:06:07.492230 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-0133a46b-59ff-4ece-b51b-423a9396fb33 None None] Bound port: bf00b6e0-0969-4774-9fb3-82159f213fbc, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '63a704c8-cd79-481c-a952-c0af6930f29a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc'}}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:06:07.493329 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-0133a46b-59ff-4ece-b51b-423a9396fb33 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:07.503428 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 4f7b3b5c-bf57-4538-9238-3f613a19c560 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:07.601994 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-0133a46b-59ff-4ece-b51b-423a9396fb33 None None] For port bf00b6e0-0969-4774-9fb3-82159f213fbc, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102478) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:06:07.605511 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-0133a46b-59ff-4ece-b51b-423a9396fb33 None None] For port bf00b6e0-0969-4774-9fb3-82159f213fbc, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=bf00b6e0-0969-4774-9fb3-82159f213fbc,segment=NetworkSegment(63a704c8-cd79-481c-a952-c0af6930f29a),segment_id=63a704c8-cd79-481c-a952-c0af6930f29a)] {{(pid=102478) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:06:07.613993 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-0133a46b-59ff-4ece-b51b-423a9396fb33 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:07.634687 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ed0a6dd1-5fde-480f-87e4-9153b9bc435a admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:07.655688 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ed0a6dd1-5fde-480f-87e4-9153b9bc435a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:07.754240 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 4f7b3b5c-bf57-4538-9238-3f613a19c560 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:07.755125 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:07.771746 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] Sync routers for ids ['a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'] in dv-cinder-816443-2-iscsi {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:06:07.783834 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] Routers {'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:06:07.784743 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:05:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:07.791493 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.db_base_plugin_common [None req-ed0a6dd1-5fde-480f-87e4-9153b9bc435a admin admin] Allocated IP 172.27.1.27 (9b4e4b31-551f-45a9-b26a-cb44ee20a17d/f277b899-8779-420e-8a8d-bfcd5eb7f012/b99d7dd8-746f-48d5-ae56-6378c12b152b) {{(pid=102477) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:06:07.828987 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0133a46b-59ff-4ece-b51b-423a9396fb33 None None] Pushing event updated for resources: {'Port': ['ID=bf00b6e0-0969-4774-9fb3-82159f213fbc,revision_number=2']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:07.913351 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:07.942169 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] Set router a17d8253-42dc-43b3-b8fe-d8352c4bfc8f gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:06:07.946912 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] For port 4f7b3b5c-bf57-4538-9238-3f613a19c560, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=4f7b3b5c-bf57-4538-9238-3f613a19c560,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:06:07.952206 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:07.963417 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ed0a6dd1-5fde-480f-87e4-9153b9bc435a admin admin] Publish callbacks [] for port, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:08.021928 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Pushing event updated for resources: {'Port': ['ID=4f7b3b5c-bf57-4538-9238-3f613a19c560,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:08.049542 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ed0a6dd1-5fde-480f-87e4-9153b9bc435a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:08.103870 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed0a6dd1-5fde-480f-87e4-9153b9bc435a admin admin] Network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d is already hosted by enough agents. {{(pid=102477) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:06:08.107271 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-ed0a6dd1-5fde-480f-87e4-9153b9bc435a admin admin] Resources bound (agent type, host, resource id): {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:06:08.110454 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed0a6dd1-5fde-480f-87e4-9153b9bc435a admin admin] Received port after_create {{(pid=102477) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:06:08.161511 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed0a6dd1-5fde-480f-87e4-9153b9bc435a admin admin] Pushing event updated for resources: {'Port': ['ID=b99d7dd8-746f-48d5-ae56-6378c12b152b,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:08.245970 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'name': 'tempest-TestMinimumBasicScenario-953343402-router', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248'}], 'enable_snat': True}, 'gw_port_id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:01Z', 'updated_at': '2021-12-24T05:06:04Z', 'revision_number': 4, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'gw_port': {'id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:e8:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 488, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:02Z', 'updated_at': '2021-12-24T05:06:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '6dd40189-9984-4e72-8831-3e9d864c65b9', 'name': '', 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'mac_address': 'fa:16:3e:cf:37:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '11836946-2718-402d-9e36-6ad89714906f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:04Z', 'updated_at': '2021-12-24T05:06:05Z', 'revision_number': 2, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'subnets': [{'id': '11836946-2718-402d-9e36-6ad89714906f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:08.272963 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] Checking router: a17d8253-42dc-43b3-b8fe-d8352c4bfc8f for host: dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:06:08.273224 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] Updating router a17d8253-42dc-43b3-b8fe-d8352c4bfc8f port 6dd40189-9984-4e72-8831-3e9d864c65b9 binding host dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 24 05:06:08.299524 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:08.401042 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ed0a6dd1-5fde-480f-87e4-9153b9bc435a admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:08.569360 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] Publish callbacks [] for port, precommit_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:08.575605 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:08.595759 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ed0a6dd1-5fde-480f-87e4-9153b9bc435a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-546295', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-545958'] for router, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:08.625563 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9362fc5-9a1e-4822-bff1-9587adbdc8cc None None] Pushing event updated for resources: {'Port': ['ID=6dd40189-9984-4e72-8831-3e9d864c65b9,revision_number=3']} {{(pid=102479) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:08.658534 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9362fc5-9a1e-4822-bff1-9587adbdc8cc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:08.659093 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9362fc5-9a1e-4822-bff1-9587adbdc8cc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:08.659716 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9362fc5-9a1e-4822-bff1-9587adbdc8cc None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:08.660153 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9362fc5-9a1e-4822-bff1-9587adbdc8cc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:08.660604 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9362fc5-9a1e-4822-bff1-9587adbdc8cc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:08.661029 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9362fc5-9a1e-4822-bff1-9587adbdc8cc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:08.661455 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9362fc5-9a1e-4822-bff1-9587adbdc8cc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:08.661876 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9362fc5-9a1e-4822-bff1-9587adbdc8cc None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:08.662296 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9362fc5-9a1e-4822-bff1-9587adbdc8cc None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:08.662931 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9362fc5-9a1e-4822-bff1-9587adbdc8cc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:08.663142 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9362fc5-9a1e-4822-bff1-9587adbdc8cc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:08.663593 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9362fc5-9a1e-4822-bff1-9587adbdc8cc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:08.664130 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9362fc5-9a1e-4822-bff1-9587adbdc8cc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:08.694940 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] Attempting to bind port 6dd40189-9984-4e72-8831-3e9d864c65b9 on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:06:08.695679 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] Attempting to bind port 6dd40189-9984-4e72-8831-3e9d864c65b9 by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': '2d8c6ac9-499a-46a9-971d-99edaae74aeb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2'}] {{(pid=102479) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:06:08.695836 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] Attempting to bind port 6dd40189-9984-4e72-8831-3e9d864c65b9 on network f6c8eead-66df-4cba-abce-78ee3b037ee2 {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:06:08.701580 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 5, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:06:08.702131 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] Checking segment: {'id': '2d8c6ac9-499a-46a9-971d-99edaae74aeb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102479) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:06:08.703013 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:08.703353 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] Bound using segment: {'id': '2d8c6ac9-499a-46a9-971d-99edaae74aeb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2'} {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:06:08.704075 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] Bound port: 6dd40189-9984-4e72-8831-3e9d864c65b9, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2d8c6ac9-499a-46a9-971d-99edaae74aeb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2'}}] {{(pid=102479) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:06:08.704845 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:08.742049 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ed0a6dd1-5fde-480f-87e4-9153b9bc435a admin admin] Router ed895a5b-4255-42de-b9e2-38e931bf55d9 is scheduled to L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 with binding_index 1 {{(pid=102477) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 24 05:06:08.786379 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.db [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] For port 6dd40189-9984-4e72-8831-3e9d864c65b9, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102479) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:06:08.790202 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.db [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] For port 6dd40189-9984-4e72-8831-3e9d864c65b9, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=6dd40189-9984-4e72-8831-3e9d864c65b9,segment=NetworkSegment(2d8c6ac9-499a-46a9-971d-99edaae74aeb),segment_id=2d8c6ac9-499a-46a9-971d-99edaae74aeb)] {{(pid=102479) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:06:08.795973 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:08.854384 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] Routers {'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:06:08.855366 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:05:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:08.864212 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ed0a6dd1-5fde-480f-87e4-9153b9bc435a admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102477) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:06:08.875164 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] Sync routers for ids ['ed895a5b-4255-42de-b9e2-38e931bf55d9'] in dv-cinder-816443-2-iscsi {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:06:08.892213 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ed0a6dd1-5fde-480f-87e4-9153b9bc435a admin admin] Publish callbacks [] for router, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:08.893334 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] Routers {'ed895a5b-4255-42de-b9e2-38e931bf55d9'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:06:08.893880 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-ed0a6dd1-5fde-480f-87e4-9153b9bc435a admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 1.9473007 Dec 24 05:06:08.894332 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:05:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['ed895a5b-4255-42de-b9e2-38e931bf55d9'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:08.896880 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 32806) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:08.903419 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9362fc5-9a1e-4822-bff1-9587adbdc8cc None None] Pushing event updated for resources: {'Port': ['ID=6dd40189-9984-4e72-8831-3e9d864c65b9,revision_number=4']} {{(pid=102479) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:09.002711 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-eb35c714-8664-47fa-95dc-ab95d2b9b6b9 None None] Provisioning complete for port 6dd40189-9984-4e72-8831-3e9d864c65b9 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:09.003535 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-eb35c714-8664-47fa-95dc-ab95d2b9b6b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:09.045541 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] Set router a17d8253-42dc-43b3-b8fe-d8352c4bfc8f gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:06:09.149081 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] Set router ed895a5b-4255-42de-b9e2-38e931bf55d9 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:06:09.221428 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49a08a77-6790-4757-a65a-712cb80b57c7 None None] Network 99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:06:09.422483 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-eb35c714-8664-47fa-95dc-ab95d2b9b6b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:09.491175 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'name': 'tempest-TestMinimumBasicScenario-953343402-router', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248'}], 'enable_snat': True}, 'gw_port_id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:01Z', 'updated_at': '2021-12-24T05:06:04Z', 'revision_number': 4, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'gw_port': {'id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:e8:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 488, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:02Z', 'updated_at': '2021-12-24T05:06:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '6dd40189-9984-4e72-8831-3e9d864c65b9', 'name': '', 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'mac_address': 'fa:16:3e:cf:37:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '11836946-2718-402d-9e36-6ad89714906f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:04Z', 'updated_at': '2021-12-24T05:06:08Z', 'revision_number': 4, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'subnets': [{'id': '11836946-2718-402d-9e36-6ad89714906f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:09.539944 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:09.572603 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-eb35c714-8664-47fa-95dc-ab95d2b9b6b9 None None] For port 6dd40189-9984-4e72-8831-3e9d864c65b9, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=6dd40189-9984-4e72-8831-3e9d864c65b9,segment=NetworkSegment(2d8c6ac9-499a-46a9-971d-99edaae74aeb),segment_id=2d8c6ac9-499a-46a9-971d-99edaae74aeb)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:06:09.580269 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7b9bc8c5-be69-4a09-b840-b48cc102179c None None] The sync data for ids ['a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'] in dv-cinder-816443-2-iscsi is: [{'id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'name': 'tempest-TestMinimumBasicScenario-953343402-router', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248'}], 'enable_snat': True}, 'gw_port_id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:01Z', 'updated_at': '2021-12-24T05:06:04Z', 'revision_number': 4, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'gw_port': {'id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:e8:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 488, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:02Z', 'updated_at': '2021-12-24T05:06:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '6dd40189-9984-4e72-8831-3e9d864c65b9', 'name': '', 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'mac_address': 'fa:16:3e:cf:37:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '11836946-2718-402d-9e36-6ad89714906f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:04Z', 'updated_at': '2021-12-24T05:06:08Z', 'revision_number': 4, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'subnets': [{'id': '11836946-2718-402d-9e36-6ad89714906f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:06:09.595206 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-eb35c714-8664-47fa-95dc-ab95d2b9b6b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:09.677206 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed895a5b-4255-42de-b9e2-38e931bf55d9', 'name': 'tempest-TestMinimumBasicScenario-1787144168-router', 'tenant_id': '3f3829205cff4830ba6b76ce6b6a8469', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.27'}], 'enable_snat': True}, 'gw_port_id': 'b99d7dd8-746f-48d5-ae56-6378c12b152b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:06Z', 'updated_at': '2021-12-24T05:06:08Z', 'revision_number': 3, 'project_id': '3f3829205cff4830ba6b76ce6b6a8469', 'gw_port': {'id': 'b99d7dd8-746f-48d5-ae56-6378c12b152b', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:cb:9a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed895a5b-4255-42de-b9e2-38e931bf55d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.27', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:07Z', 'updated_at': '2021-12-24T05:06:07Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:09.720484 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] Checking router: ed895a5b-4255-42de-b9e2-38e931bf55d9 for host: dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:06:09.720988 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] Updating router ed895a5b-4255-42de-b9e2-38e931bf55d9 port b99d7dd8-746f-48d5-ae56-6378c12b152b binding host dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 24 05:06:09.727154 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 4f7b3b5c-bf57-4538-9238-3f613a19c560 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:09.747617 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb35c714-8664-47fa-95dc-ab95d2b9b6b9 None None] Pushing event updated for resources: {'Port': ['ID=6dd40189-9984-4e72-8831-3e9d864c65b9,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:09.748258 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.db_base_plugin_common [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Allocated IP 172.20.0.1 (99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc/4606dd6c-9937-42c0-8f9a-596cea367298/8d561bb5-7197-4f2a-b9db-527de397040e) {{(pid=102477) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:06:09.793051 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:09.825116 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-1ece974d-fe80-4c08-91ec-750fe7b7a2fb None None] Provisioning complete for port bf00b6e0-0969-4774-9fb3-82159f213fbc triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:09.825493 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-1ece974d-fe80-4c08-91ec-750fe7b7a2fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:09.892026 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:09.940994 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:09.974449 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 4f7b3b5c-bf57-4538-9238-3f613a19c560 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:09.974940 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:09.991466 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Network 99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc is already hosted by enough agents. {{(pid=102477) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:06:09.994518 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Resources bound (agent type, host, resource id): {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:06:09.998708 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Received port after_create {{(pid=102477) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:06:10.038996 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Pushing event updated for resources: {'Port': ['ID=8d561bb5-7197-4f2a-b9db-527de397040e,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:10.046470 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-545913'] for router_interface, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:10.134326 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-1ece974d-fe80-4c08-91ec-750fe7b7a2fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:10.192499 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:10.247206 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-1ece974d-fe80-4c08-91ec-750fe7b7a2fb None None] For port bf00b6e0-0969-4774-9fb3-82159f213fbc, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=bf00b6e0-0969-4774-9fb3-82159f213fbc,segment=NetworkSegment(63a704c8-cd79-481c-a952-c0af6930f29a),segment_id=63a704c8-cd79-481c-a952-c0af6930f29a)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:06:10.272135 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-1ece974d-fe80-4c08-91ec-750fe7b7a2fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:10.283640 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 6dd40189-9984-4e72-8831-3e9d864c65b9 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:10.347568 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] Publish callbacks [] for port, precommit_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:10.367189 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-1ece974d-fe80-4c08-91ec-750fe7b7a2fb None None] Provisioning complete for port 6dd40189-9984-4e72-8831-3e9d864c65b9 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:10.367471 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-1ece974d-fe80-4c08-91ec-750fe7b7a2fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:10.372698 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:10.420403 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ece974d-fe80-4c08-91ec-750fe7b7a2fb None None] Pushing event updated for resources: {'Port': ['ID=bf00b6e0-0969-4774-9fb3-82159f213fbc,revision_number=3']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:10.481741 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] Attempting to bind port b99d7dd8-746f-48d5-ae56-6378c12b152b on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:06:10.482105 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] Attempting to bind port b99d7dd8-746f-48d5-ae56-6378c12b152b by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:06:10.482467 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] Attempting to bind port b99d7dd8-746f-48d5-ae56-6378c12b152b on network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:06:10.492849 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d47b3ebf-9245-4ac1-86d1-c4ad15303156 None None] Pushing event updated for resources: {'Port': ['ID=b99d7dd8-746f-48d5-ae56-6378c12b152b,revision_number=2']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:10.495893 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 5, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:06:10.496208 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] Checking segment: {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102478) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:06:10.496645 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:10.497025 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] Bound using segment: {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:06:10.497490 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] Bound port: b99d7dd8-746f-48d5-ae56-6378c12b152b, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:06:10.497871 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:10.499394 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 6dd40189-9984-4e72-8831-3e9d864c65b9 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:10.499739 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:10.565971 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:10.572619 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29535615'] for port, after_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:10.646522 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-627486', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-548585'] for router_interface, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:10.648640 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Pushing event updated for resources: {'Port': ['ID=8d561bb5-7197-4f2a-b9db-527de397040e,revision_number=2']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:10.662725 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:10.663100 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:10.663418 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:10.663756 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:10.664090 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:10.664422 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:10.664801 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:10.665128 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:10.665525 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:10.665846 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:10.666176 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:10.666497 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:10.666947 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:10.743403 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] For port b99d7dd8-746f-48d5-ae56-6378c12b152b, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102478) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:06:10.747371 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] For port b99d7dd8-746f-48d5-ae56-6378c12b152b, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=b99d7dd8-746f-48d5-ae56-6378c12b152b,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102478) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:06:10.755196 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:10.772594 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Network 99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc is already hosted by enough agents. {{(pid=102477) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:06:10.775076 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Resources bound (agent type, host, resource id): {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:06:10.847642 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device bf00b6e0-0969-4774-9fb3-82159f213fbc up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:10.858136 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] Routers {'ed895a5b-4255-42de-b9e2-38e931bf55d9'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:06:10.858787 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:05:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['ed895a5b-4255-42de-b9e2-38e931bf55d9'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:10.860869 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d47b3ebf-9245-4ac1-86d1-c4ad15303156 None None] Pushing event updated for resources: {'Port': ['ID=b99d7dd8-746f-48d5-ae56-6378c12b152b,revision_number=3']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:10.943125 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Router ed895a5b-4255-42de-b9e2-38e931bf55d9 has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102477) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:06:10.958267 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-6b6cd163-6031-4ace-b974-32e4f979dff1 None None] Provisioning complete for port 8d561bb5-7197-4f2a-b9db-527de397040e triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:10.958682 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-6b6cd163-6031-4ace-b974-32e4f979dff1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:11.063288 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102477) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:06:11.064253 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] Set router ed895a5b-4255-42de-b9e2-38e931bf55d9 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:06:11.067659 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-6b6cd163-6031-4ace-b974-32e4f979dff1 None None] Port 8d561bb5-7197-4f2a-b9db-527de397040e cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 05:06:11.078820 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-7862cf29-4f0c-4b2c-900d-9704f4936e01 admin admin] 10.222.0.43 "PUT /v2.0/routers/ed895a5b-4255-42de-b9e2-38e931bf55d9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1662567 Dec 24 05:06:11.102580 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port bf00b6e0-0969-4774-9fb3-82159f213fbc triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:11.102960 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:11.172741 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-6b6cd163-6031-4ace-b974-32e4f979dff1 None None] Provisioning complete for port bf00b6e0-0969-4774-9fb3-82159f213fbc triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:11.173206 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-6b6cd163-6031-4ace-b974-32e4f979dff1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:11.407655 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed895a5b-4255-42de-b9e2-38e931bf55d9', 'name': 'tempest-TestMinimumBasicScenario-1787144168-router', 'tenant_id': '3f3829205cff4830ba6b76ce6b6a8469', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.27'}], 'enable_snat': True}, 'gw_port_id': 'b99d7dd8-746f-48d5-ae56-6378c12b152b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:06Z', 'updated_at': '2021-12-24T05:06:10Z', 'revision_number': 4, 'project_id': '3f3829205cff4830ba6b76ce6b6a8469', 'gw_port': {'id': 'b99d7dd8-746f-48d5-ae56-6378c12b152b', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:cb:9a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed895a5b-4255-42de-b9e2-38e931bf55d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.27', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:07Z', 'updated_at': '2021-12-24T05:06:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '8d561bb5-7197-4f2a-b9db-527de397040e', 'name': '', 'network_id': '99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc', 'tenant_id': '3f3829205cff4830ba6b76ce6b6a8469', 'mac_address': 'fa:16:3e:32:49:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed895a5b-4255-42de-b9e2-38e931bf55d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '4606dd6c-9937-42c0-8f9a-596cea367298', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:09Z', 'updated_at': '2021-12-24T05:06:10Z', 'revision_number': 2, 'project_id': '3f3829205cff4830ba6b76ce6b6a8469', 'subnets': [{'id': '4606dd6c-9937-42c0-8f9a-596cea367298', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:11.447139 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e8a7719-820a-474b-9832-d83edafe0f92 None None] The sync data for ids ['ed895a5b-4255-42de-b9e2-38e931bf55d9'] in dv-cinder-816443-2-iscsi is: [{'id': 'ed895a5b-4255-42de-b9e2-38e931bf55d9', 'name': 'tempest-TestMinimumBasicScenario-1787144168-router', 'tenant_id': '3f3829205cff4830ba6b76ce6b6a8469', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.27'}], 'enable_snat': True}, 'gw_port_id': 'b99d7dd8-746f-48d5-ae56-6378c12b152b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:06Z', 'updated_at': '2021-12-24T05:06:10Z', 'revision_number': 4, 'project_id': '3f3829205cff4830ba6b76ce6b6a8469', 'gw_port': {'id': 'b99d7dd8-746f-48d5-ae56-6378c12b152b', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:cb:9a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed895a5b-4255-42de-b9e2-38e931bf55d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.27', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:07Z', 'updated_at': '2021-12-24T05:06:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '8d561bb5-7197-4f2a-b9db-527de397040e', 'name': '', 'network_id': '99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc', 'tenant_id': '3f3829205cff4830ba6b76ce6b6a8469', 'mac_address': 'fa:16:3e:32:49:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed895a5b-4255-42de-b9e2-38e931bf55d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '4606dd6c-9937-42c0-8f9a-596cea367298', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:09Z', 'updated_at': '2021-12-24T05:06:10Z', 'revision_number': 2, 'project_id': '3f3829205cff4830ba6b76ce6b6a8469', 'subnets': [{'id': '4606dd6c-9937-42c0-8f9a-596cea367298', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:06:11.494804 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 6dd40189-9984-4e72-8831-3e9d864c65b9 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:11.544357 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-e951c62d-4a58-4597-9313-2e188280c3ba None None] Provisioning complete for port 8d561bb5-7197-4f2a-b9db-527de397040e triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:11.544815 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e951c62d-4a58-4597-9313-2e188280c3ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:11.589891 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-e951c62d-4a58-4597-9313-2e188280c3ba None None] Port 8d561bb5-7197-4f2a-b9db-527de397040e cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 05:06:11.615585 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 6dd40189-9984-4e72-8831-3e9d864c65b9 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:11.615963 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:11.750445 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device bf00b6e0-0969-4774-9fb3-82159f213fbc up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:11.816748 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port bf00b6e0-0969-4774-9fb3-82159f213fbc triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:11.817354 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:13.520438 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device b99d7dd8-746f-48d5-ae56-6378c12b152b up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:13.576217 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port b99d7dd8-746f-48d5-ae56-6378c12b152b triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:13.576217 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:13.679950 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:13.719471 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] For port b99d7dd8-746f-48d5-ae56-6378c12b152b, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=b99d7dd8-746f-48d5-ae56-6378c12b152b,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:06:13.728620 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:13.786402 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Pushing event updated for resources: {'Port': ['ID=b99d7dd8-746f-48d5-ae56-6378c12b152b,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:14.025576 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] Sync routers for ids ['ed895a5b-4255-42de-b9e2-38e931bf55d9'] in dv-cinder-816443-2-iscsi {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:06:14.038366 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] Routers {'ed895a5b-4255-42de-b9e2-38e931bf55d9'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:06:14.039014 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:05:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['ed895a5b-4255-42de-b9e2-38e931bf55d9'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:14.154022 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] Set router ed895a5b-4255-42de-b9e2-38e931bf55d9 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:06:14.378624 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed895a5b-4255-42de-b9e2-38e931bf55d9', 'name': 'tempest-TestMinimumBasicScenario-1787144168-router', 'tenant_id': '3f3829205cff4830ba6b76ce6b6a8469', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.27'}], 'enable_snat': True}, 'gw_port_id': 'b99d7dd8-746f-48d5-ae56-6378c12b152b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:06Z', 'updated_at': '2021-12-24T05:06:10Z', 'revision_number': 4, 'project_id': '3f3829205cff4830ba6b76ce6b6a8469', 'gw_port': {'id': 'b99d7dd8-746f-48d5-ae56-6378c12b152b', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:cb:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed895a5b-4255-42de-b9e2-38e931bf55d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.27', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:07Z', 'updated_at': '2021-12-24T05:06:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '8d561bb5-7197-4f2a-b9db-527de397040e', 'name': '', 'network_id': '99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc', 'tenant_id': '3f3829205cff4830ba6b76ce6b6a8469', 'mac_address': 'fa:16:3e:32:49:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed895a5b-4255-42de-b9e2-38e931bf55d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '4606dd6c-9937-42c0-8f9a-596cea367298', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:09Z', 'updated_at': '2021-12-24T05:06:10Z', 'revision_number': 2, 'project_id': '3f3829205cff4830ba6b76ce6b6a8469', 'subnets': [{'id': '4606dd6c-9937-42c0-8f9a-596cea367298', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:14.412406 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] Checking router: ed895a5b-4255-42de-b9e2-38e931bf55d9 for host: dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:06:14.412902 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] Updating router ed895a5b-4255-42de-b9e2-38e931bf55d9 port 8d561bb5-7197-4f2a-b9db-527de397040e binding host dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 24 05:06:14.419667 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:06:14.443192 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:14.767384 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] Publish callbacks [] for port, precommit_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:14.773379 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:14.822783 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-245226de-2a09-47ee-a23f-df01824edb7b None None] Pushing event updated for resources: {'Port': ['ID=8d561bb5-7197-4f2a-b9db-527de397040e,revision_number=3']} {{(pid=102479) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:14.880413 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] Attempting to bind port 8d561bb5-7197-4f2a-b9db-527de397040e on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:06:14.880825 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] Attempting to bind port 8d561bb5-7197-4f2a-b9db-527de397040e by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': '63a704c8-cd79-481c-a952-c0af6930f29a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc'}] {{(pid=102479) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:06:14.881206 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] Attempting to bind port 8d561bb5-7197-4f2a-b9db-527de397040e on network 99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:06:14.891991 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 5, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:06:14.892412 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] Checking segment: {'id': '63a704c8-cd79-481c-a952-c0af6930f29a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102479) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:06:14.892790 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:14.893283 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] Bound using segment: {'id': '63a704c8-cd79-481c-a952-c0af6930f29a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc'} {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:06:14.893754 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] Bound port: 8d561bb5-7197-4f2a-b9db-527de397040e, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '63a704c8-cd79-481c-a952-c0af6930f29a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc'}}] {{(pid=102479) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:06:14.894134 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:14.977741 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.db [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] For port 8d561bb5-7197-4f2a-b9db-527de397040e, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102479) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:06:14.982009 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.db [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] For port 8d561bb5-7197-4f2a-b9db-527de397040e, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=8d561bb5-7197-4f2a-b9db-527de397040e,segment=NetworkSegment(63a704c8-cd79-481c-a952-c0af6930f29a),segment_id=63a704c8-cd79-481c-a952-c0af6930f29a)] {{(pid=102479) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:06:14.989679 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:15.053981 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] Routers {'ed895a5b-4255-42de-b9e2-38e931bf55d9'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:06:15.054695 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:05:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['ed895a5b-4255-42de-b9e2-38e931bf55d9'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:15.101759 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-245226de-2a09-47ee-a23f-df01824edb7b None None] Pushing event updated for resources: {'Port': ['ID=8d561bb5-7197-4f2a-b9db-527de397040e,revision_number=4']} {{(pid=102479) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:15.138431 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-a9182521-f875-475a-aab4-1027639eceee None None] Provisioning complete for port 8d561bb5-7197-4f2a-b9db-527de397040e triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:15.139041 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-a9182521-f875-475a-aab4-1027639eceee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:15.204249 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] Set router ed895a5b-4255-42de-b9e2-38e931bf55d9 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:06:15.267314 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-a9182521-f875-475a-aab4-1027639eceee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:15.313479 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-a9182521-f875-475a-aab4-1027639eceee None None] For port 8d561bb5-7197-4f2a-b9db-527de397040e, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=8d561bb5-7197-4f2a-b9db-527de397040e,segment=NetworkSegment(63a704c8-cd79-481c-a952-c0af6930f29a),segment_id=63a704c8-cd79-481c-a952-c0af6930f29a)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:06:15.327079 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-a9182521-f875-475a-aab4-1027639eceee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:15.421226 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9182521-f875-475a-aab4-1027639eceee None None] Pushing event updated for resources: {'Port': ['ID=8d561bb5-7197-4f2a-b9db-527de397040e,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:15.456680 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-4d9aa8f5-0a06-4f29-a941-df3f635da4d8 None None] Provisioning complete for port 8d561bb5-7197-4f2a-b9db-527de397040e triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:15.457192 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-4d9aa8f5-0a06-4f29-a941-df3f635da4d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:15.490074 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed895a5b-4255-42de-b9e2-38e931bf55d9', 'name': 'tempest-TestMinimumBasicScenario-1787144168-router', 'tenant_id': '3f3829205cff4830ba6b76ce6b6a8469', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.27'}], 'enable_snat': True}, 'gw_port_id': 'b99d7dd8-746f-48d5-ae56-6378c12b152b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:06Z', 'updated_at': '2021-12-24T05:06:10Z', 'revision_number': 4, 'project_id': '3f3829205cff4830ba6b76ce6b6a8469', 'gw_port': {'id': 'b99d7dd8-746f-48d5-ae56-6378c12b152b', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:cb:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed895a5b-4255-42de-b9e2-38e931bf55d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.27', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:07Z', 'updated_at': '2021-12-24T05:06:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '8d561bb5-7197-4f2a-b9db-527de397040e', 'name': '', 'network_id': '99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc', 'tenant_id': '3f3829205cff4830ba6b76ce6b6a8469', 'mac_address': 'fa:16:3e:32:49:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed895a5b-4255-42de-b9e2-38e931bf55d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '4606dd6c-9937-42c0-8f9a-596cea367298', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:09Z', 'updated_at': '2021-12-24T05:06:14Z', 'revision_number': 4, 'project_id': '3f3829205cff4830ba6b76ce6b6a8469', 'subnets': [{'id': '4606dd6c-9937-42c0-8f9a-596cea367298', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:15.525141 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce18ae6f-0a9c-4909-b9af-635feab8442d None None] The sync data for ids ['ed895a5b-4255-42de-b9e2-38e931bf55d9'] in dv-cinder-816443-2-iscsi is: [{'id': 'ed895a5b-4255-42de-b9e2-38e931bf55d9', 'name': 'tempest-TestMinimumBasicScenario-1787144168-router', 'tenant_id': '3f3829205cff4830ba6b76ce6b6a8469', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.27'}], 'enable_snat': True}, 'gw_port_id': 'b99d7dd8-746f-48d5-ae56-6378c12b152b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:06Z', 'updated_at': '2021-12-24T05:06:10Z', 'revision_number': 4, 'project_id': '3f3829205cff4830ba6b76ce6b6a8469', 'gw_port': {'id': 'b99d7dd8-746f-48d5-ae56-6378c12b152b', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:cb:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed895a5b-4255-42de-b9e2-38e931bf55d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.27', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:07Z', 'updated_at': '2021-12-24T05:06:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '8d561bb5-7197-4f2a-b9db-527de397040e', 'name': '', 'network_id': '99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc', 'tenant_id': '3f3829205cff4830ba6b76ce6b6a8469', 'mac_address': 'fa:16:3e:32:49:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ed895a5b-4255-42de-b9e2-38e931bf55d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 516, 'fixed_ips': [{'subnet_id': '4606dd6c-9937-42c0-8f9a-596cea367298', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:09Z', 'updated_at': '2021-12-24T05:06:14Z', 'revision_number': 4, 'project_id': '3f3829205cff4830ba6b76ce6b6a8469', 'subnets': [{'id': '4606dd6c-9937-42c0-8f9a-596cea367298', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:06:15.550313 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device b99d7dd8-746f-48d5-ae56-6378c12b152b up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:15.618520 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port b99d7dd8-746f-48d5-ae56-6378c12b152b triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:15.618885 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:15.726030 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 8d561bb5-7197-4f2a-b9db-527de397040e up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:15.792335 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 8d561bb5-7197-4f2a-b9db-527de397040e triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:15.792744 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:17.085698 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 32930) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:17.224999 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-738ab640-42d9-4b5f-b2f5-4fdc64caaeca admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:17.310054 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-738ab640-42d9-4b5f-b2f5-4fdc64caaeca admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:17.314808 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-738ab640-42d9-4b5f-b2f5-4fdc64caaeca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:17.358728 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 32934) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:17.361083 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-738ab640-42d9-4b5f-b2f5-4fdc64caaeca admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=e1e4473904384550b47b8b6848a76ea0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2734766 Dec 24 05:06:17.368266 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-738ab640-42d9-4b5f-b2f5-4fdc64caaeca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=40c61b16-2378-4c86-a89d-97a726782e96,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:17.376245 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-738ab640-42d9-4b5f-b2f5-4fdc64caaeca admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:17.376644 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-738ab640-42d9-4b5f-b2f5-4fdc64caaeca admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:17.377022 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-738ab640-42d9-4b5f-b2f5-4fdc64caaeca admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:17.377391 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-738ab640-42d9-4b5f-b2f5-4fdc64caaeca admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:17.377729 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-738ab640-42d9-4b5f-b2f5-4fdc64caaeca admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:17.378217 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-738ab640-42d9-4b5f-b2f5-4fdc64caaeca admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:17.378563 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-738ab640-42d9-4b5f-b2f5-4fdc64caaeca admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:17.378891 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-738ab640-42d9-4b5f-b2f5-4fdc64caaeca admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:17.379221 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-738ab640-42d9-4b5f-b2f5-4fdc64caaeca admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:17.379550 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-738ab640-42d9-4b5f-b2f5-4fdc64caaeca admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:17.379874 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-738ab640-42d9-4b5f-b2f5-4fdc64caaeca admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:17.380205 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-738ab640-42d9-4b5f-b2f5-4fdc64caaeca admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:17.380550 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-738ab640-42d9-4b5f-b2f5-4fdc64caaeca admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:17.452647 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-69937c7b-ae2b-491b-ab8c-e5b9f3277961 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:17.480802 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 8d561bb5-7197-4f2a-b9db-527de397040e up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:17.489192 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-69937c7b-ae2b-491b-ab8c-e5b9f3277961 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:17.536443 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 8d561bb5-7197-4f2a-b9db-527de397040e triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:17.538698 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:17.549563 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-69937c7b-ae2b-491b-ab8c-e5b9f3277961 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:17.552297 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-69937c7b-ae2b-491b-ab8c-e5b9f3277961 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:17.553606 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-69937c7b-ae2b-491b-ab8c-e5b9f3277961 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/40c61b16-2378-4c86-a89d-97a726782e96 HTTP/1.1" status: 204 len: 168 time: 0.1939318 Dec 24 05:06:17.563183 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69937c7b-ae2b-491b-ab8c-e5b9f3277961 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=40c61b16-2378-4c86-a89d-97a726782e96,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:18.278656 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 32960) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:18.399116 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-6ddb94e7-532a-496f-8e51-39e57f4ab4f7 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-65459633-network', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:18.429330 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6ddb94e7-532a-496f-8e51-39e57f4ab4f7 admin admin] Made reservation on behalf of 8b1a80c6322a493ba10c69a77168b46f for: {'network': 1} {{(pid=102477) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:06:18.436270 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-6ddb94e7-532a-496f-8e51-39e57f4ab4f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for network, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:18.445646 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-6ddb94e7-532a-496f-8e51-39e57f4ab4f7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:18.553781 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-6ddb94e7-532a-496f-8e51-39e57f4ab4f7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:18.561375 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-6ddb94e7-532a-496f-8e51-39e57f4ab4f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:18.594628 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6ddb94e7-532a-496f-8e51-39e57f4ab4f7 admin admin] vlan segment allocate from pool success with {'vlan_id': 122, 'physical_network': 'physnet1'} {{(pid=102477) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 24 05:06:18.606297 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ddb94e7-532a-496f-8e51-39e57f4ab4f7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=814e46cc-f537-4c44-8e22-29ecbc1440eb,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:18.623264 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-6ddb94e7-532a-496f-8e51-39e57f4ab4f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:18.623615 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.db.segments_db [None req-6ddb94e7-532a-496f-8e51-39e57f4ab4f7 admin admin] Added segment cb920e21-208e-474e-84a0-615ea3280b8a of type vlan for network df2331c3-0dd0-460e-980f-1e2409baa35e Dec 24 05:06:18.669364 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-6ddb94e7-532a-496f-8e51-39e57f4ab4f7 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750577486812'] for network, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:18.704577 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-6ddb94e7-532a-496f-8e51-39e57f4ab4f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for network, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:18.705751 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ddb94e7-532a-496f-8e51-39e57f4ab4f7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:18.706464 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-6ddb94e7-532a-496f-8e51-39e57f4ab4f7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:18.742177 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-6ddb94e7-532a-496f-8e51-39e57f4ab4f7 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.4623601 Dec 24 05:06:18.745498 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 32966) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:18.752570 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-9ef02ffb-d549-45a8-bc57-95fe9e1e983f admin admin] Request body: {'subnet': {'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-65459633-subnet', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'ip_version': 4}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:18.774992 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ddb94e7-532a-496f-8e51-39e57f4ab4f7 admin admin] Pushing event updated for resources: {'Network': ['ID=df2331c3-0dd0-460e-980f-1e2409baa35e,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:18.790767 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Network df2331c3-0dd0-460e-980f-1e2409baa35e details requested by agent ovs-agent-dv-cinder-816443-2-iscsi with host dv-cinder-816443-2-iscsi {{(pid=102478) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 24 05:06:18.801154 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9ef02ffb-d549-45a8-bc57-95fe9e1e983f admin admin] Made reservation on behalf of 8b1a80c6322a493ba10c69a77168b46f for: {'subnet': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:06:18.804631 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9ef02ffb-d549-45a8-bc57-95fe9e1e983f admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-32970422'] for subnet, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:18.995518 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9ef02ffb-d549-45a8-bc57-95fe9e1e983f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-32528573', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-32970404'] for subnet, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:19.063310 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ef02ffb-d549-45a8-bc57-95fe9e1e983f admin admin] Checking segment: {'id': 'cb920e21-208e-474e-84a0-615ea3280b8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:06:19.063676 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ef02ffb-d549-45a8-bc57-95fe9e1e983f admin admin] Network hostable DHCP agents. Network: df2331c3-0dd0-460e-980f-1e2409baa35e, hostable agents: ['01bc2530-0600-4d1b-b486-2fd9d63a2d51'], hosted agents: [] {{(pid=102476) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 24 05:06:19.072478 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ef02ffb-d549-45a8-bc57-95fe9e1e983f admin admin] Pushing event updated for resources: {'Subnet': ['ID=9df81c69-0712-4247-ad21-3b3a089ce4b5,revision_number=0']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:19.088897 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ef02ffb-d549-45a8-bc57-95fe9e1e983f admin admin] Network df2331c3-0dd0-460e-980f-1e2409baa35e is scheduled to be hosted by DHCP agent 01bc2530-0600-4d1b-b486-2fd9d63a2d51 with binding_index 1 {{(pid=102476) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 24 05:06:19.101505 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-9ef02ffb-d549-45a8-bc57-95fe9e1e983f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816443-2-iscsi, df2331c3-0dd0-460e-980f-1e2409baa35e) {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:06:19.106201 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ef02ffb-d549-45a8-bc57-95fe9e1e983f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:19.106795 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-9ef02ffb-d549-45a8-bc57-95fe9e1e983f admin admin] Publish callbacks [] for subnet, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:19.112250 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ee0767e7-645a-4e93-b2e8-371a4f315d1e None None] Network df2331c3-0dd0-460e-980f-1e2409baa35e requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:06:19.127951 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-9ef02ffb-d549-45a8-bc57-95fe9e1e983f admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.3806946 Dec 24 05:06:19.130584 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 32968) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:19.135347 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-ad1628dc-b825-4118-8f14-52fc28644b2f admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:19.161960 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ad1628dc-b825-4118-8f14-52fc28644b2f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-546186', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2070334'] for router, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:19.163453 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ad1628dc-b825-4118-8f14-52fc28644b2f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-546302', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-549497', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-553463', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2070311'] for router, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:19.248315 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ad1628dc-b825-4118-8f14-52fc28644b2f admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:19.299066 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpd2866d45-53d6-5577-9724-7d7a303c375f-df2331c3-0dd0-460e-980f-1e2409baa35e', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5'}]}} from dv-cinder-816443-2-iscsi. {{(pid=102478) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 24 05:06:19.305732 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:19.443564 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ad1628dc-b825-4118-8f14-52fc28644b2f admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:19.474000 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.db_base_plugin_common [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Allocated IP 172.20.0.2 (df2331c3-0dd0-460e-980f-1e2409baa35e/9df81c69-0712-4247-ad21-3b3a089ce4b5/cdcaf45c-ae0e-4d57-8f82-9506240faf0a) {{(pid=102478) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:06:19.698868 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ad1628dc-b825-4118-8f14-52fc28644b2f admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:19.725296 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ad1628dc-b825-4118-8f14-52fc28644b2f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:19.791871 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Publish callbacks [] for port, precommit_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:19.802906 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001'] for port, after_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:19.847394 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Network df2331c3-0dd0-460e-980f-1e2409baa35e is already hosted by enough agents. {{(pid=102478) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:06:19.850358 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.scheduler.base_scheduler [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Resources bound (agent type, host, resource id): {{(pid=102478) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:06:19.854237 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Received port after_create {{(pid=102478) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:06:19.862450 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Pushing event updated for resources: {'Port': ['ID=cdcaf45c-ae0e-4d57-8f82-9506240faf0a,revision_number=1']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:19.862836 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [None req-ad1628dc-b825-4118-8f14-52fc28644b2f admin admin] Allocated IP 172.27.1.26 (9b4e4b31-551f-45a9-b26a-cb44ee20a17d/f277b899-8779-420e-8a8d-bfcd5eb7f012/cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:06:19.869767 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:19.870255 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:19.870599 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:19.870934 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:19.871392 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:19.871723 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:19.872053 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:19.872377 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:19.872727 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:19.873174 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:19.873367 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:19.873694 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:19.874001 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:06:19.949222 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Attempting to bind port cdcaf45c-ae0e-4d57-8f82-9506240faf0a on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:06:19.950303 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Attempting to bind port cdcaf45c-ae0e-4d57-8f82-9506240faf0a by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': 'cb920e21-208e-474e-84a0-615ea3280b8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e'}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:06:19.950861 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Attempting to bind port cdcaf45c-ae0e-4d57-8f82-9506240faf0a on network df2331c3-0dd0-460e-980f-1e2409baa35e {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:06:19.957867 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 5, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:06:19.958515 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Checking segment: {'id': 'cb920e21-208e-474e-84a0-615ea3280b8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102478) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:06:19.959099 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:19.959638 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Bound using segment: {'id': 'cb920e21-208e-474e-84a0-615ea3280b8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e'} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:06:19.960669 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Bound port: cdcaf45c-ae0e-4d57-8f82-9506240faf0a, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cb920e21-208e-474e-84a0-615ea3280b8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e'}}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:06:19.961222 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:20.007249 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ad1628dc-b825-4118-8f14-52fc28644b2f admin admin] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:20.025211 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] For port cdcaf45c-ae0e-4d57-8f82-9506240faf0a, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102478) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:06:20.028639 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] For port cdcaf45c-ae0e-4d57-8f82-9506240faf0a, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=cdcaf45c-ae0e-4d57-8f82-9506240faf0a,segment=NetworkSegment(cb920e21-208e-474e-84a0-615ea3280b8a),segment_id=cb920e21-208e-474e-84a0-615ea3280b8a)] {{(pid=102478) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:06:20.035653 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:20.048247 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ad1628dc-b825-4118-8f14-52fc28644b2f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:20.103275 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d1bc06a-7d65-4ae7-9eaa-a96b4bd51c58 None None] Pushing event updated for resources: {'Port': ['ID=cdcaf45c-ae0e-4d57-8f82-9506240faf0a,revision_number=2']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:20.110549 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad1628dc-b825-4118-8f14-52fc28644b2f admin admin] Pushing event updated for resources: {'Port': ['ID=cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:20.119583 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad1628dc-b825-4118-8f14-52fc28644b2f admin admin] Network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:06:20.121177 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-ad1628dc-b825-4118-8f14-52fc28644b2f admin admin] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:06:20.123481 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad1628dc-b825-4118-8f14-52fc28644b2f admin admin] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:06:20.424498 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:20.467940 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ad1628dc-b825-4118-8f14-52fc28644b2f admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:20.695257 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ad1628dc-b825-4118-8f14-52fc28644b2f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-546295', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-545958'] for router, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:20.853430 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ad1628dc-b825-4118-8f14-52fc28644b2f admin admin] Router 9df11fe3-ba73-4793-a582-0e00f27a374d is scheduled to L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 with binding_index 1 {{(pid=102476) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 24 05:06:20.971984 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ad1628dc-b825-4118-8f14-52fc28644b2f admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:06:20.988582 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] Sync routers for ids ['9df11fe3-ba73-4793-a582-0e00f27a374d'] in dv-cinder-816443-2-iscsi {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:06:21.021912 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ad1628dc-b825-4118-8f14-52fc28644b2f admin admin] Publish callbacks [] for router, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:21.023634 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-ad1628dc-b825-4118-8f14-52fc28644b2f admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 1.8920755 Dec 24 05:06:21.026461 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 32970) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:21.030256 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] Routers {'9df11fe3-ba73-4793-a582-0e00f27a374d'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:06:21.030960 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:05:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['9df11fe3-ba73-4793-a582-0e00f27a374d'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:21.157879 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58a950b9-a0ef-48a2-91a9-9ae24a168e7f None None] Network df2331c3-0dd0-460e-980f-1e2409baa35e requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:06:21.201122 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] Set router 9df11fe3-ba73-4793-a582-0e00f27a374d gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:06:21.344828 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-66dabd83-5019-44ba-9fbc-d76e518ad750 None None] Provisioning complete for port cdcaf45c-ae0e-4d57-8f82-9506240faf0a triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:21.345327 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-66dabd83-5019-44ba-9fbc-d76e518ad750 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:21.541559 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device cdcaf45c-ae0e-4d57-8f82-9506240faf0a up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:21.578842 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-22bdad22-c45f-4185-9a97-438247e7602c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:21.611670 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-66dabd83-5019-44ba-9fbc-d76e518ad750 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:21.668281 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-66dabd83-5019-44ba-9fbc-d76e518ad750 None None] For port cdcaf45c-ae0e-4d57-8f82-9506240faf0a, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=cdcaf45c-ae0e-4d57-8f82-9506240faf0a,segment=NetworkSegment(cb920e21-208e-474e-84a0-615ea3280b8a),segment_id=cb920e21-208e-474e-84a0-615ea3280b8a)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:06:21.678969 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-66dabd83-5019-44ba-9fbc-d76e518ad750 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:21.750933 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66dabd83-5019-44ba-9fbc-d76e518ad750 None None] Pushing event updated for resources: {'Port': ['ID=cdcaf45c-ae0e-4d57-8f82-9506240faf0a,revision_number=3']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:21.766842 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port cdcaf45c-ae0e-4d57-8f82-9506240faf0a triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:21.767034 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:21.804737 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [None req-22bdad22-c45f-4185-9a97-438247e7602c admin admin] Allocated IP 172.20.0.1 (df2331c3-0dd0-460e-980f-1e2409baa35e/9df81c69-0712-4247-ad21-3b3a089ce4b5/826094e8-3c74-4e96-9507-84128f7209f1) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:06:21.811681 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:20Z', 'revision_number': 3, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:19Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:21.849849 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] Checking router: 9df11fe3-ba73-4793-a582-0e00f27a374d for host: dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:06:21.850194 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] Updating router 9df11fe3-ba73-4793-a582-0e00f27a374d port cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5 binding host dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 24 05:06:21.875177 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-12b4cbe7-ff74-47c8-9e5b-a6ccf9db3552 None None] Provisioning complete for port cdcaf45c-ae0e-4d57-8f82-9506240faf0a triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:21.876296 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-12b4cbe7-ff74-47c8-9e5b-a6ccf9db3552 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:21.916313 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:21.930688 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-22bdad22-c45f-4185-9a97-438247e7602c admin admin] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:21.965955 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-22bdad22-c45f-4185-9a97-438247e7602c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:21.999152 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-22bdad22-c45f-4185-9a97-438247e7602c admin admin] Network df2331c3-0dd0-460e-980f-1e2409baa35e is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:06:22.003379 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-22bdad22-c45f-4185-9a97-438247e7602c admin admin] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:06:22.007160 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22bdad22-c45f-4185-9a97-438247e7602c admin admin] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:06:22.056930 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22bdad22-c45f-4185-9a97-438247e7602c admin admin] Pushing event updated for resources: {'Port': ['ID=826094e8-3c74-4e96-9507-84128f7209f1,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:22.068357 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-22bdad22-c45f-4185-9a97-438247e7602c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-545913'] for router_interface, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:22.286066 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-22bdad22-c45f-4185-9a97-438247e7602c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:22.287289 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] Publish callbacks [] for port, precommit_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:22.294490 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:22.368057 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] Attempting to bind port cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5 on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:06:22.368423 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] Attempting to bind port cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5 by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:06:22.368808 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] Attempting to bind port cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5 on network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:06:22.374461 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-826adede-1c4c-453b-bab5-f92b2f0fb1c0 None None] Pushing event updated for resources: {'Port': ['ID=cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5,revision_number=2']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:22.378527 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 5, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:06:22.378909 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] Checking segment: {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102478) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:06:22.379321 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:22.379698 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] Bound using segment: {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:06:22.380607 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] Bound port: cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:06:22.380990 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:22.382939 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-1159abde-027c-4f83-9978-55878cbdfa67 None None] Provisioning complete for port 826094e8-3c74-4e96-9507-84128f7209f1 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:22.383023 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-1159abde-027c-4f83-9978-55878cbdfa67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:22.457174 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-1159abde-027c-4f83-9978-55878cbdfa67 None None] Port 826094e8-3c74-4e96-9507-84128f7209f1 cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 05:06:22.467010 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] For port cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102478) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:06:22.470595 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] For port cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102478) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:06:22.474419 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:22.536263 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] Routers {'9df11fe3-ba73-4793-a582-0e00f27a374d'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:06:22.536951 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:05:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['9df11fe3-ba73-4793-a582-0e00f27a374d'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:22.542510 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-826adede-1c4c-453b-bab5-f92b2f0fb1c0 None None] Pushing event updated for resources: {'Port': ['ID=cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5,revision_number=3']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:22.786881 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] Set router 9df11fe3-ba73-4793-a582-0e00f27a374d gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:06:22.843110 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-22bdad22-c45f-4185-9a97-438247e7602c admin admin] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:22.852367 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-5d50f2d9-0f04-44de-ab61-22b2d8b1d536 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:22.853864 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-5d50f2d9-0f04-44de-ab61-22b2d8b1d536 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/networks?id=f6c8eead-66df-4cba-abce-78ee3b037ee2 HTTP/1.1" status: 200 len: 814 time: 0.4216015 Dec 24 05:06:22.854914 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-22bdad22-c45f-4185-9a97-438247e7602c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:22.911052 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-09794a59-1ccc-4965-9bbb-41e138895f67 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/quotas/f081e71a66b74c3bb12e1bec9d9a5cd1 HTTP/1.1" status: 200 len: 375 time: 0.0506907 Dec 24 05:06:22.954381 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22bdad22-c45f-4185-9a97-438247e7602c admin admin] Pushing event updated for resources: {'Port': ['ID=826094e8-3c74-4e96-9507-84128f7209f1,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:22.962384 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-22bdad22-c45f-4185-9a97-438247e7602c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-627486', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-548585'] for router_interface, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:22.990622 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '826094e8-3c74-4e96-9507-84128f7209f1', 'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'mac_address': 'fa:16:3e:b3:73:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:21Z', 'updated_at': '2021-12-24T05:06:21Z', 'revision_number': 1, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'subnets': [{'id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:23.004687 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-f5e7226f-5497-40b3-927e-d22fc4eb4ab6 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=f081e71a66b74c3bb12e1bec9d9a5cd1&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0867844 Dec 24 05:06:23.018809 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c79c881-00b9-48a1-b924-eee026618cf5 None None] The sync data for ids ['9df11fe3-ba73-4793-a582-0e00f27a374d'] in dv-cinder-816443-2-iscsi is: [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '826094e8-3c74-4e96-9507-84128f7209f1', 'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'mac_address': 'fa:16:3e:b3:73:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:21Z', 'updated_at': '2021-12-24T05:06:21Z', 'revision_number': 1, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'subnets': [{'id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:06:23.138494 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-22bdad22-c45f-4185-9a97-438247e7602c admin admin] Network df2331c3-0dd0-460e-980f-1e2409baa35e is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:06:23.143109 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-22bdad22-c45f-4185-9a97-438247e7602c admin admin] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:06:23.203493 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-e938d9bb-7314-4979-9293-9cffb80536a3 service neutron] 10.222.0.43 "GET /v2.0/networks/f6c8eead-66df-4cba-abce-78ee3b037ee2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1668034 Dec 24 05:06:23.220975 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-a0bd7636-9145-47e9-bfff-e77ef2c14c4d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:23.397060 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-22bdad22-c45f-4185-9a97-438247e7602c admin admin] Router 9df11fe3-ba73-4793-a582-0e00f27a374d has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102476) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:06:23.403038 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-8c9d75a4-b863-4813-8ffc-c3182bde817e service neutron] 10.222.0.43 "GET /v2.0/networks/f6c8eead-66df-4cba-abce-78ee3b037ee2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1890144 Dec 24 05:06:23.474696 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device cdcaf45c-ae0e-4d57-8f82-9506240faf0a up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:23.542149 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-22bdad22-c45f-4185-9a97-438247e7602c admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:06:23.549971 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-22bdad22-c45f-4185-9a97-438247e7602c admin admin] 10.222.0.43 "PUT /v2.0/routers/9df11fe3-ba73-4793-a582-0e00f27a374d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5224452 Dec 24 05:06:23.553516 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-3e43e561-1f7e-42a0-abf8-3d95aa0f0aaf None None] Provisioning complete for port 826094e8-3c74-4e96-9507-84128f7209f1 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:23.553889 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3e43e561-1f7e-42a0-abf8-3d95aa0f0aaf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:23.611026 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port cdcaf45c-ae0e-4d57-8f82-9506240faf0a triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:23.611414 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:23.613521 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-eaa30d52-c6b0-4c04-8db1-d921737ce1d6 req-1c1e1181-2396-4969-880a-a4c23320602d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 210 time: 0.0383909 Dec 24 05:06:23.615203 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-3e43e561-1f7e-42a0-abf8-3d95aa0f0aaf None None] Port 826094e8-3c74-4e96-9507-84128f7209f1 cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 05:06:24.160622 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 33022) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:24.165635 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-781f5e7a-a8e5-4781-8a60-220a61bd150c admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-26042513-network', 'tenant_id': 'bf7b649b22d644f4971ea81dfca887e0'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:24.189700 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-781f5e7a-a8e5-4781-8a60-220a61bd150c admin admin] Made reservation on behalf of bf7b649b22d644f4971ea81dfca887e0 for: {'network': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:06:24.192060 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-781f5e7a-a8e5-4781-8a60-220a61bd150c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for network, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:24.201223 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-781f5e7a-a8e5-4781-8a60-220a61bd150c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:24.287355 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-781f5e7a-a8e5-4781-8a60-220a61bd150c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:24.292950 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-781f5e7a-a8e5-4781-8a60-220a61bd150c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:24.322138 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-781f5e7a-a8e5-4781-8a60-220a61bd150c admin admin] vlan segment allocate from pool success with {'vlan_id': 144, 'physical_network': 'physnet1'} {{(pid=102476) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 24 05:06:24.333418 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-781f5e7a-a8e5-4781-8a60-220a61bd150c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=41262f8f-341a-4db3-8afd-e3698a9aab93,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:24.340204 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-781f5e7a-a8e5-4781-8a60-220a61bd150c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:24.340633 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.segments_db [None req-781f5e7a-a8e5-4781-8a60-220a61bd150c admin admin] Added segment 4a78b754-1ec8-4968-9b2e-553c2cd2237b of type vlan for network 0609ed93-c812-4af1-9df9-9ff4b30f6db5 Dec 24 05:06:24.389971 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-781f5e7a-a8e5-4781-8a60-220a61bd150c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750577486812'] for network, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:24.417690 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-781f5e7a-a8e5-4781-8a60-220a61bd150c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for network, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:24.418832 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-781f5e7a-a8e5-4781-8a60-220a61bd150c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:24.419625 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-781f5e7a-a8e5-4781-8a60-220a61bd150c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:24.452015 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-781f5e7a-a8e5-4781-8a60-220a61bd150c admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.2902532 Dec 24 05:06:24.455078 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 33024) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:24.461755 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-a34da7b1-073e-4e20-9ad4-919e63a22918 admin admin] Request body: {'subnet': {'network_id': '0609ed93-c812-4af1-9df9-9ff4b30f6db5', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-26042513-subnet', 'tenant_id': 'bf7b649b22d644f4971ea81dfca887e0', 'ip_version': 4}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:24.497573 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-781f5e7a-a8e5-4781-8a60-220a61bd150c admin admin] Pushing event updated for resources: {'Network': ['ID=0609ed93-c812-4af1-9df9-9ff4b30f6db5,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:24.509103 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Network 0609ed93-c812-4af1-9df9-9ff4b30f6db5 details requested by agent ovs-agent-dv-cinder-816443-2-iscsi with host dv-cinder-816443-2-iscsi {{(pid=102478) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 24 05:06:24.518529 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a34da7b1-073e-4e20-9ad4-919e63a22918 admin admin] Made reservation on behalf of bf7b649b22d644f4971ea81dfca887e0 for: {'subnet': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:06:24.521448 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a34da7b1-073e-4e20-9ad4-919e63a22918 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-32970422'] for subnet, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:24.748855 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-62b36733-60eb-476c-87b0-6aa060319ed5 req-25ba0928-0126-4dbc-a945-552097152dc8 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 210 time: 0.0596967 Dec 24 05:06:24.759237 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a34da7b1-073e-4e20-9ad4-919e63a22918 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-32528573', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-32970404'] for subnet, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:24.881359 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-2ce20e0c-2312-42d7-a55a-68af8f6f5fe1 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:24.882964 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-2ce20e0c-2312-42d7-a55a-68af8f6f5fe1 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.46 "GET /v2.0/networks?id=f6c8eead-66df-4cba-abce-78ee3b037ee2 HTTP/1.1" status: 200 len: 814 time: 0.2024984 Dec 24 05:06:24.883637 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a34da7b1-073e-4e20-9ad4-919e63a22918 admin admin] Pushing event updated for resources: {'Subnet': ['ID=be96039d-7619-4886-a09d-561401ca5c41,revision_number=0']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:24.891700 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a34da7b1-073e-4e20-9ad4-919e63a22918 admin admin] Checking segment: {'id': '4a78b754-1ec8-4968-9b2e-553c2cd2237b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '0609ed93-c812-4af1-9df9-9ff4b30f6db5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:06:24.892193 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a34da7b1-073e-4e20-9ad4-919e63a22918 admin admin] Network hostable DHCP agents. Network: 0609ed93-c812-4af1-9df9-9ff4b30f6db5, hostable agents: ['01bc2530-0600-4d1b-b486-2fd9d63a2d51'], hosted agents: [] {{(pid=102476) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 24 05:06:24.912576 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-3149a3ed-e5e9-4ef4-a0fb-7f54dc5f914a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Request body: {'port': {'device_id': 'ae7a102d-4793-4384-bc31-07d28018c9df', 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2', 'admin_state_up': True, 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:24.917326 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a34da7b1-073e-4e20-9ad4-919e63a22918 admin admin] Network 0609ed93-c812-4af1-9df9-9ff4b30f6db5 is scheduled to be hosted by DHCP agent 01bc2530-0600-4d1b-b486-2fd9d63a2d51 with binding_index 1 {{(pid=102476) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 24 05:06:24.945232 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-a34da7b1-073e-4e20-9ad4-919e63a22918 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816443-2-iscsi, 0609ed93-c812-4af1-9df9-9ff4b30f6db5) {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:06:24.952275 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a34da7b1-073e-4e20-9ad4-919e63a22918 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:24.953008 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a34da7b1-073e-4e20-9ad4-919e63a22918 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:24.954885 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-681d62ce-aeac-4675-80f1-a9931118b723 None None] Network 0609ed93-c812-4af1-9df9-9ff4b30f6db5 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:06:25.005922 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-a34da7b1-073e-4e20-9ad4-919e63a22918 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.5496171 Dec 24 05:06:25.008191 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 33036) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:25.013067 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-ce22787b-afe8-4964-87da-ad1a54938747 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-26042513-router', 'tenant_id': 'bf7b649b22d644f4971ea81dfca887e0', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:25.052098 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ce22787b-afe8-4964-87da-ad1a54938747 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-546186', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2070334'] for router, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:25.053184 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ce22787b-afe8-4964-87da-ad1a54938747 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-546302', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-549497', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-553463', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2070311'] for router, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:25.097116 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-361d7fa9-f390-42fb-a065-910c6659f54d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpd2866d45-53d6-5577-9724-7d7a303c375f-0609ed93-c812-4af1-9df9-9ff4b30f6db5', 'network_id': '0609ed93-c812-4af1-9df9-9ff4b30f6db5', 'project_id': 'bf7b649b22d644f4971ea81dfca887e0', 'fixed_ips': [{'subnet_id': 'be96039d-7619-4886-a09d-561401ca5c41'}]}} from dv-cinder-816443-2-iscsi. {{(pid=102478) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 24 05:06:25.098123 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-361d7fa9-f390-42fb-a065-910c6659f54d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:25.118447 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-3149a3ed-e5e9-4ef4-a0fb-7f54dc5f914a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Made reservation on behalf of f081e71a66b74c3bb12e1bec9d9a5cd1 for: {'port': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:06:25.122363 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-3149a3ed-e5e9-4ef4-a0fb-7f54dc5f914a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:25.128501 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ce22787b-afe8-4964-87da-ad1a54938747 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:25.289685 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-5f298580-2418-46b4-aa78-c51b1c832228 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:25.294297 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.db_base_plugin_common [None req-361d7fa9-f390-42fb-a065-910c6659f54d None None] Allocated IP 172.20.0.2 (0609ed93-c812-4af1-9df9-9ff4b30f6db5/be96039d-7619-4886-a09d-561401ca5c41/b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0) {{(pid=102478) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:06:25.296468 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] Sync routers for ids ['9df11fe3-ba73-4793-a582-0e00f27a374d'] in dv-cinder-816443-2-iscsi {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:06:25.308260 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] Routers {'9df11fe3-ba73-4793-a582-0e00f27a374d'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:06:25.308990 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:06:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['9df11fe3-ba73-4793-a582-0e00f27a374d'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:25.332355 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ce22787b-afe8-4964-87da-ad1a54938747 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:25.416248 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-3149a3ed-e5e9-4ef4-a0fb-7f54dc5f914a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Allocated IP 172.20.0.8 (f6c8eead-66df-4cba-abce-78ee3b037ee2/11836946-2718-402d-9e36-6ad89714906f/b8dc8fcb-f50d-49a3-9bd0-47110fdb068f) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:06:25.508349 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] Set router 9df11fe3-ba73-4793-a582-0e00f27a374d gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:06:25.567243 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:25.637354 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-361d7fa9-f390-42fb-a065-910c6659f54d None None] Publish callbacks [] for port, precommit_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:25.650860 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-361d7fa9-f390-42fb-a065-910c6659f54d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001'] for port, after_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:25.712664 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361d7fa9-f390-42fb-a065-910c6659f54d None None] Pushing event updated for resources: {'Port': ['ID=b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0,revision_number=1']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:25.724231 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:25.724610 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:25.734613 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-3149a3ed-e5e9-4ef4-a0fb-7f54dc5f914a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:25.768984 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '826094e8-3c74-4e96-9507-84128f7209f1', 'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'mac_address': 'fa:16:3e:b3:73:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:21Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 2, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'subnets': [{'id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:25.776559 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-361d7fa9-f390-42fb-a065-910c6659f54d None None] Network 0609ed93-c812-4af1-9df9-9ff4b30f6db5 is already hosted by enough agents. {{(pid=102478) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:06:25.781831 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.scheduler.base_scheduler [None req-361d7fa9-f390-42fb-a065-910c6659f54d None None] Resources bound (agent type, host, resource id): {{(pid=102478) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:06:25.791720 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ce22787b-afe8-4964-87da-ad1a54938747 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:25.796302 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-361d7fa9-f390-42fb-a065-910c6659f54d None None] Received port after_create {{(pid=102478) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:06:25.811185 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] Checking router: 9df11fe3-ba73-4793-a582-0e00f27a374d for host: dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:06:25.811828 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] Updating router 9df11fe3-ba73-4793-a582-0e00f27a374d port 826094e8-3c74-4e96-9507-84128f7209f1 binding host dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 24 05:06:25.868038 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ce22787b-afe8-4964-87da-ad1a54938747 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:25.871590 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:25.937838 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-361d7fa9-f390-42fb-a065-910c6659f54d None None] Attempting to bind port b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0 on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:06:25.938217 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-361d7fa9-f390-42fb-a065-910c6659f54d None None] Attempting to bind port b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0 by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': '4a78b754-1ec8-4968-9b2e-553c2cd2237b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '0609ed93-c812-4af1-9df9-9ff4b30f6db5'}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:06:25.938581 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-361d7fa9-f390-42fb-a065-910c6659f54d None None] Attempting to bind port b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0 on network 0609ed93-c812-4af1-9df9-9ff4b30f6db5 {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:06:25.943919 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-859409f2-7f2a-4ed7-9ba4-aee07ca6b0f3 req-4a4dbc43-f74b-49d8-81a5-c1de184c188f tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 210 time: 0.0584986 Dec 24 05:06:25.991178 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-3149a3ed-e5e9-4ef4-a0fb-7f54dc5f914a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:26.030579 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:26.040595 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-361d7fa9-f390-42fb-a065-910c6659f54d None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 5, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:06:26.042541 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-361d7fa9-f390-42fb-a065-910c6659f54d None None] Checking segment: {'id': '4a78b754-1ec8-4968-9b2e-553c2cd2237b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '0609ed93-c812-4af1-9df9-9ff4b30f6db5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102478) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:06:26.043228 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-361d7fa9-f390-42fb-a065-910c6659f54d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:26.043802 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-361d7fa9-f390-42fb-a065-910c6659f54d None None] Bound using segment: {'id': '4a78b754-1ec8-4968-9b2e-553c2cd2237b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '0609ed93-c812-4af1-9df9-9ff4b30f6db5'} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:06:26.045454 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-361d7fa9-f390-42fb-a065-910c6659f54d None None] Bound port: b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4a78b754-1ec8-4968-9b2e-553c2cd2237b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '0609ed93-c812-4af1-9df9-9ff4b30f6db5'}}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:06:26.045859 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-361d7fa9-f390-42fb-a065-910c6659f54d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:26.092976 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3149a3ed-e5e9-4ef4-a0fb-7f54dc5f914a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Pushing event updated for resources: {'Port': ['ID=b8dc8fcb-f50d-49a3-9bd0-47110fdb068f,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:26.119580 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] For port cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:06:26.138539 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:26.151595 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-3149a3ed-e5e9-4ef4-a0fb-7f54dc5f914a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Network f6c8eead-66df-4cba-abce-78ee3b037ee2 is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:06:26.155544 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-3149a3ed-e5e9-4ef4-a0fb-7f54dc5f914a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:06:26.158708 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-3149a3ed-e5e9-4ef4-a0fb-7f54dc5f914a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:06:26.173987 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-361d7fa9-f390-42fb-a065-910c6659f54d None None] For port b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102478) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:06:26.214947 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-361d7fa9-f390-42fb-a065-910c6659f54d None None] For port b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0,segment=NetworkSegment(4a78b754-1ec8-4968-9b2e-553c2cd2237b),segment_id=4a78b754-1ec8-4968-9b2e-553c2cd2237b)] {{(pid=102478) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:06:26.228114 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [None req-ce22787b-afe8-4964-87da-ad1a54938747 admin admin] Allocated IP 172.27.1.176 (9b4e4b31-551f-45a9-b26a-cb44ee20a17d/f277b899-8779-420e-8a8d-bfcd5eb7f012/0eabffd2-992f-410d-9b71-973d0d669377) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:06:26.231299 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-361d7fa9-f390-42fb-a065-910c6659f54d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:26.258180 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-3149a3ed-e5e9-4ef4-a0fb-7f54dc5f914a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:26.259471 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-3149a3ed-e5e9-4ef4-a0fb-7f54dc5f914a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:26.260026 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Pushing event updated for resources: {'Port': ['ID=cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:26.321508 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-3149a3ed-e5e9-4ef4-a0fb-7f54dc5f914a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.46 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.4127326 Dec 24 05:06:26.340938 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-361d7fa9-f390-42fb-a065-910c6659f54d None None] Pushing event updated for resources: {'Port': ['ID=b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0,revision_number=2']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:26.427004 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] Publish callbacks [] for port, precommit_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:26.435861 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:26.510675 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:26.554378 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ce22787b-afe8-4964-87da-ad1a54938747 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:26.588661 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-729943c2-da3f-4ddf-ac8d-8713f448940e None None] Pushing event updated for resources: {'Port': ['ID=826094e8-3c74-4e96-9507-84128f7209f1,revision_number=3']} {{(pid=102479) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:26.650162 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ce22787b-afe8-4964-87da-ad1a54938747 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:26.682072 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-621371c4-48e0-4a5d-bfff-a4dbac30c9a9 None None] Provisioning complete for port b8dc8fcb-f50d-49a3-9bd0-47110fdb068f triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:26.682583 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-621371c4-48e0-4a5d-bfff-a4dbac30c9a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:26.720218 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ce22787b-afe8-4964-87da-ad1a54938747 admin admin] Network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:06:26.747667 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-ce22787b-afe8-4964-87da-ad1a54938747 admin admin] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:06:26.747667 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce22787b-afe8-4964-87da-ad1a54938747 admin admin] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:06:26.764328 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] Attempting to bind port 826094e8-3c74-4e96-9507-84128f7209f1 on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:06:26.765254 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] Attempting to bind port 826094e8-3c74-4e96-9507-84128f7209f1 by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': 'cb920e21-208e-474e-84a0-615ea3280b8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e'}] {{(pid=102479) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:06:26.766212 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] Attempting to bind port 826094e8-3c74-4e96-9507-84128f7209f1 on network df2331c3-0dd0-460e-980f-1e2409baa35e {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:06:26.773562 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce22787b-afe8-4964-87da-ad1a54938747 admin admin] Pushing event updated for resources: {'Port': ['ID=0eabffd2-992f-410d-9b71-973d0d669377,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:26.784439 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 5, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:06:26.788400 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] Checking segment: {'id': 'cb920e21-208e-474e-84a0-615ea3280b8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102479) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:06:26.788849 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:26.789245 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] Bound using segment: {'id': 'cb920e21-208e-474e-84a0-615ea3280b8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e'} {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:06:26.793951 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] Bound port: 826094e8-3c74-4e96-9507-84128f7209f1, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cb920e21-208e-474e-84a0-615ea3280b8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e'}}] {{(pid=102479) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:06:26.794384 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:26.818226 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-621371c4-48e0-4a5d-bfff-a4dbac30c9a9 None None] Port b8dc8fcb-f50d-49a3-9bd0-47110fdb068f cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 05:06:26.974376 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.db [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] For port 826094e8-3c74-4e96-9507-84128f7209f1, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102479) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:06:26.982145 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.db [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] For port 826094e8-3c74-4e96-9507-84128f7209f1, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=826094e8-3c74-4e96-9507-84128f7209f1,segment=NetworkSegment(cb920e21-208e-474e-84a0-615ea3280b8a),segment_id=cb920e21-208e-474e-84a0-615ea3280b8a)] {{(pid=102479) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:06:26.990824 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:27.065290 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-9a20158e-e7e5-4b62-ac63-983cacfe49e1 None None] Provisioning complete for port 826094e8-3c74-4e96-9507-84128f7209f1 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:27.065666 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-9a20158e-e7e5-4b62-ac63-983cacfe49e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:27.098840 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] Routers {'9df11fe3-ba73-4793-a582-0e00f27a374d'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:06:27.099574 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:06:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['9df11fe3-ba73-4793-a582-0e00f27a374d'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:27.175833 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-729943c2-da3f-4ddf-ac8d-8713f448940e None None] Pushing event updated for resources: {'Port': ['ID=826094e8-3c74-4e96-9507-84128f7209f1,revision_number=4']} {{(pid=102479) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:27.213851 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-9a20158e-e7e5-4b62-ac63-983cacfe49e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:27.234972 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f97b282-0a4f-4ede-b5b5-8893bfc59d2d req-92f18f98-daf2-47e4-a4a7-b8c5301b577a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:27.237278 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4f97b282-0a4f-4ede-b5b5-8893bfc59d2d req-92f18f98-daf2-47e4-a4a7-b8c5301b577a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 931 time: 0.1362808 Dec 24 05:06:27.277688 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-9a20158e-e7e5-4b62-ac63-983cacfe49e1 None None] For port 826094e8-3c74-4e96-9507-84128f7209f1, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=826094e8-3c74-4e96-9507-84128f7209f1,segment=NetworkSegment(cb920e21-208e-474e-84a0-615ea3280b8a),segment_id=cb920e21-208e-474e-84a0-615ea3280b8a)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:06:27.289590 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-9a20158e-e7e5-4b62-ac63-983cacfe49e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:27.315406 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] Set router 9df11fe3-ba73-4793-a582-0e00f27a374d gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:06:27.333938 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4f97b282-0a4f-4ede-b5b5-8893bfc59d2d req-06a0633d-1f08-4ad4-bd0a-53b803fa4c5b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0885062 Dec 24 05:06:27.334894 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ce22787b-afe8-4964-87da-ad1a54938747 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:27.405267 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a20158e-e7e5-4b62-ac63-983cacfe49e1 None None] Pushing event updated for resources: {'Port': ['ID=826094e8-3c74-4e96-9507-84128f7209f1,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:27.534212 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-6e8ff2ae-6772-43c8-a505-f62565ba5e3a None None] Provisioning complete for port 826094e8-3c74-4e96-9507-84128f7209f1 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:27.534599 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-6e8ff2ae-6772-43c8-a505-f62565ba5e3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:27.806401 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '826094e8-3c74-4e96-9507-84128f7209f1', 'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'mac_address': 'fa:16:3e:b3:73:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:21Z', 'updated_at': '2021-12-24T05:06:26Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'subnets': [{'id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:27.819375 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 826094e8-3c74-4e96-9507-84128f7209f1 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:27.902041 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a9d17f99-f77c-42bf-9aff-23bf600b25c2 None None] The sync data for ids ['9df11fe3-ba73-4793-a582-0e00f27a374d'] in dv-cinder-816443-2-iscsi is: [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '826094e8-3c74-4e96-9507-84128f7209f1', 'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'mac_address': 'fa:16:3e:b3:73:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:21Z', 'updated_at': '2021-12-24T05:06:26Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'subnets': [{'id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:06:27.960940 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:27.979664 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 826094e8-3c74-4e96-9507-84128f7209f1 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:27.980326 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:28.120485 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-574de10e-e264-43d1-8a15-ce4e9be96f8f None None] Network 0609ed93-c812-4af1-9df9-9ff4b30f6db5 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:06:28.206157 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ce22787b-afe8-4964-87da-ad1a54938747 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-546295', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-545958'] for router, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:28.216003 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:28.224465 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8be26256-3149-4099-8a76-2ca39b6a518f None None] Provisioning complete for port b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:28.225053 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8be26256-3149-4099-8a76-2ca39b6a518f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:28.401692 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:28.409503 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:28.487033 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ce22787b-afe8-4964-87da-ad1a54938747 admin admin] Router ba235614-f658-4ae3-8e87-a8cacc752ef0 is scheduled to L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 with binding_index 1 {{(pid=102476) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 24 05:06:28.513433 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce1fa88-5fcf-4838-8a5d-c2df46a1ea2d req-01395406-ec56-4266-b125-4f9f0dcfc56e tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:28.523806 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7ce1fa88-5fcf-4838-8a5d-c2df46a1ea2d req-01395406-ec56-4266-b125-4f9f0dcfc56e tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 931 time: 0.0760016 Dec 24 05:06:28.608751 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-7ce1fa88-5fcf-4838-8a5d-c2df46a1ea2d req-7f94789e-f470-47b6-869a-5363c4b011a6 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0814703 Dec 24 05:06:28.672719 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ce22787b-afe8-4964-87da-ad1a54938747 admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:06:28.694255 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ce22787b-afe8-4964-87da-ad1a54938747 admin admin] Publish callbacks [] for router, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:28.696170 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-ce22787b-afe8-4964-87da-ad1a54938747 admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 3.6870100 Dec 24 05:06:28.704570 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 33062) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:28.738418 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] Sync routers for ids ['ba235614-f658-4ae3-8e87-a8cacc752ef0'] in dv-cinder-816443-2-iscsi {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:06:28.794763 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] Routers {'ba235614-f658-4ae3-8e87-a8cacc752ef0'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:06:28.796343 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:06:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['ba235614-f658-4ae3-8e87-a8cacc752ef0'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:28.891145 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8be26256-3149-4099-8a76-2ca39b6a518f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:28.902200 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:29.175256 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:29.199718 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-8be26256-3149-4099-8a76-2ca39b6a518f None None] For port b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0,segment=NetworkSegment(4a78b754-1ec8-4968-9b2e-553c2cd2237b),segment_id=4a78b754-1ec8-4968-9b2e-553c2cd2237b)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:06:29.223472 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8be26256-3149-4099-8a76-2ca39b6a518f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:29.310873 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] Set router ba235614-f658-4ae3-8e87-a8cacc752ef0 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:06:29.350060 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8be26256-3149-4099-8a76-2ca39b6a518f None None] Pushing event updated for resources: {'Port': ['ID=b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0,revision_number=3']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:29.435679 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-401475b0-d6f1-4bf8-a7db-ac8f93c36779 None None] Provisioning complete for port b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:29.436371 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-401475b0-d6f1-4bf8-a7db-ac8f93c36779 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:29.478670 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-26a5bd46-a465-4f96-9fb0-1825892318fd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:29.480375 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:29.480816 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:29.666346 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.db_base_plugin_common [None req-26a5bd46-a465-4f96-9fb0-1825892318fd admin admin] Allocated IP 172.20.0.1 (0609ed93-c812-4af1-9df9-9ff4b30f6db5/be96039d-7619-4886-a09d-561401ca5c41/651e2e0a-96cc-4dd5-a12b-875c42bbdf24) {{(pid=102477) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:06:29.729528 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ba235614-f658-4ae3-8e87-a8cacc752ef0', 'name': 'tempest-TestVolumeBootPattern-26042513-router', 'tenant_id': 'bf7b649b22d644f4971ea81dfca887e0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.176'}], 'enable_snat': True}, 'gw_port_id': '0eabffd2-992f-410d-9b71-973d0d669377', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:25Z', 'updated_at': '2021-12-24T05:06:27Z', 'revision_number': 3, 'project_id': 'bf7b649b22d644f4971ea81dfca887e0', 'gw_port': {'id': '0eabffd2-992f-410d-9b71-973d0d669377', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:9b:39', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ba235614-f658-4ae3-8e87-a8cacc752ef0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:25Z', 'updated_at': '2021-12-24T05:06:26Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:29.759267 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] Checking router: ba235614-f658-4ae3-8e87-a8cacc752ef0 for host: dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:06:29.759618 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] Updating router ba235614-f658-4ae3-8e87-a8cacc752ef0 port 0eabffd2-992f-410d-9b71-973d0d669377 binding host dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 24 05:06:29.785023 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ba9b055-1f4a-4e1a-a03b-85ced1f44f14 req-d173af86-da6b-489e-bf1d-51270539eff3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:29.792071 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:29.792477 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0ba9b055-1f4a-4e1a-a03b-85ced1f44f14 req-d173af86-da6b-489e-bf1d-51270539eff3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 931 time: 0.1134439 Dec 24 05:06:29.859144 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-26a5bd46-a465-4f96-9fb0-1825892318fd admin admin] Publish callbacks [] for port, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:29.891791 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0ba9b055-1f4a-4e1a-a03b-85ced1f44f14 req-fcf59368-a261-4370-be55-48867865ff3c tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0837817 Dec 24 05:06:29.904907 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 826094e8-3c74-4e96-9507-84128f7209f1 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:29.917413 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-26a5bd46-a465-4f96-9fb0-1825892318fd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:29.961670 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-26a5bd46-a465-4f96-9fb0-1825892318fd admin admin] Network 0609ed93-c812-4af1-9df9-9ff4b30f6db5 is already hosted by enough agents. {{(pid=102477) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:06:29.964578 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-26a5bd46-a465-4f96-9fb0-1825892318fd admin admin] Resources bound (agent type, host, resource id): {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:06:29.968380 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26a5bd46-a465-4f96-9fb0-1825892318fd admin admin] Received port after_create {{(pid=102477) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:06:29.999477 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26a5bd46-a465-4f96-9fb0-1825892318fd admin admin] Pushing event updated for resources: {'Port': ['ID=651e2e0a-96cc-4dd5-a12b-875c42bbdf24,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:30.021032 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-26a5bd46-a465-4f96-9fb0-1825892318fd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-545913'] for router_interface, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:30.049071 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 826094e8-3c74-4e96-9507-84128f7209f1 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:30.049452 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:30.220609 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-26a5bd46-a465-4f96-9fb0-1825892318fd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:30.225349 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] Publish callbacks [] for port, precommit_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:30.228055 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:30.280106 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:30.371095 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af357e75-215b-4bf8-a334-489467ae2d4c None None] Pushing event updated for resources: {'Port': ['ID=0eabffd2-992f-410d-9b71-973d0d669377,revision_number=2']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:30.373990 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-cb437e65-c1ab-4a54-979b-6cc5f57c1720 None None] Provisioning complete for port 651e2e0a-96cc-4dd5-a12b-875c42bbdf24 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:30.374355 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-cb437e65-c1ab-4a54-979b-6cc5f57c1720 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:30.376852 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] Attempting to bind port 0eabffd2-992f-410d-9b71-973d0d669377 on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:06:30.377691 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] Attempting to bind port 0eabffd2-992f-410d-9b71-973d0d669377 by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:06:30.377691 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] Attempting to bind port 0eabffd2-992f-410d-9b71-973d0d669377 on network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:06:30.415443 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 6, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:06:30.415832 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] Checking segment: {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102478) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:06:30.416119 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:30.416511 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] Bound using segment: {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:06:30.417016 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] Bound port: 0eabffd2-992f-410d-9b71-973d0d669377, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:06:30.417389 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:30.421524 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:30.421889 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:30.424825 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-26a5bd46-a465-4f96-9fb0-1825892318fd admin admin] Publish callbacks [] for port, precommit_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:30.429977 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-26a5bd46-a465-4f96-9fb0-1825892318fd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29535615'] for port, after_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:30.482542 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-cb437e65-c1ab-4a54-979b-6cc5f57c1720 None None] Port 651e2e0a-96cc-4dd5-a12b-875c42bbdf24 cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 05:06:30.505109 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26a5bd46-a465-4f96-9fb0-1825892318fd admin admin] Pushing event updated for resources: {'Port': ['ID=651e2e0a-96cc-4dd5-a12b-875c42bbdf24,revision_number=2']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:30.507728 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-26a5bd46-a465-4f96-9fb0-1825892318fd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-627486', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-548585'] for router_interface, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:30.524094 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] For port 0eabffd2-992f-410d-9b71-973d0d669377, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102478) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:06:30.527960 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] For port 0eabffd2-992f-410d-9b71-973d0d669377, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=0eabffd2-992f-410d-9b71-973d0d669377,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102478) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:06:30.535996 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:30.628306 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-26a5bd46-a465-4f96-9fb0-1825892318fd admin admin] Network 0609ed93-c812-4af1-9df9-9ff4b30f6db5 is already hosted by enough agents. {{(pid=102477) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:06:30.629764 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-26a5bd46-a465-4f96-9fb0-1825892318fd admin admin] Resources bound (agent type, host, resource id): {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:06:30.633552 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af357e75-215b-4bf8-a334-489467ae2d4c None None] Pushing event updated for resources: {'Port': ['ID=0eabffd2-992f-410d-9b71-973d0d669377,revision_number=3']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:30.641784 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] Routers {'ba235614-f658-4ae3-8e87-a8cacc752ef0'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:06:30.642539 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:06:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['ba235614-f658-4ae3-8e87-a8cacc752ef0'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:30.780907 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] Set router ba235614-f658-4ae3-8e87-a8cacc752ef0 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:06:30.788258 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-26a5bd46-a465-4f96-9fb0-1825892318fd admin admin] Router ba235614-f658-4ae3-8e87-a8cacc752ef0 has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102477) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:06:30.938647 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-26a5bd46-a465-4f96-9fb0-1825892318fd admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102477) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:06:30.958693 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-26a5bd46-a465-4f96-9fb0-1825892318fd admin admin] 10.222.0.43 "PUT /v2.0/routers/ba235614-f658-4ae3-8e87-a8cacc752ef0/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2517674 Dec 24 05:06:30.962272 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-72c20f4a-0806-4bba-acb2-599ba2923ce5 None None] Provisioning complete for port 651e2e0a-96cc-4dd5-a12b-875c42bbdf24 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:30.962660 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-72c20f4a-0806-4bba-acb2-599ba2923ce5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:31.011785 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9deba91c-e4c8-485e-a234-b76a0bec4303 req-12dd28b9-66f8-4e4f-8fcd-952de8e0f8af tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:31.019746 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-9deba91c-e4c8-485e-a234-b76a0bec4303 req-12dd28b9-66f8-4e4f-8fcd-952de8e0f8af tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 931 time: 0.0549459 Dec 24 05:06:31.035500 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-72c20f4a-0806-4bba-acb2-599ba2923ce5 None None] Port 651e2e0a-96cc-4dd5-a12b-875c42bbdf24 cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 05:06:31.068689 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ba235614-f658-4ae3-8e87-a8cacc752ef0', 'name': 'tempest-TestVolumeBootPattern-26042513-router', 'tenant_id': 'bf7b649b22d644f4971ea81dfca887e0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.176'}], 'enable_snat': True}, 'gw_port_id': '0eabffd2-992f-410d-9b71-973d0d669377', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:25Z', 'updated_at': '2021-12-24T05:06:30Z', 'revision_number': 4, 'project_id': 'bf7b649b22d644f4971ea81dfca887e0', 'gw_port': {'id': '0eabffd2-992f-410d-9b71-973d0d669377', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:9b:39', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ba235614-f658-4ae3-8e87-a8cacc752ef0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:25Z', 'updated_at': '2021-12-24T05:06:30Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '651e2e0a-96cc-4dd5-a12b-875c42bbdf24', 'name': '', 'network_id': '0609ed93-c812-4af1-9df9-9ff4b30f6db5', 'tenant_id': 'bf7b649b22d644f4971ea81dfca887e0', 'mac_address': 'fa:16:3e:a9:6d:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ba235614-f658-4ae3-8e87-a8cacc752ef0', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': 'be96039d-7619-4886-a09d-561401ca5c41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:29Z', 'updated_at': '2021-12-24T05:06:30Z', 'revision_number': 2, 'project_id': 'bf7b649b22d644f4971ea81dfca887e0', 'subnets': [{'id': 'be96039d-7619-4886-a09d-561401ca5c41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:31.082778 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-9deba91c-e4c8-485e-a234-b76a0bec4303 req-8217ba2a-e8b7-49e2-9b8a-70f0da9f48b5 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0619664 Dec 24 05:06:31.097565 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7d705c9-cc17-4b18-b26a-d0c5ce5e633f None None] The sync data for ids ['ba235614-f658-4ae3-8e87-a8cacc752ef0'] in dv-cinder-816443-2-iscsi is: [{'id': 'ba235614-f658-4ae3-8e87-a8cacc752ef0', 'name': 'tempest-TestVolumeBootPattern-26042513-router', 'tenant_id': 'bf7b649b22d644f4971ea81dfca887e0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.176'}], 'enable_snat': True}, 'gw_port_id': '0eabffd2-992f-410d-9b71-973d0d669377', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:25Z', 'updated_at': '2021-12-24T05:06:30Z', 'revision_number': 4, 'project_id': 'bf7b649b22d644f4971ea81dfca887e0', 'gw_port': {'id': '0eabffd2-992f-410d-9b71-973d0d669377', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:9b:39', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ba235614-f658-4ae3-8e87-a8cacc752ef0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:25Z', 'updated_at': '2021-12-24T05:06:30Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '651e2e0a-96cc-4dd5-a12b-875c42bbdf24', 'name': '', 'network_id': '0609ed93-c812-4af1-9df9-9ff4b30f6db5', 'tenant_id': 'bf7b649b22d644f4971ea81dfca887e0', 'mac_address': 'fa:16:3e:a9:6d:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ba235614-f658-4ae3-8e87-a8cacc752ef0', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': 'be96039d-7619-4886-a09d-561401ca5c41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:29Z', 'updated_at': '2021-12-24T05:06:30Z', 'revision_number': 2, 'project_id': 'bf7b649b22d644f4971ea81dfca887e0', 'subnets': [{'id': 'be96039d-7619-4886-a09d-561401ca5c41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:06:31.910178 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 33092) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:31.914782 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-14f087ba-63d3-4af0-a07b-62e5201d3475 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-2046201915', 'description': 'tempest-secgroup-smoke-2046201915 description', 'project_id': '8b1a80c6322a493ba10c69a77168b46f'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:31.981021 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-14f087ba-63d3-4af0-a07b-62e5201d3475 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:32.127224 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-14f087ba-63d3-4af0-a07b-62e5201d3475 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:32.134327 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-14f087ba-63d3-4af0-a07b-62e5201d3475 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:32.160141 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-14f087ba-63d3-4af0-a07b-62e5201d3475 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:32.161770 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-14f087ba-63d3-4af0-a07b-62e5201d3475 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.2505581 Dec 24 05:06:32.164951 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 33096) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:32.169508 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-a74965a4-768c-4cd0-accd-8a732fa93af1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Request body: {'security_group_rule': {'security_group_id': 'b4b0be72-ffa9-4e18-8986-808181a3a50d', 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:32.195384 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14f087ba-63d3-4af0-a07b-62e5201d3475 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b4b0be72-ffa9-4e18-8986-808181a3a50d,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:32.451821 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f4a6271-b70d-4e83-a6a5-01497115fe98 req-af12058d-b791-4ff3-95ab-f68db599c336 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:32.453527 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4f4a6271-b70d-4e83-a6a5-01497115fe98 req-af12058d-b791-4ff3-95ab-f68db599c336 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 931 time: 0.2774110 Dec 24 05:06:32.477551 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a74965a4-768c-4cd0-accd-8a732fa93af1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:32.542943 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4f4a6271-b70d-4e83-a6a5-01497115fe98 req-9a84ef57-91fe-4709-9270-0aebd976a7ab tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0799348 Dec 24 05:06:32.578633 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a74965a4-768c-4cd0-accd-8a732fa93af1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:32.583195 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a74965a4-768c-4cd0-accd-8a732fa93af1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:32.600438 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a74965a4-768c-4cd0-accd-8a732fa93af1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=719f1aba-8fc7-4f08-a155-04495a584365,revision_number=0']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:32.633933 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a74965a4-768c-4cd0-accd-8a732fa93af1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:32.635036 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-a74965a4-768c-4cd0-accd-8a732fa93af1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4690497 Dec 24 05:06:32.637818 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 33100) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:32.643439 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-a3ca76c5-bdba-4fcc-9aca-3ead7bdbf6b9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Request body: {'security_group_rule': {'security_group_id': 'b4b0be72-ffa9-4e18-8986-808181a3a50d', 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:32.684024 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a3ca76c5-bdba-4fcc-9aca-3ead7bdbf6b9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:32.751636 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a3ca76c5-bdba-4fcc-9aca-3ead7bdbf6b9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:32.756709 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a3ca76c5-bdba-4fcc-9aca-3ead7bdbf6b9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:32.781074 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3ca76c5-bdba-4fcc-9aca-3ead7bdbf6b9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3860025c-6c94-438e-b627-f597208b8468,revision_number=0']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:32.787063 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a3ca76c5-bdba-4fcc-9aca-3ead7bdbf6b9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:32.788763 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-a3ca76c5-bdba-4fcc-9aca-3ead7bdbf6b9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1493561 Dec 24 05:06:32.790907 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 33102) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:32.796126 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-d4d324a8-b7f7-433f-9860-ac45c50ac21f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Request body: {'security_group_rule': {'security_group_id': 'b4b0be72-ffa9-4e18-8986-808181a3a50d', 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:32.827509 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d4d324a8-b7f7-433f-9860-ac45c50ac21f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:32.887111 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d4d324a8-b7f7-433f-9860-ac45c50ac21f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:32.892686 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d4d324a8-b7f7-433f-9860-ac45c50ac21f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:32.913208 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4d324a8-b7f7-433f-9860-ac45c50ac21f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d18106cd-eb8a-408b-94f5-9ca2a5b2dd2d,revision_number=0']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:32.923386 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d4d324a8-b7f7-433f-9860-ac45c50ac21f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:32.924646 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-d4d324a8-b7f7-433f-9860-ac45c50ac21f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1324127 Dec 24 05:06:32.927332 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 33104) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:32.931933 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-f4c4ee6b-da0e-481c-bdba-2ffc75d88bfb tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Request body: {'security_group_rule': {'security_group_id': 'b4b0be72-ffa9-4e18-8986-808181a3a50d', 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:32.967853 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f4c4ee6b-da0e-481c-bdba-2ffc75d88bfb tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:33.047614 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f4c4ee6b-da0e-481c-bdba-2ffc75d88bfb tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:33.053392 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f4c4ee6b-da0e-481c-bdba-2ffc75d88bfb tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:33.074087 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4c4ee6b-da0e-481c-bdba-2ffc75d88bfb tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=09c6a2c0-86a8-465e-a6d1-12e23c257314,revision_number=0']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:33.090471 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f4c4ee6b-da0e-481c-bdba-2ffc75d88bfb tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:33.094460 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-f4c4ee6b-da0e-481c-bdba-2ffc75d88bfb tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1634891 Dec 24 05:06:33.094894 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 33106) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:33.099946 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-a22d30b1-5f61-4523-9c07-44360d76db5c tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Request body: {'security_group_rule': {'security_group_id': 'b4b0be72-ffa9-4e18-8986-808181a3a50d', 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:33.127072 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.securitygroups_db [None req-a22d30b1-5f61-4523-9c07-44360d76db5c tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Project 8b1a80c6322a493ba10c69a77168b46f added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 24 05:06:33.134468 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a22d30b1-5f61-4523-9c07-44360d76db5c tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:33.206917 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a22d30b1-5f61-4523-9c07-44360d76db5c tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:33.212494 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a22d30b1-5f61-4523-9c07-44360d76db5c tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:33.229851 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a22d30b1-5f61-4523-9c07-44360d76db5c tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bf7318bc-2635-4069-ad59-b7ceac708f4a,revision_number=0']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:33.236398 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a22d30b1-5f61-4523-9c07-44360d76db5c tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:33.240303 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-a22d30b1-5f61-4523-9c07-44360d76db5c tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1415312 Dec 24 05:06:33.240418 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 33108) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:33.244701 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-ac268dcf-f9e7-4dfd-ad7f-86c66d9a81f3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Request body: {'security_group_rule': {'security_group_id': 'b4b0be72-ffa9-4e18-8986-808181a3a50d', 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:33.269606 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.securitygroups_db [None req-ac268dcf-f9e7-4dfd-ad7f-86c66d9a81f3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Project 8b1a80c6322a493ba10c69a77168b46f added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 24 05:06:33.275903 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ac268dcf-f9e7-4dfd-ad7f-86c66d9a81f3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:33.336760 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ac268dcf-f9e7-4dfd-ad7f-86c66d9a81f3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:33.342088 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ac268dcf-f9e7-4dfd-ad7f-86c66d9a81f3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:33.366887 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac268dcf-f9e7-4dfd-ad7f-86c66d9a81f3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7e6e23f5-a14d-472e-aeff-9b9c5bc992bf,revision_number=0']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:33.385034 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ac268dcf-f9e7-4dfd-ad7f-86c66d9a81f3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:33.386286 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-ac268dcf-f9e7-4dfd-ad7f-86c66d9a81f3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1449978 Dec 24 05:06:33.684068 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd3025d7-ee8c-4d28-9f4b-aae418d4f117 req-3583f91b-484b-48b8-8966-7a47ed85c43e tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:33.686494 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-fd3025d7-ee8c-4d28-9f4b-aae418d4f117 req-3583f91b-484b-48b8-8966-7a47ed85c43e tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 931 time: 0.0677602 Dec 24 05:06:33.747941 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-fd3025d7-ee8c-4d28-9f4b-aae418d4f117 req-60b4e187-e5e1-43b9-a52e-2ec9df92d9a1 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0536957 Dec 24 05:06:33.855721 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 0eabffd2-992f-410d-9b71-973d0d669377 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:33.955104 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 0eabffd2-992f-410d-9b71-973d0d669377 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:33.957762 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:34.046675 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:34.069538 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] For port 0eabffd2-992f-410d-9b71-973d0d669377, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=0eabffd2-992f-410d-9b71-973d0d669377,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:06:34.075634 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:34.266143 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Pushing event updated for resources: {'Port': ['ID=0eabffd2-992f-410d-9b71-973d0d669377,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:34.887199 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-693a4652-8cab-4abc-b166-0b8b05c22fca req-d3181792-753d-4840-a245-f0038a81d505 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:34.888708 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-693a4652-8cab-4abc-b166-0b8b05c22fca req-d3181792-753d-4840-a245-f0038a81d505 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 931 time: 0.0555232 Dec 24 05:06:34.940466 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-693a4652-8cab-4abc-b166-0b8b05c22fca req-78a1615e-04ed-4727-81cf-aa65012abc59 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445693 Dec 24 05:06:35.470973 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] Sync routers for ids ['ba235614-f658-4ae3-8e87-a8cacc752ef0'] in dv-cinder-816443-2-iscsi {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:06:35.484126 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] Routers {'ba235614-f658-4ae3-8e87-a8cacc752ef0'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:06:35.485331 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:06:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['ba235614-f658-4ae3-8e87-a8cacc752ef0'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:35.598058 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] Set router ba235614-f658-4ae3-8e87-a8cacc752ef0 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:06:35.811357 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 0eabffd2-992f-410d-9b71-973d0d669377 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:35.865155 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 0eabffd2-992f-410d-9b71-973d0d669377 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:35.865448 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:35.899300 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ba235614-f658-4ae3-8e87-a8cacc752ef0', 'name': 'tempest-TestVolumeBootPattern-26042513-router', 'tenant_id': 'bf7b649b22d644f4971ea81dfca887e0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.176'}], 'enable_snat': True}, 'gw_port_id': '0eabffd2-992f-410d-9b71-973d0d669377', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:25Z', 'updated_at': '2021-12-24T05:06:30Z', 'revision_number': 4, 'project_id': 'bf7b649b22d644f4971ea81dfca887e0', 'gw_port': {'id': '0eabffd2-992f-410d-9b71-973d0d669377', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:9b:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba235614-f658-4ae3-8e87-a8cacc752ef0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:25Z', 'updated_at': '2021-12-24T05:06:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '651e2e0a-96cc-4dd5-a12b-875c42bbdf24', 'name': '', 'network_id': '0609ed93-c812-4af1-9df9-9ff4b30f6db5', 'tenant_id': 'bf7b649b22d644f4971ea81dfca887e0', 'mac_address': 'fa:16:3e:a9:6d:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ba235614-f658-4ae3-8e87-a8cacc752ef0', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': 'be96039d-7619-4886-a09d-561401ca5c41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:29Z', 'updated_at': '2021-12-24T05:06:30Z', 'revision_number': 2, 'project_id': 'bf7b649b22d644f4971ea81dfca887e0', 'subnets': [{'id': 'be96039d-7619-4886-a09d-561401ca5c41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:35.926946 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] Checking router: ba235614-f658-4ae3-8e87-a8cacc752ef0 for host: dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:06:35.927301 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] Updating router ba235614-f658-4ae3-8e87-a8cacc752ef0 port 651e2e0a-96cc-4dd5-a12b-875c42bbdf24 binding host dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 24 05:06:35.955337 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:36.073326 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffce7a4c-7aed-4325-b2f9-234cc82c7d65 req-7acb681b-941a-4564-a7cc-75faa4ea2cf8 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:36.074799 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ffce7a4c-7aed-4325-b2f9-234cc82c7d65 req-7acb681b-941a-4564-a7cc-75faa4ea2cf8 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 931 time: 0.0508204 Dec 24 05:06:36.127539 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ffce7a4c-7aed-4325-b2f9-234cc82c7d65 req-0b431c83-01e5-4772-8f54-b3e59e148cec tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461626 Dec 24 05:06:36.222343 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] Publish callbacks [] for port, precommit_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:36.230706 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:36.284517 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86d67dc6-7d12-46d6-9684-41bf876ba758 None None] Pushing event updated for resources: {'Port': ['ID=651e2e0a-96cc-4dd5-a12b-875c42bbdf24,revision_number=3']} {{(pid=102479) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:36.339895 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] Attempting to bind port 651e2e0a-96cc-4dd5-a12b-875c42bbdf24 on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:06:36.340255 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] Attempting to bind port 651e2e0a-96cc-4dd5-a12b-875c42bbdf24 by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': '4a78b754-1ec8-4968-9b2e-553c2cd2237b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '0609ed93-c812-4af1-9df9-9ff4b30f6db5'}] {{(pid=102479) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:06:36.340647 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] Attempting to bind port 651e2e0a-96cc-4dd5-a12b-875c42bbdf24 on network 0609ed93-c812-4af1-9df9-9ff4b30f6db5 {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:06:36.346079 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 6, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:06:36.346532 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] Checking segment: {'id': '4a78b754-1ec8-4968-9b2e-553c2cd2237b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '0609ed93-c812-4af1-9df9-9ff4b30f6db5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102479) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:06:36.346990 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:36.347363 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] Bound using segment: {'id': '4a78b754-1ec8-4968-9b2e-553c2cd2237b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '0609ed93-c812-4af1-9df9-9ff4b30f6db5'} {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:06:36.347825 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] Bound port: 651e2e0a-96cc-4dd5-a12b-875c42bbdf24, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4a78b754-1ec8-4968-9b2e-553c2cd2237b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '0609ed93-c812-4af1-9df9-9ff4b30f6db5'}}] {{(pid=102479) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:06:36.348215 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:36.414839 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.db [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] For port 651e2e0a-96cc-4dd5-a12b-875c42bbdf24, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102479) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:06:36.418069 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.db [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] For port 651e2e0a-96cc-4dd5-a12b-875c42bbdf24, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=651e2e0a-96cc-4dd5-a12b-875c42bbdf24,segment=NetworkSegment(4a78b754-1ec8-4968-9b2e-553c2cd2237b),segment_id=4a78b754-1ec8-4968-9b2e-553c2cd2237b)] {{(pid=102479) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:06:36.425360 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:36.482528 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86d67dc6-7d12-46d6-9684-41bf876ba758 None None] Pushing event updated for resources: {'Port': ['ID=651e2e0a-96cc-4dd5-a12b-875c42bbdf24,revision_number=4']} {{(pid=102479) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:36.485397 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] Routers {'ba235614-f658-4ae3-8e87-a8cacc752ef0'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:06:36.486025 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:06:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['ba235614-f658-4ae3-8e87-a8cacc752ef0'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:36.513708 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-1b7892c1-56e5-44ed-a96c-edf37a44530e None None] Provisioning complete for port 651e2e0a-96cc-4dd5-a12b-875c42bbdf24 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:36.514410 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-1b7892c1-56e5-44ed-a96c-edf37a44530e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:36.598973 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-1b7892c1-56e5-44ed-a96c-edf37a44530e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:36.611512 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] Set router ba235614-f658-4ae3-8e87-a8cacc752ef0 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:06:36.632451 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-1b7892c1-56e5-44ed-a96c-edf37a44530e None None] For port 651e2e0a-96cc-4dd5-a12b-875c42bbdf24, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=651e2e0a-96cc-4dd5-a12b-875c42bbdf24,segment=NetworkSegment(4a78b754-1ec8-4968-9b2e-553c2cd2237b),segment_id=4a78b754-1ec8-4968-9b2e-553c2cd2237b)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:06:36.640454 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-1b7892c1-56e5-44ed-a96c-edf37a44530e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:36.692798 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b7892c1-56e5-44ed-a96c-edf37a44530e None None] Pushing event updated for resources: {'Port': ['ID=651e2e0a-96cc-4dd5-a12b-875c42bbdf24,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:36.761772 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-a1fd37bb-522b-4e41-a14c-1cf5a01326aa None None] Provisioning complete for port 651e2e0a-96cc-4dd5-a12b-875c42bbdf24 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:36.762129 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-a1fd37bb-522b-4e41-a14c-1cf5a01326aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:36.826792 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ba235614-f658-4ae3-8e87-a8cacc752ef0', 'name': 'tempest-TestVolumeBootPattern-26042513-router', 'tenant_id': 'bf7b649b22d644f4971ea81dfca887e0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.176'}], 'enable_snat': True}, 'gw_port_id': '0eabffd2-992f-410d-9b71-973d0d669377', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:25Z', 'updated_at': '2021-12-24T05:06:30Z', 'revision_number': 4, 'project_id': 'bf7b649b22d644f4971ea81dfca887e0', 'gw_port': {'id': '0eabffd2-992f-410d-9b71-973d0d669377', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:9b:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba235614-f658-4ae3-8e87-a8cacc752ef0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:25Z', 'updated_at': '2021-12-24T05:06:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '651e2e0a-96cc-4dd5-a12b-875c42bbdf24', 'name': '', 'network_id': '0609ed93-c812-4af1-9df9-9ff4b30f6db5', 'tenant_id': 'bf7b649b22d644f4971ea81dfca887e0', 'mac_address': 'fa:16:3e:a9:6d:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ba235614-f658-4ae3-8e87-a8cacc752ef0', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': 'be96039d-7619-4886-a09d-561401ca5c41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:29Z', 'updated_at': '2021-12-24T05:06:36Z', 'revision_number': 4, 'project_id': 'bf7b649b22d644f4971ea81dfca887e0', 'subnets': [{'id': 'be96039d-7619-4886-a09d-561401ca5c41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:36.854128 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92f52326-b095-4035-bcbb-0c1af37c0678 None None] The sync data for ids ['ba235614-f658-4ae3-8e87-a8cacc752ef0'] in dv-cinder-816443-2-iscsi is: [{'id': 'ba235614-f658-4ae3-8e87-a8cacc752ef0', 'name': 'tempest-TestVolumeBootPattern-26042513-router', 'tenant_id': 'bf7b649b22d644f4971ea81dfca887e0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.176'}], 'enable_snat': True}, 'gw_port_id': '0eabffd2-992f-410d-9b71-973d0d669377', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:25Z', 'updated_at': '2021-12-24T05:06:30Z', 'revision_number': 4, 'project_id': 'bf7b649b22d644f4971ea81dfca887e0', 'gw_port': {'id': '0eabffd2-992f-410d-9b71-973d0d669377', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:9b:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba235614-f658-4ae3-8e87-a8cacc752ef0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:25Z', 'updated_at': '2021-12-24T05:06:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '651e2e0a-96cc-4dd5-a12b-875c42bbdf24', 'name': '', 'network_id': '0609ed93-c812-4af1-9df9-9ff4b30f6db5', 'tenant_id': 'bf7b649b22d644f4971ea81dfca887e0', 'mac_address': 'fa:16:3e:a9:6d:05', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ba235614-f658-4ae3-8e87-a8cacc752ef0', 'device_owner': 'network:router_interface', 'standard_attr_id': 546, 'fixed_ips': [{'subnet_id': 'be96039d-7619-4886-a09d-561401ca5c41', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:29Z', 'updated_at': '2021-12-24T05:06:36Z', 'revision_number': 4, 'project_id': 'bf7b649b22d644f4971ea81dfca887e0', 'subnets': [{'id': 'be96039d-7619-4886-a09d-561401ca5c41', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:06:37.250507 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd4addde-3b07-4899-abec-2ac2e0c94239 req-1278a71d-9770-4f4f-820f-70c8baaaaab5 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:37.251629 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-cd4addde-3b07-4899-abec-2ac2e0c94239 req-1278a71d-9770-4f4f-820f-70c8baaaaab5 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 931 time: 0.0556355 Dec 24 05:06:37.302787 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-cd4addde-3b07-4899-abec-2ac2e0c94239 req-d10a0d4f-6fd2-43ee-bba7-46e5a44ab62a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451057 Dec 24 05:06:37.822370 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 651e2e0a-96cc-4dd5-a12b-875c42bbdf24 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:37.878504 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 651e2e0a-96cc-4dd5-a12b-875c42bbdf24 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:37.878891 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:38.430266 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-facc7743-1f11-4d16-8422-2fe17232792a req-38c5578e-c7bc-4d0a-8944-896b86c693e2 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:38.432154 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-facc7743-1f11-4d16-8422-2fe17232792a req-38c5578e-c7bc-4d0a-8944-896b86c693e2 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 931 time: 0.0518398 Dec 24 05:06:38.487132 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-facc7743-1f11-4d16-8422-2fe17232792a req-8e4a2bd3-c461-4dc3-8896-f7b652ab02a3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432162 Dec 24 05:06:38.808251 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-bdb2c1f7-983f-4eb4-af47-4470d5b9eb20 service neutron] Request body: {'port': {'device_id': 'ae7a102d-4793-4384-bc31-07d28018c9df', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81644'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:38.867474 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-bdb2c1f7-983f-4eb4-af47-4470d5b9eb20 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:39.151048 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-bdb2c1f7-983f-4eb4-af47-4470d5b9eb20 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b8dc8fcb-f50d-49a3-9bd0-47110fdb068f {{(pid=102476) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:06:39.160161 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-bdb2c1f7-983f-4eb4-af47-4470d5b9eb20 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:39.176457 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.provisioning_blocks [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-bdb2c1f7-983f-4eb4-af47-4470d5b9eb20 service neutron] Transition to ACTIVE for port object b8dc8fcb-f50d-49a3-9bd0-47110fdb068f will not be triggered until provisioned by entity L2. {{(pid=102476) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 24 05:06:39.181986 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-bdb2c1f7-983f-4eb4-af47-4470d5b9eb20 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:39.235421 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdb2c1f7-983f-4eb4-af47-4470d5b9eb20 service neutron] Pushing event updated for resources: {'Port': ['ID=b8dc8fcb-f50d-49a3-9bd0-47110fdb068f,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:39.303885 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-bdb2c1f7-983f-4eb4-af47-4470d5b9eb20 service neutron] Attempting to bind port b8dc8fcb-f50d-49a3-9bd0-47110fdb068f on host hv-cinder-81644 for vnic_type normal with profile {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:06:39.304290 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-bdb2c1f7-983f-4eb4-af47-4470d5b9eb20 service neutron] Attempting to bind port b8dc8fcb-f50d-49a3-9bd0-47110fdb068f by drivers openvswitch,hyperv on host hv-cinder-81644 at level 0 using segments [{'id': '2d8c6ac9-499a-46a9-971d-99edaae74aeb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2'}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:06:39.304598 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-bdb2c1f7-983f-4eb4-af47-4470d5b9eb20 service neutron] Attempting to bind port b8dc8fcb-f50d-49a3-9bd0-47110fdb068f on network f6c8eead-66df-4cba-abce-78ee3b037ee2 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:06:39.309135 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-bdb2c1f7-983f-4eb4-af47-4470d5b9eb20 service neutron] Port b8dc8fcb-f50d-49a3-9bd0-47110fdb068f on network f6c8eead-66df-4cba-abce-78ee3b037ee2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81644 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 24 05:06:39.309448 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-bdb2c1f7-983f-4eb4-af47-4470d5b9eb20 service neutron] Attempting to bind port b8dc8fcb-f50d-49a3-9bd0-47110fdb068f on network f6c8eead-66df-4cba-abce-78ee3b037ee2 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:06:39.315876 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-bdb2c1f7-983f-4eb4-af47-4470d5b9eb20 service neutron] Checking agent: {'id': '7a2ffd19-371f-4f7b-a239-eea3b5cfd55b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81644', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'started_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 6, 20), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:06:39.316264 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-bdb2c1f7-983f-4eb4-af47-4470d5b9eb20 service neutron] Checking segment: {'id': '2d8c6ac9-499a-46a9-971d-99edaae74aeb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:06:39.316916 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-bdb2c1f7-983f-4eb4-af47-4470d5b9eb20 service neutron] Bound using segment: {'id': '2d8c6ac9-499a-46a9-971d-99edaae74aeb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2'} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:06:39.317060 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-bdb2c1f7-983f-4eb4-af47-4470d5b9eb20 service neutron] Bound port: b8dc8fcb-f50d-49a3-9bd0-47110fdb068f, host: hv-cinder-81644, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2d8c6ac9-499a-46a9-971d-99edaae74aeb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2'}}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:06:39.317568 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-bdb2c1f7-983f-4eb4-af47-4470d5b9eb20 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:39.389338 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-bdb2c1f7-983f-4eb4-af47-4470d5b9eb20 service neutron] For port b8dc8fcb-f50d-49a3-9bd0-47110fdb068f, host hv-cinder-81644, cleared binding levels {{(pid=102476) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:06:39.392554 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-bdb2c1f7-983f-4eb4-af47-4470d5b9eb20 service neutron] For port b8dc8fcb-f50d-49a3-9bd0-47110fdb068f, host hv-cinder-81644, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=b8dc8fcb-f50d-49a3-9bd0-47110fdb068f,segment=NetworkSegment(2d8c6ac9-499a-46a9-971d-99edaae74aeb),segment_id=2d8c6ac9-499a-46a9-971d-99edaae74aeb)] {{(pid=102476) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:06:39.399190 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-bdb2c1f7-983f-4eb4-af47-4470d5b9eb20 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:39.435443 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-bdb2c1f7-983f-4eb4-af47-4470d5b9eb20 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:39.436406 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-bdb2c1f7-983f-4eb4-af47-4470d5b9eb20 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:39.437797 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-bdb2c1f7-983f-4eb4-af47-4470d5b9eb20 service neutron] 10.222.0.46 "PUT /v2.0/ports/b8dc8fcb-f50d-49a3-9bd0-47110fdb068f HTTP/1.1" status: 200 len: 1093 time: 0.6357672 Dec 24 05:06:39.442653 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ae7a102d-4793-4384-bc31-07d28018c9df', 'tag': 'b8dc8fcb-f50d-49a3-9bd0-47110fdb068f'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:06:39.445248 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a336aeed-5cc2-465c-876a-c4cb9fe6ddff" -d '{"events": [{"name": "network-changed", "server_uuid": "ae7a102d-4793-4384-bc31-07d28018c9df", "tag": "b8dc8fcb-f50d-49a3-9bd0-47110fdb068f"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:06:39.475520 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdb2c1f7-983f-4eb4-af47-4470d5b9eb20 service neutron] Pushing event updated for resources: {'Port': ['ID=b8dc8fcb-f50d-49a3-9bd0-47110fdb068f,revision_number=3']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:39.495192 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:06:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bc9e4636-f1f2-47fe-b921-4ea183b7ddb9 x-openstack-request-id: req-bc9e4636-f1f2-47fe-b921-4ea183b7ddb9 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:06:39.495480 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ae7a102d-4793-4384-bc31-07d28018c9df", "tag": "b8dc8fcb-f50d-49a3-9bd0-47110fdb068f", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:06:39.495730 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-bc9e4636-f1f2-47fe-b921-4ea183b7ddb9 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:06:39.496123 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ae7a102d-4793-4384-bc31-07d28018c9df', 'tag': 'b8dc8fcb-f50d-49a3-9bd0-47110fdb068f', 'status': 'completed', 'code': 200} Dec 24 05:06:39.647725 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8fa743d-747b-45b9-8942-c15df227b267 req-9d8d8f01-073f-460f-aaf6-a62e913444c9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:39.649226 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a8fa743d-747b-45b9-8942-c15df227b267 req-9d8d8f01-073f-460f-aaf6-a62e913444c9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 943 time: 0.0846286 Dec 24 05:06:39.651669 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a336aeed-5cc2-465c-876a-c4cb9fe6ddff req-98dbdaf3-2512-4798-aa70-8677aaee5b1a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:39.653037 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a336aeed-5cc2-465c-876a-c4cb9fe6ddff req-98dbdaf3-2512-4798-aa70-8677aaee5b1a service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=f081e71a66b74c3bb12e1bec9d9a5cd1&device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 1096 time: 0.0756149 Dec 24 05:06:39.726757 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a8fa743d-747b-45b9-8942-c15df227b267 req-d34e36fb-f86a-43ea-aa50-70ae522ff3b0 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0708742 Dec 24 05:06:39.785719 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a336aeed-5cc2-465c-876a-c4cb9fe6ddff req-adae09aa-8d7b-4b54-9266-4118e8664bca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:39.787219 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a336aeed-5cc2-465c-876a-c4cb9fe6ddff req-adae09aa-8d7b-4b54-9266-4118e8664bca service neutron] 10.222.0.46 "GET /v2.0/networks?tenant_id=f081e71a66b74c3bb12e1bec9d9a5cd1&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1104605 Dec 24 05:06:39.897654 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a336aeed-5cc2-465c-876a-c4cb9fe6ddff req-3666baba-ed27-40f5-8847-b5cd3f682907 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:39.899090 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a336aeed-5cc2-465c-876a-c4cb9fe6ddff req-3666baba-ed27-40f5-8847-b5cd3f682907 service neutron] 10.222.0.46 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0976291 Dec 24 05:06:40.005973 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-5a10d7a3-e0fa-4bcd-b318-8d68df176352 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:40.007539 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-5a10d7a3-e0fa-4bcd-b318-8d68df176352 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=f081e71a66b74c3bb12e1bec9d9a5cd1&device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 1096 time: 0.0451663 Dec 24 05:06:40.060330 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-a6fc533d-d04c-4180-a933-b1f93c0f0f21 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b8dc8fcb-f50d-49a3-9bd0-47110fdb068f HTTP/1.1" status: 200 len: 217 time: 0.0371220 Dec 24 05:06:40.117528 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-9531e87b-3705-4db1-82b0-96d3ee900d2b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:40.119043 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-9531e87b-3705-4db1-82b0-96d3ee900d2b service neutron] 10.222.0.46 "GET /v2.0/subnets?id=11836946-2718-402d-9e36-6ad89714906f HTTP/1.1" status: 200 len: 853 time: 0.0499809 Dec 24 05:06:40.169366 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-e88b5a8c-c67a-4d10-9f02-2834d6b61ea6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:40.170928 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-e88b5a8c-c67a-4d10-9f02-2834d6b61ea6 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=f6c8eead-66df-4cba-abce-78ee3b037ee2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0441239 Dec 24 05:06:40.280716 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-40ba9c65-673e-4a63-a79b-0a4d141953ac service neutron] 10.222.0.46 "GET /v2.0/networks/f6c8eead-66df-4cba-abce-78ee3b037ee2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1009326 Dec 24 05:06:40.357296 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac3248eb-4854-4744-b726-e136fe95a344 req-682d25d3-55dd-4850-a2d6-8c9d733ecde1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:40.358794 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ac3248eb-4854-4744-b726-e136fe95a344 req-682d25d3-55dd-4850-a2d6-8c9d733ecde1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 946 time: 0.0590019 Dec 24 05:06:40.407244 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d85db859-57a9-41f6-ae51-0b6ca99dba17 req-31369834-ce55-48df-88d7-775b56e20840 service neutron] 10.222.0.46 "GET /v2.0/networks/f6c8eead-66df-4cba-abce-78ee3b037ee2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0938883 Dec 24 05:06:40.411958 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ac3248eb-4854-4744-b726-e136fe95a344 req-c886f4a4-2cdd-44b9-8444-389b246f5122 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0465651 Dec 24 05:06:40.847288 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f150cc0a-ec46-4f09-bf7e-8e7c0463983d req-6832ead4-2311-4c40-a487-b9d5d24d62d8 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:40.848901 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f150cc0a-ec46-4f09-bf7e-8e7c0463983d req-6832ead4-2311-4c40-a487-b9d5d24d62d8 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 943 time: 0.0516698 Dec 24 05:06:40.904959 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f150cc0a-ec46-4f09-bf7e-8e7c0463983d req-7d4eadb7-180e-4541-b7eb-fd2ba11db712 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469594 Dec 24 05:06:41.544931 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1783ad4-da70-4932-8259-ee13583613b2 req-8467ba3c-2b24-4000-9b5e-19862b107e41 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:41.546399 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f1783ad4-da70-4932-8259-ee13583613b2 req-8467ba3c-2b24-4000-9b5e-19862b107e41 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 946 time: 0.0549145 Dec 24 05:06:41.598492 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f1783ad4-da70-4932-8259-ee13583613b2 req-ea78d524-e30b-4c54-bf4f-293cd8ce1846 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458300 Dec 24 05:06:42.036620 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c0d478-0fe3-40fd-94ae-f44faf970572 req-d0443ae8-4d0f-4a00-8c25-c21893b52950 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:42.038050 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-95c0d478-0fe3-40fd-94ae-f44faf970572 req-d0443ae8-4d0f-4a00-8c25-c21893b52950 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 943 time: 0.0644577 Dec 24 05:06:42.091831 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-95c0d478-0fe3-40fd-94ae-f44faf970572 req-0490611c-d5eb-4ac6-8c92-7c0e68e5eb05 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461471 Dec 24 05:06:42.378198 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06ae393f-c8ec-4fa8-8071-7a0058565e0a req-3eff87b9-0ce6-4577-a005-d67f620ed1ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:42.380427 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-06ae393f-c8ec-4fa8-8071-7a0058565e0a req-3eff87b9-0ce6-4577-a005-d67f620ed1ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.46 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 946 time: 0.0742984 Dec 24 05:06:42.481949 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-06ae393f-c8ec-4fa8-8071-7a0058565e0a req-a185fae6-ab0d-4d57-b680-84345e57640e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Deleting port 61ec3441-5b75-4c07-b8ad-4174450d6a55 {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:06:42.482293 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-06ae393f-c8ec-4fa8-8071-7a0058565e0a req-a185fae6-ab0d-4d57-b680-84345e57640e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:42.573645 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-06ae393f-c8ec-4fa8-8071-7a0058565e0a req-a185fae6-ab0d-4d57-b680-84345e57640e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] For port 61ec3441-5b75-4c07-b8ad-4174450d6a55, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=61ec3441-5b75-4c07-b8ad-4174450d6a55,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:06:42.574013 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-06ae393f-c8ec-4fa8-8071-7a0058565e0a req-a185fae6-ab0d-4d57-b680-84345e57640e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:42.745341 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-736a7898-2866-4ad6-8f51-9b5e60b9249e req-51fe3ab8-d1f7-44de-b94d-df862a58a34c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:42.746853 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-736a7898-2866-4ad6-8f51-9b5e60b9249e req-51fe3ab8-d1f7-44de-b94d-df862a58a34c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 946 time: 0.0524235 Dec 24 05:06:42.798791 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-736a7898-2866-4ad6-8f51-9b5e60b9249e req-0f0ece90-941e-4f38-8d04-dd3fb30238e8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=2b32cddf-29a8-4d82-a930-1f27033cc61f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454934 Dec 24 05:06:42.819783 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-06ae393f-c8ec-4fa8-8071-7a0058565e0a req-a185fae6-ab0d-4d57-b680-84345e57640e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:42.820174 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-06ae393f-c8ec-4fa8-8071-7a0058565e0a req-a185fae6-ab0d-4d57-b680-84345e57640e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-545804'] for floatingip, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:42.820494 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.l3_db [req-06ae393f-c8ec-4fa8-8071-7a0058565e0a req-a185fae6-ab0d-4d57-b680-84345e57640e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Floating IP 84745415-6c2d-486f-9fad-9bd76e6c1538 disassociated. External IP: 172.27.1.63, port: 61ec3441-5b75-4c07-b8ad-4174450d6a55. Dec 24 05:06:42.821162 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-06ae393f-c8ec-4fa8-8071-7a0058565e0a req-a185fae6-ab0d-4d57-b680-84345e57640e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling delete_port for 61ec3441-5b75-4c07-b8ad-4174450d6a55 owned by compute:nova {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:06:42.956188 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-06ae393f-c8ec-4fa8-8071-7a0058565e0a req-a185fae6-ab0d-4d57-b680-84345e57640e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:42.987049 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a185fae6-ab0d-4d57-b680-84345e57640e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Pushing event deleted for resources: {'Port': ['ID=61ec3441-5b75-4c07-b8ad-4174450d6a55,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:43.103615 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [req-06ae393f-c8ec-4fa8-8071-7a0058565e0a req-a185fae6-ab0d-4d57-b680-84345e57640e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Router d1392df8-0562-4659-9906-2d085b726626 has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102476) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:06:43.242497 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-06ae393f-c8ec-4fa8-8071-7a0058565e0a req-a185fae6-ab0d-4d57-b680-84345e57640e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:06:43.252863 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ed93e6e-8cf2-4188-bcaa-f8562919d357 None None] Sync routers for ids ['d1392df8-0562-4659-9906-2d085b726626'] in dv-cinder-816443-2-iscsi {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:06:43.264905 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ed93e6e-8cf2-4188-bcaa-f8562919d357 None None] Routers {'d1392df8-0562-4659-9906-2d085b726626'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:06:43.265631 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-2ed93e6e-8cf2-4188-bcaa-f8562919d357 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:06:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['d1392df8-0562-4659-9906-2d085b726626'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:43.275750 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-335ebafe-8a1a-4182-b496-7bb881b7fa5a req-910a4ddd-d83d-40ec-8478-c1623371079c tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:43.277360 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-335ebafe-8a1a-4182-b496-7bb881b7fa5a req-910a4ddd-d83d-40ec-8478-c1623371079c tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 943 time: 0.0834768 Dec 24 05:06:43.299474 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-06ae393f-c8ec-4fa8-8071-7a0058565e0a req-a185fae6-ab0d-4d57-b680-84345e57640e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] No DVR routers for this DVR port 61ec3441-5b75-4c07-b8ad-4174450d6a55 on host hv-cinder-81644 {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:06:43.306648 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-06ae393f-c8ec-4fa8-8071-7a0058565e0a req-a185fae6-ab0d-4d57-b680-84345e57640e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:43.311494 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-06ae393f-c8ec-4fa8-8071-7a0058565e0a req-a185fae6-ab0d-4d57-b680-84345e57640e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.46 "DELETE /v2.0/ports/61ec3441-5b75-4c07-b8ad-4174450d6a55 HTTP/1.1" status: 204 len: 173 time: 0.9242334 Dec 24 05:06:43.312045 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6485c286-d5e3-42e7-bf58-c4685f8c3066', 'name': 'network-vif-deleted', 'tag': '61ec3441-5b75-4c07-b8ad-4174450d6a55'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:06:43.314690 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1d0bc9f8-c3c0-4ece-8808-2f419fd2adc2" -d '{"events": [{"server_uuid": "6485c286-d5e3-42e7-bf58-c4685f8c3066", "name": "network-vif-deleted", "tag": "61ec3441-5b75-4c07-b8ad-4174450d6a55"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:06:43.358349 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:06:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b9186a82-c09d-4049-849b-a6e9dc5374d7 x-openstack-request-id: req-b9186a82-c09d-4049-849b-a6e9dc5374d7 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:06:43.358838 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6485c286-d5e3-42e7-bf58-c4685f8c3066", "name": "network-vif-deleted", "tag": "61ec3441-5b75-4c07-b8ad-4174450d6a55", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:06:43.359124 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-b9186a82-c09d-4049-849b-a6e9dc5374d7 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:06:43.359641 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6485c286-d5e3-42e7-bf58-c4685f8c3066', 'name': 'network-vif-deleted', 'tag': '61ec3441-5b75-4c07-b8ad-4174450d6a55', 'status': 'completed', 'code': 200} Dec 24 05:06:43.368425 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-335ebafe-8a1a-4182-b496-7bb881b7fa5a req-9dd59ee0-4f8d-43a0-b4ca-45f74b370db9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0707917 Dec 24 05:06:43.425767 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-2ed93e6e-8cf2-4188-bcaa-f8562919d357 None None] Set router d1392df8-0562-4659-9906-2d085b726626 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:06:43.652250 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-2ed93e6e-8cf2-4188-bcaa-f8562919d357 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1392df8-0562-4659-9906-2d085b726626', 'name': 'tempest-AttachVolumeShelveTestJSON-634320677-router', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148'}], 'enable_snat': True}, 'gw_port_id': 'd5be979e-f11f-424a-bd46-164029481a60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:06Z', 'updated_at': '2021-12-24T04:59:13Z', 'revision_number': 4, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'gw_port': {'id': 'd5be979e-f11f-424a-bd46-164029481a60', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:30:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:07Z', 'updated_at': '2021-12-24T04:59:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '3e72624e-ab22-45c6-b262-91a63ca05279', 'name': '', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'mac_address': 'fa:16:3e:38:ea:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:12Z', 'updated_at': '2021-12-24T04:59:19Z', 'revision_number': 5, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'subnets': [{'id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:43.678533 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ed93e6e-8cf2-4188-bcaa-f8562919d357 None None] Checking router: d1392df8-0562-4659-9906-2d085b726626 for host: dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:06:43.687150 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ed93e6e-8cf2-4188-bcaa-f8562919d357 None None] Routers {'d1392df8-0562-4659-9906-2d085b726626'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:06:43.687769 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-2ed93e6e-8cf2-4188-bcaa-f8562919d357 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:06:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['d1392df8-0562-4659-9906-2d085b726626'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:43.801055 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-2ed93e6e-8cf2-4188-bcaa-f8562919d357 None None] Set router d1392df8-0562-4659-9906-2d085b726626 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:06:43.942161 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6b4def8d-cfe6-481b-8a86-123a920ab2a6 req-b95356ee-e7ab-408c-a21a-fa6fe74bc74a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=6485c286-d5e3-42e7-bf58-c4685f8c3066 HTTP/1.1" status: 200 len: 210 time: 0.0369496 Dec 24 05:06:44.040477 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-2ed93e6e-8cf2-4188-bcaa-f8562919d357 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1392df8-0562-4659-9906-2d085b726626', 'name': 'tempest-AttachVolumeShelveTestJSON-634320677-router', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148'}], 'enable_snat': True}, 'gw_port_id': 'd5be979e-f11f-424a-bd46-164029481a60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:06Z', 'updated_at': '2021-12-24T04:59:13Z', 'revision_number': 4, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'gw_port': {'id': 'd5be979e-f11f-424a-bd46-164029481a60', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:30:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:07Z', 'updated_at': '2021-12-24T04:59:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '3e72624e-ab22-45c6-b262-91a63ca05279', 'name': '', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'mac_address': 'fa:16:3e:38:ea:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:12Z', 'updated_at': '2021-12-24T04:59:19Z', 'revision_number': 5, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'subnets': [{'id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:06:44.067537 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ed93e6e-8cf2-4188-bcaa-f8562919d357 None None] The sync data for ids ['d1392df8-0562-4659-9906-2d085b726626'] in dv-cinder-816443-2-iscsi is: [{'id': 'd1392df8-0562-4659-9906-2d085b726626', 'name': 'tempest-AttachVolumeShelveTestJSON-634320677-router', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148'}], 'enable_snat': True}, 'gw_port_id': 'd5be979e-f11f-424a-bd46-164029481a60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:06Z', 'updated_at': '2021-12-24T04:59:13Z', 'revision_number': 4, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'gw_port': {'id': 'd5be979e-f11f-424a-bd46-164029481a60', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:30:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:07Z', 'updated_at': '2021-12-24T04:59:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '3e72624e-ab22-45c6-b262-91a63ca05279', 'name': '', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'mac_address': 'fa:16:3e:38:ea:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:12Z', 'updated_at': '2021-12-24T04:59:19Z', 'revision_number': 5, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'subnets': [{'id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:06:44.299197 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e856d8d6-343e-4492-beaa-a5e8e3d3eeaa None None] New status for floating IP 84745415-6c2d-486f-9fad-9bd76e6c1538: DOWN {{(pid=102479) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 24 05:06:44.511245 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c154c429-7c47-490f-bd58-3b811d9023ce req-79cc4725-2875-4faa-80b3-d5d2189f16cf tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:44.513361 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c154c429-7c47-490f-bd58-3b811d9023ce req-79cc4725-2875-4faa-80b3-d5d2189f16cf tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 943 time: 0.0691671 Dec 24 05:06:44.561989 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c154c429-7c47-490f-bd58-3b811d9023ce req-718525e9-fc7b-4851-9a5c-ee33632eaded tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424511 Dec 24 05:06:45.030669 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 33242) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:45.086496 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-dd6b000a-66bf-4ca7-af3a-1e53a39d7e33 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:45.111746 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-dd6b000a-66bf-4ca7-af3a-1e53a39d7e33 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:45.167140 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-dd6b000a-66bf-4ca7-af3a-1e53a39d7e33 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:45.169346 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-dd6b000a-66bf-4ca7-af3a-1e53a39d7e33 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:45.171344 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-dd6b000a-66bf-4ca7-af3a-1e53a39d7e33 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "DELETE /v2.0/security-groups/2b32cddf-29a8-4d82-a930-1f27033cc61f HTTP/1.1" status: 204 len: 168 time: 0.1396215 Dec 24 05:06:45.174021 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 33244) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:45.181555 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd6b000a-66bf-4ca7-af3a-1e53a39d7e33 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=2b32cddf-29a8-4d82-a930-1f27033cc61f,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:45.192015 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.api.v2.resource [None req-098110a7-7bb8-43e4-8266-5be923df336f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] show failed (client error): The resource could not be found. Dec 24 05:06:45.193081 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-098110a7-7bb8-43e4-8266-5be923df336f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups/2b32cddf-29a8-4d82-a930-1f27033cc61f HTTP/1.1" status: 404 len: 347 time: 0.0178523 Dec 24 05:06:45.196017 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 33246) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:45.359221 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-d724e66d-ed9c-4d34-8286-78d9beae64d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Deleting port 7c65a0bf-d44e-48c6-9c51-737e24aa3c52 {{(pid=102477) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:06:45.359487 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d724e66d-ed9c-4d34-8286-78d9beae64d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:45.444327 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d724e66d-ed9c-4d34-8286-78d9beae64d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:45.444610 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d724e66d-ed9c-4d34-8286-78d9beae64d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:45.457437 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-d724e66d-ed9c-4d34-8286-78d9beae64d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling delete_port for 7c65a0bf-d44e-48c6-9c51-737e24aa3c52 owned by network:floatingip {{(pid=102477) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:06:45.624388 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d724e66d-ed9c-4d34-8286-78d9beae64d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:45.663455 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d724e66d-ed9c-4d34-8286-78d9beae64d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Pushing event deleted for resources: {'Port': ['ID=7c65a0bf-d44e-48c6-9c51-737e24aa3c52,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:45.751973 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-577bb533-af51-46f9-9163-14354a547d50 req-8b3dc7bc-6f89-4b4e-9ddc-f87049c6af35 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:45.753451 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-577bb533-af51-46f9-9163-14354a547d50 req-8b3dc7bc-6f89-4b4e-9ddc-f87049c6af35 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 943 time: 0.0999975 Dec 24 05:06:45.757552 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d724e66d-ed9c-4d34-8286-78d9beae64d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for floatingip, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:45.760253 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d724e66d-ed9c-4d34-8286-78d9beae64d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for floatingip, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:45.761452 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-d724e66d-ed9c-4d34-8286-78d9beae64d4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "DELETE /v2.0/floatingips/84745415-6c2d-486f-9fad-9bd76e6c1538 HTTP/1.1" status: 204 len: 168 time: 0.5645235 Dec 24 05:06:45.808467 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-577bb533-af51-46f9-9163-14354a547d50 req-de8e509f-161e-44aa-9d2b-b13c0aabe557 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458395 Dec 24 05:06:45.973577 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device b8dc8fcb-f50d-49a3-9bd0-47110fdb068f details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 05:06:45.984353 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 61ec3441-5b75-4c07-b8ad-4174450d6a55 no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:06:46.006795 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] No Port match for: 61ec3441-5b75-4c07-b8ad-4174450d6a55 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:06:46.007147 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 61ec3441-5b75-4c07-b8ad-4174450d6a55 not bound to the agent host hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:06:46.058732 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 33258) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:46.063622 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-b91a8644-bb7f-4fa0-ae8a-79a1f4b769e7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Request body: {'security_group': {'name': 'tempest-securitygroup--837497056', 'description': 'tempest-description--1692902977'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:46.093307 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b91a8644-bb7f-4fa0-ae8a-79a1f4b769e7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:46.094012 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port b8dc8fcb-f50d-49a3-9bd0-47110fdb068f, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=b8dc8fcb-f50d-49a3-9bd0-47110fdb068f,segment=NetworkSegment(2d8c6ac9-499a-46a9-971d-99edaae74aeb),segment_id=2d8c6ac9-499a-46a9-971d-99edaae74aeb)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:06:46.107337 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': 'b8dc8fcb-f50d-49a3-9bd0-47110fdb068f', 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2', 'port_id': 'b8dc8fcb-f50d-49a3-9bd0-47110fdb068f', 'mac_address': 'fa:16:3e:ad:e4:9e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 123, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '11836946-2718-402d-9e36-6ad89714906f', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 05:06:46.146782 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:46.159382 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b8dc8fcb-f50d-49a3-9bd0-47110fdb068f {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:06:46.161048 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b91a8644-bb7f-4fa0-ae8a-79a1f4b769e7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:46.165894 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b91a8644-bb7f-4fa0-ae8a-79a1f4b769e7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:46.179758 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port b8dc8fcb-f50d-49a3-9bd0-47110fdb068f, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=b8dc8fcb-f50d-49a3-9bd0-47110fdb068f,segment=NetworkSegment(2d8c6ac9-499a-46a9-971d-99edaae74aeb),segment_id=2d8c6ac9-499a-46a9-971d-99edaae74aeb)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:06:46.184148 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:46.192713 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b91a8644-bb7f-4fa0-ae8a-79a1f4b769e7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:46.196808 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-b91a8644-bb7f-4fa0-ae8a-79a1f4b769e7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.1341889 Dec 24 05:06:46.197000 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 33264) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:46.201960 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-95bc4e1d-0a3a-460b-9798-d4992e5e3e8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Request body: {'security_group_rule': {'security_group_id': '51457a37-8626-4905-b242-c0b87df24845', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:46.206962 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b91a8644-bb7f-4fa0-ae8a-79a1f4b769e7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Pushing event updated for resources: {'SecurityGroup': ['ID=51457a37-8626-4905-b242-c0b87df24845,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:46.233784 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-95bc4e1d-0a3a-460b-9798-d4992e5e3e8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:46.241720 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=b8dc8fcb-f50d-49a3-9bd0-47110fdb068f,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:46.290278 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-95bc4e1d-0a3a-460b-9798-d4992e5e3e8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:46.294495 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-95bc4e1d-0a3a-460b-9798-d4992e5e3e8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:46.311247 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95bc4e1d-0a3a-460b-9798-d4992e5e3e8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fed8de5b-5507-4d79-af4b-9d2532251269,revision_number=0']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:46.321471 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-95bc4e1d-0a3a-460b-9798-d4992e5e3e8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:46.322842 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-95bc4e1d-0a3a-460b-9798-d4992e5e3e8d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1248825 Dec 24 05:06:46.325467 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 33266) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:46.329845 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-f475eb9c-6aa1-4f35-b684-d149a35aadae tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Request body: {'security_group_rule': {'security_group_id': '51457a37-8626-4905-b242-c0b87df24845', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:46.359275 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f475eb9c-6aa1-4f35-b684-d149a35aadae tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:46.415057 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f475eb9c-6aa1-4f35-b684-d149a35aadae tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:46.420786 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f475eb9c-6aa1-4f35-b684-d149a35aadae tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:46.442596 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f475eb9c-6aa1-4f35-b684-d149a35aadae tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3f46fa4d-0cd7-4f29-b35e-1cb4f8f3063e,revision_number=0']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:46.448930 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f475eb9c-6aa1-4f35-b684-d149a35aadae tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:46.450167 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-f475eb9c-6aa1-4f35-b684-d149a35aadae tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1237559 Dec 24 05:06:46.453321 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 33268) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:06:46.459642 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-365dee5a-5c3d-413c-9223-6de2fa71cffc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Request body: {'floatingip': {'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:46.483869 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-365dee5a-5c3d-413c-9223-6de2fa71cffc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for floatingip, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:46.588365 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-365dee5a-5c3d-413c-9223-6de2fa71cffc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:46.604139 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['b8dc8fcb-f50d-49a3-9bd0-47110fdb068f'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:06:46.695930 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.db_base_plugin_common [None req-365dee5a-5c3d-413c-9223-6de2fa71cffc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Allocated IP 172.27.1.122 (9b4e4b31-551f-45a9-b26a-cb44ee20a17d/f277b899-8779-420e-8a8d-bfcd5eb7f012/77090082-9ef3-4800-9a4d-5da23b7e1931) {{(pid=102477) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:06:46.800545 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-365dee5a-5c3d-413c-9223-6de2fa71cffc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for port, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:46.837836 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-365dee5a-5c3d-413c-9223-6de2fa71cffc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:46.877431 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-365dee5a-5c3d-413c-9223-6de2fa71cffc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d is already hosted by enough agents. {{(pid=102477) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:06:46.883743 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-365dee5a-5c3d-413c-9223-6de2fa71cffc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Resources bound (agent type, host, resource id): {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:06:46.889070 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.l3_dvrscheduler_db [None req-365dee5a-5c3d-413c-9223-6de2fa71cffc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Received port after_create {{(pid=102477) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:06:46.922842 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-365dee5a-5c3d-413c-9223-6de2fa71cffc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Pushing event updated for resources: {'Port': ['ID=77090082-9ef3-4800-9a4d-5da23b7e1931,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:46.982450 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae2c8f30-f1dd-4c56-8f82-db5dedc5344b req-6404cfdd-cd32-416c-ac74-147e495e54e2 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:46.983881 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ae2c8f30-f1dd-4c56-8f82-db5dedc5344b req-6404cfdd-cd32-416c-ac74-147e495e54e2 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 944 time: 0.1033154 Dec 24 05:06:47.044470 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-365dee5a-5c3d-413c-9223-6de2fa71cffc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:47.060241 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ae2c8f30-f1dd-4c56-8f82-db5dedc5344b req-d55d2f2d-47d5-40bf-9927-6e05c53a1c09 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0588894 Dec 24 05:06:47.089473 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-365dee5a-5c3d-413c-9223-6de2fa71cffc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:47.257767 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-365dee5a-5c3d-413c-9223-6de2fa71cffc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for port, precommit_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:47.266986 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-365dee5a-5c3d-413c-9223-6de2fa71cffc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29535615'] for port, after_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:47.338109 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-365dee5a-5c3d-413c-9223-6de2fa71cffc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Pushing event updated for resources: {'Port': ['ID=77090082-9ef3-4800-9a4d-5da23b7e1931,revision_number=2']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:47.350182 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-365dee5a-5c3d-413c-9223-6de2fa71cffc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-545804'] for floatingip, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:47.366893 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-365dee5a-5c3d-413c-9223-6de2fa71cffc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for floatingip, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:47.368137 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-365dee5a-5c3d-413c-9223-6de2fa71cffc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 0.9138262 Dec 24 05:06:47.582163 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-54158a63-ab6b-4228-b807-926b918f7ac4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-securitygroup--837497056&fields=id&tenant_id=6c9c47f70b8d4da5827a8ef4349559ab HTTP/1.1" status: 200 len: 267 time: 0.0460403 Dec 24 05:06:47.692407 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-6cb6d500-9609-4e8d-a931-5b763f39314f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:47.694031 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-6cb6d500-9609-4e8d-a931-5b763f39314f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/networks?id=c908572e-3b6b-470c-8b88-35b51f1472c6 HTTP/1.1" status: 200 len: 816 time: 0.1019149 Dec 24 05:06:47.709338 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-336c1995-5d46-410e-8780-73ded00582bc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/quotas/6c9c47f70b8d4da5827a8ef4349559ab HTTP/1.1" status: 200 len: 375 time: 0.0090568 Dec 24 05:06:47.772964 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-30e38b3f-2c8b-43e6-a2d0-5058f0f050a5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=6c9c47f70b8d4da5827a8ef4349559ab&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0580101 Dec 24 05:06:47.870923 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-d8e7003b-3953-4f52-a2bd-2398e11600ae service neutron] 10.222.0.43 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0862126 Dec 24 05:06:47.966162 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-722d3e3a-aa11-427a-b349-0a42354188bd service neutron] 10.222.0.43 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0888855 Dec 24 05:06:47.977893 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device b8dc8fcb-f50d-49a3-9bd0-47110fdb068f up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:48.026747 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning for port b8dc8fcb-f50d-49a3-9bd0-47110fdb068f completed by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 24 05:06:48.031395 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port b8dc8fcb-f50d-49a3-9bd0-47110fdb068f triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:48.032098 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:48.116004 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:48.140193 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ae7a102d-4793-4384-bc31-07d28018c9df', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b8dc8fcb-f50d-49a3-9bd0-47110fdb068f'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:06:48.142582 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-81ac7c92-78c4-427a-b138-b9ace38755c3" -d '{"events": [{"server_uuid": "ae7a102d-4793-4384-bc31-07d28018c9df", "name": "network-vif-plugged", "status": "completed", "tag": "b8dc8fcb-f50d-49a3-9bd0-47110fdb068f"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:06:48.155519 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port b8dc8fcb-f50d-49a3-9bd0-47110fdb068f, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=b8dc8fcb-f50d-49a3-9bd0-47110fdb068f,segment=NetworkSegment(2d8c6ac9-499a-46a9-971d-99edaae74aeb),segment_id=2d8c6ac9-499a-46a9-971d-99edaae74aeb)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:06:48.155956 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-31bf8bfe-90e9-4f9f-8e56-05590d1dc677 req-ebeaa313-37f6-4574-901f-9cf9611dded4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 210 time: 0.0348315 Dec 24 05:06:48.162872 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:48.183140 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fff53a3-a72e-4dd0-ad4b-c00e4cee65b5 req-7e6af7e9-fe12-4139-823b-4d19142acca6 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:48.184880 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6fff53a3-a72e-4dd0-ad4b-c00e4cee65b5 req-7e6af7e9-fe12-4139-823b-4d19142acca6 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 944 time: 0.0519211 Dec 24 05:06:48.230757 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:06:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-68bc7cf8-6111-4500-848d-6b80e8d75d13 x-openstack-request-id: req-68bc7cf8-6111-4500-848d-6b80e8d75d13 {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:06:48.231150 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ae7a102d-4793-4384-bc31-07d28018c9df", "name": "network-vif-plugged", "status": "completed", "tag": "b8dc8fcb-f50d-49a3-9bd0-47110fdb068f", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:06:48.231942 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-68bc7cf8-6111-4500-848d-6b80e8d75d13 {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:06:48.232624 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ae7a102d-4793-4384-bc31-07d28018c9df', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b8dc8fcb-f50d-49a3-9bd0-47110fdb068f', 'code': 200} Dec 24 05:06:48.238150 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=b8dc8fcb-f50d-49a3-9bd0-47110fdb068f,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:48.239249 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6fff53a3-a72e-4dd0-ad4b-c00e4cee65b5 req-285333be-b367-4df2-96c4-1d8ef636ef79 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458422 Dec 24 05:06:48.451167 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c0ef2c4-6678-4fc2-915b-e17c5daf998e req-6d5ebae5-b675-478c-bf3a-b9ad735b7fca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:48.452750 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5c0ef2c4-6678-4fc2-915b-e17c5daf998e req-6d5ebae5-b675-478c-bf3a-b9ad735b7fca service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 1098 time: 0.0415957 Dec 24 05:06:48.503901 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5c0ef2c4-6678-4fc2-915b-e17c5daf998e req-78f8c5d4-67db-4ad1-8daf-38fa48406503 service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415599 Dec 24 05:06:49.267740 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-de88eb41-6429-439f-b803-b7bacf083f79 req-93796b51-fc8c-4759-8a29-7c05472d71ad tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 210 time: 0.0266025 Dec 24 05:06:49.362215 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f14df40e-13b4-4494-abd9-0ef9334d4954 req-025f10d4-0dc0-4741-8b1f-fcb665e80154 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:49.363751 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f14df40e-13b4-4494-abd9-0ef9334d4954 req-025f10d4-0dc0-4741-8b1f-fcb665e80154 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 945 time: 0.0507324 Dec 24 05:06:49.417392 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f14df40e-13b4-4494-abd9-0ef9334d4954 req-f96d127b-c01b-4ffd-b50b-6e2056d44e3e tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465837 Dec 24 05:06:49.595389 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-81ce1075-73d1-4d07-bdb3-7ca33da4c83a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:49.596940 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-81ce1075-73d1-4d07-bdb3-7ca33da4c83a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.46 "GET /v2.0/networks?id=c908572e-3b6b-470c-8b88-35b51f1472c6 HTTP/1.1" status: 200 len: 816 time: 0.1092403 Dec 24 05:06:49.668182 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-5a4bd213-6b58-4a4d-983c-c9ef770df6f2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.46 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6c9c47f70b8d4da5827a8ef4349559ab HTTP/1.1" status: 200 len: 379 time: 0.0532467 Dec 24 05:06:49.682175 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-72613214-24fc-4512-ac56-5d1736b2064d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Request body: {'port': {'device_id': 'cc21b91f-c07f-40f8-8cf1-a9c343386f03', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'admin_state_up': True, 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'security_groups': ['51457a37-8626-4905-b242-c0b87df24845']}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:49.796298 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-72613214-24fc-4512-ac56-5d1736b2064d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Made reservation on behalf of 6c9c47f70b8d4da5827a8ef4349559ab for: {'port': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:06:49.802126 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-72613214-24fc-4512-ac56-5d1736b2064d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:49.938482 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-72613214-24fc-4512-ac56-5d1736b2064d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Allocated IP 172.20.0.7 (c908572e-3b6b-470c-8b88-35b51f1472c6/699b398d-7f9d-4acb-bc18-ac32f35377c3/8f0b0287-0281-4556-ae15-8fe2c2dbf50d) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:06:50.075551 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-72613214-24fc-4512-ac56-5d1736b2064d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:50.118469 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-72613214-24fc-4512-ac56-5d1736b2064d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:50.159616 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-72613214-24fc-4512-ac56-5d1736b2064d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Network c908572e-3b6b-470c-8b88-35b51f1472c6 is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:06:50.162747 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-72613214-24fc-4512-ac56-5d1736b2064d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:06:50.165427 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-72613214-24fc-4512-ac56-5d1736b2064d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:06:50.194543 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72613214-24fc-4512-ac56-5d1736b2064d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Pushing event updated for resources: {'Port': ['ID=8f0b0287-0281-4556-ae15-8fe2c2dbf50d,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:50.221725 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-72613214-24fc-4512-ac56-5d1736b2064d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:50.222426 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-72613214-24fc-4512-ac56-5d1736b2064d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:50.245475 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-72613214-24fc-4512-ac56-5d1736b2064d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.46 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5668981 Dec 24 05:06:50.269049 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-2414b1e4-f7d5-46fb-bd56-7fd278ca4e3d service neutron] Request body: {'port': {'device_id': 'cc21b91f-c07f-40f8-8cf1-a9c343386f03', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81644'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:50.339269 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-2414b1e4-f7d5-46fb-bd56-7fd278ca4e3d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:50.408585 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:50.413729 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-40c6f218-2cfe-413d-a135-b885c476ee4d None None] Provisioning complete for port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:50.414116 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-40c6f218-2cfe-413d-a135-b885c476ee4d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:50.461152 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-40c6f218-2cfe-413d-a135-b885c476ee4d None None] Port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 05:06:50.560890 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65a50654-804d-4e5d-bcf5-59d653cea036 req-04f6b529-4bce-4f59-b04b-adcfd17d03ed tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:50.562475 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-65a50654-804d-4e5d-bcf5-59d653cea036 req-04f6b529-4bce-4f59-b04b-adcfd17d03ed tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 931 time: 0.0475769 Dec 24 05:06:50.588613 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74808803-f60b-45ad-80ad-7a5c2951d8bd req-3faba350-26d7-4630-8563-21ac59bf22ec tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:50.590136 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-74808803-f60b-45ad-80ad-7a5c2951d8bd req-3faba350-26d7-4630-8563-21ac59bf22ec tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 945 time: 0.0988631 Dec 24 05:06:50.613005 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-65a50654-804d-4e5d-bcf5-59d653cea036 req-853f4f2b-6367-4baa-8b20-f8e5f2ce1d9d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444858 Dec 24 05:06:50.686339 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-74808803-f60b-45ad-80ad-7a5c2951d8bd req-beed5095-5acc-48e9-9e0c-2d7026272875 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0843887 Dec 24 05:06:50.689781 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-2414b1e4-f7d5-46fb-bd56-7fd278ca4e3d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8f0b0287-0281-4556-ae15-8fe2c2dbf50d {{(pid=102476) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:06:50.697395 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-2414b1e4-f7d5-46fb-bd56-7fd278ca4e3d service neutron] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:50.709676 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.provisioning_blocks [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-2414b1e4-f7d5-46fb-bd56-7fd278ca4e3d service neutron] Transition to ACTIVE for port object 8f0b0287-0281-4556-ae15-8fe2c2dbf50d will not be triggered until provisioned by entity L2. {{(pid=102476) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 24 05:06:50.714974 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-2414b1e4-f7d5-46fb-bd56-7fd278ca4e3d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:50.770133 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2414b1e4-f7d5-46fb-bd56-7fd278ca4e3d service neutron] Pushing event updated for resources: {'Port': ['ID=8f0b0287-0281-4556-ae15-8fe2c2dbf50d,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:50.814944 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00df4c98-f46d-46e2-b177-a3787256415e req-891a957c-5402-4cca-82dd-f188512d2b29 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:50.816577 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-00df4c98-f46d-46e2-b177-a3787256415e req-891a957c-5402-4cca-82dd-f188512d2b29 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 945 time: 0.0587919 Dec 24 05:06:50.845397 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-2414b1e4-f7d5-46fb-bd56-7fd278ca4e3d service neutron] Attempting to bind port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d on host hv-cinder-81644 for vnic_type normal with profile {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:06:50.845815 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-2414b1e4-f7d5-46fb-bd56-7fd278ca4e3d service neutron] Attempting to bind port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d by drivers openvswitch,hyperv on host hv-cinder-81644 at level 0 using segments [{'id': 'db374990-dadf-47a9-9824-44188ba20dd8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6'}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:06:50.846258 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-2414b1e4-f7d5-46fb-bd56-7fd278ca4e3d service neutron] Attempting to bind port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d on network c908572e-3b6b-470c-8b88-35b51f1472c6 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:06:50.851503 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-2414b1e4-f7d5-46fb-bd56-7fd278ca4e3d service neutron] Port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d on network c908572e-3b6b-470c-8b88-35b51f1472c6 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81644 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 24 05:06:50.851946 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-2414b1e4-f7d5-46fb-bd56-7fd278ca4e3d service neutron] Attempting to bind port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d on network c908572e-3b6b-470c-8b88-35b51f1472c6 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:06:50.856834 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-2414b1e4-f7d5-46fb-bd56-7fd278ca4e3d service neutron] Checking agent: {'id': '7a2ffd19-371f-4f7b-a239-eea3b5cfd55b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81644', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'started_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 6, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:06:50.857181 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-2414b1e4-f7d5-46fb-bd56-7fd278ca4e3d service neutron] Checking segment: {'id': 'db374990-dadf-47a9-9824-44188ba20dd8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:06:50.857568 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-2414b1e4-f7d5-46fb-bd56-7fd278ca4e3d service neutron] Bound using segment: {'id': 'db374990-dadf-47a9-9824-44188ba20dd8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6'} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:06:50.858003 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-2414b1e4-f7d5-46fb-bd56-7fd278ca4e3d service neutron] Bound port: 8f0b0287-0281-4556-ae15-8fe2c2dbf50d, host: hv-cinder-81644, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'db374990-dadf-47a9-9824-44188ba20dd8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6'}}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:06:50.858360 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-2414b1e4-f7d5-46fb-bd56-7fd278ca4e3d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:50.870726 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-00df4c98-f46d-46e2-b177-a3787256415e req-4996185d-51b8-40dc-be8d-41668b761dab tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467777 Dec 24 05:06:51.193984 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-2414b1e4-f7d5-46fb-bd56-7fd278ca4e3d service neutron] For port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d, host hv-cinder-81644, cleared binding levels {{(pid=102476) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:06:51.197369 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-2414b1e4-f7d5-46fb-bd56-7fd278ca4e3d service neutron] For port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d, host hv-cinder-81644, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=8f0b0287-0281-4556-ae15-8fe2c2dbf50d,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102476) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:06:51.202166 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-2414b1e4-f7d5-46fb-bd56-7fd278ca4e3d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:51.204203 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb899afd-e4f3-4400-aabc-43eaa1867f7f req-8e0890ab-bcfc-4bf6-8468-48402b230a81 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:51.205733 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-cb899afd-e4f3-4400-aabc-43eaa1867f7f req-8e0890ab-bcfc-4bf6-8468-48402b230a81 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 945 time: 0.0523002 Dec 24 05:06:51.235050 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-2414b1e4-f7d5-46fb-bd56-7fd278ca4e3d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:51.235278 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-2414b1e4-f7d5-46fb-bd56-7fd278ca4e3d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:51.236826 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-2414b1e4-f7d5-46fb-bd56-7fd278ca4e3d service neutron] 10.222.0.46 "PUT /v2.0/ports/8f0b0287-0281-4556-ae15-8fe2c2dbf50d HTTP/1.1" status: 200 len: 1093 time: 0.9723611 Dec 24 05:06:51.241315 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cc21b91f-c07f-40f8-8cf1-a9c343386f03', 'tag': '8f0b0287-0281-4556-ae15-8fe2c2dbf50d'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:06:51.243649 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-82d6e028-426e-4212-aeff-49822e411c53" -d '{"events": [{"name": "network-changed", "server_uuid": "cc21b91f-c07f-40f8-8cf1-a9c343386f03", "tag": "8f0b0287-0281-4556-ae15-8fe2c2dbf50d"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:06:51.275743 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-cb899afd-e4f3-4400-aabc-43eaa1867f7f req-01a802c9-2f1b-4f8d-8f6e-724b23484a5c tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0631311 Dec 24 05:06:51.276034 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2414b1e4-f7d5-46fb-bd56-7fd278ca4e3d service neutron] Pushing event updated for resources: {'Port': ['ID=8f0b0287-0281-4556-ae15-8fe2c2dbf50d,revision_number=3']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:51.309888 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:06:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-98783733-df3e-41db-85bd-5d3aa25f7ba0 x-openstack-request-id: req-98783733-df3e-41db-85bd-5d3aa25f7ba0 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:06:51.310205 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cc21b91f-c07f-40f8-8cf1-a9c343386f03", "tag": "8f0b0287-0281-4556-ae15-8fe2c2dbf50d", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:06:51.310475 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-98783733-df3e-41db-85bd-5d3aa25f7ba0 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:06:51.310971 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cc21b91f-c07f-40f8-8cf1-a9c343386f03', 'tag': '8f0b0287-0281-4556-ae15-8fe2c2dbf50d', 'status': 'completed', 'code': 200} Dec 24 05:06:51.382505 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-844ed4c9-b6fd-4887-8a91-191c0ecc0417 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:51.384078 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-844ed4c9-b6fd-4887-8a91-191c0ecc0417 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=6c9c47f70b8d4da5827a8ef4349559ab&device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 1096 time: 0.0448437 Dec 24 05:06:51.420730 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:06:51.437634 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-30023935-94e0-4c2e-9b59-d6e920a30812 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8f0b0287-0281-4556-ae15-8fe2c2dbf50d HTTP/1.1" status: 200 len: 217 time: 0.0392523 Dec 24 05:06:51.487578 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-2ca7bd41-cb85-44a8-8d93-1c15a85a5176 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:51.489073 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-2ca7bd41-cb85-44a8-8d93-1c15a85a5176 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=699b398d-7f9d-4acb-bc18-ac32f35377c3 HTTP/1.1" status: 200 len: 855 time: 0.0435352 Dec 24 05:06:51.536873 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-b0c2f039-a171-4eb7-9b4c-744c8ee003dd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:51.547501 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-b0c2f039-a171-4eb7-9b4c-744c8ee003dd service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=c908572e-3b6b-470c-8b88-35b51f1472c6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0423872 Dec 24 05:06:51.647699 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-cefc843d-74d3-48b1-85b1-b5ed20acf0a0 service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1001418 Dec 24 05:06:51.745564 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d298e7be-159d-413d-8dfe-b72b82aff71c req-f1ad2223-d7fe-4426-aa9b-0553102aa34b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:51.747749 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d298e7be-159d-413d-8dfe-b72b82aff71c req-f1ad2223-d7fe-4426-aa9b-0553102aa34b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 943 time: 0.0594618 Dec 24 05:06:51.755306 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7ece5503-bf9f-46e7-8f09-3113ca5ad7fe req-8e015aba-a473-4bc1-ad9b-ea13adf74a5d service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0920372 Dec 24 05:06:51.798290 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d298e7be-159d-413d-8dfe-b72b82aff71c req-a2e67f29-f05d-4650-a7f9-b6e36afcc95c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430584 Dec 24 05:06:51.883659 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82d6e028-426e-4212-aeff-49822e411c53 req-42a81305-e747-4994-ac5c-a10f6182ebfa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:51.885201 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-82d6e028-426e-4212-aeff-49822e411c53 req-42a81305-e747-4994-ac5c-a10f6182ebfa service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=6c9c47f70b8d4da5827a8ef4349559ab&device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 1096 time: 0.0416601 Dec 24 05:06:51.981116 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82d6e028-426e-4212-aeff-49822e411c53 req-4f05d6c7-c3f5-4f4c-8338-b28c197a86ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:51.982583 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-82d6e028-426e-4212-aeff-49822e411c53 req-4f05d6c7-c3f5-4f4c-8338-b28c197a86ef service neutron] 10.222.0.46 "GET /v2.0/networks?id=c908572e-3b6b-470c-8b88-35b51f1472c6 HTTP/1.1" status: 200 len: 917 time: 0.0903146 Dec 24 05:06:52.023802 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-82d6e028-426e-4212-aeff-49822e411c53 req-88e8ecca-b519-4a7f-9445-748cd7f79bbe service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8f0b0287-0281-4556-ae15-8fe2c2dbf50d HTTP/1.1" status: 200 len: 217 time: 0.0334821 Dec 24 05:06:52.076068 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82d6e028-426e-4212-aeff-49822e411c53 req-17664abc-ae35-414f-b91d-d7ffe114a143 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:52.077549 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-82d6e028-426e-4212-aeff-49822e411c53 req-17664abc-ae35-414f-b91d-d7ffe114a143 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=699b398d-7f9d-4acb-bc18-ac32f35377c3 HTTP/1.1" status: 200 len: 855 time: 0.0468273 Dec 24 05:06:52.123595 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82d6e028-426e-4212-aeff-49822e411c53 req-e90f4128-6b9e-47ae-a5e8-af07ab84cccb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:52.125062 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-82d6e028-426e-4212-aeff-49822e411c53 req-e90f4128-6b9e-47ae-a5e8-af07ab84cccb service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=c908572e-3b6b-470c-8b88-35b51f1472c6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0399921 Dec 24 05:06:52.243802 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-82d6e028-426e-4212-aeff-49822e411c53 req-afffa89b-67f5-4d69-8e95-ab33d6b0616b service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1106865 Dec 24 05:06:52.337319 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-82d6e028-426e-4212-aeff-49822e411c53 req-86f81f4a-53ab-4655-bb58-5078eba8363a service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0854943 Dec 24 05:06:52.947814 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-255e1bf1-9b51-4c23-8f47-510daa90c06b req-6377b791-69be-4c6c-84ae-1f099f7434bc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:52.949386 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-255e1bf1-9b51-4c23-8f47-510daa90c06b req-6377b791-69be-4c6c-84ae-1f099f7434bc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 943 time: 0.0583634 Dec 24 05:06:53.008513 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-255e1bf1-9b51-4c23-8f47-510daa90c06b req-e7738fdf-5280-4c55-9f41-ba04186920b8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0527890 Dec 24 05:06:53.206087 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e7184f8c-7f22-48e4-9365-ef06abf7c832 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:54.144045 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b482a8f-be82-4a8e-95e9-f13b54d0bfa5 req-d96defb9-296d-48a9-bdd7-ed5edde43dcc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:54.145743 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3b482a8f-be82-4a8e-95e9-f13b54d0bfa5 req-d96defb9-296d-48a9-bdd7-ed5edde43dcc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 943 time: 0.0533543 Dec 24 05:06:54.201576 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3b482a8f-be82-4a8e-95e9-f13b54d0bfa5 req-72a22404-2b70-4891-af8c-2ae835b8adb9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0489206 Dec 24 05:06:55.268735 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-62eb9ac6-8643-4787-a2cd-a6208b44a03c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:55.338456 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c77a405c-6f0d-4644-96ee-cab813c7cffb req-2ec6faa5-1ab4-4e47-9e79-f1767e6e958c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:55.339928 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c77a405c-6f0d-4644-96ee-cab813c7cffb req-2ec6faa5-1ab4-4e47-9e79-f1767e6e958c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 943 time: 0.0496688 Dec 24 05:06:55.389239 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c77a405c-6f0d-4644-96ee-cab813c7cffb req-1221b552-0c31-4457-8ca0-8f8361529ffd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433204 Dec 24 05:06:56.059992 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 8f0b0287-0281-4556-ae15-8fe2c2dbf50d details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 05:06:56.156420 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=8f0b0287-0281-4556-ae15-8fe2c2dbf50d,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:06:56.171554 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': '8f0b0287-0281-4556-ae15-8fe2c2dbf50d', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'port_id': '8f0b0287-0281-4556-ae15-8fe2c2dbf50d', 'mac_address': 'fa:16:3e:da:a5:13', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 05:06:56.211701 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:56.230955 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8f0b0287-0281-4556-ae15-8fe2c2dbf50d {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:06:56.254945 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=8f0b0287-0281-4556-ae15-8fe2c2dbf50d,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:06:56.263074 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:56.311878 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=8f0b0287-0281-4556-ae15-8fe2c2dbf50d,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:56.483260 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:56.512706 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b58a46c7-3369-4588-be4f-51075006302e req-cda6efae-0322-44e6-9d7a-5e66ce9d8991 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:56.514208 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b58a46c7-3369-4588-be4f-51075006302e req-cda6efae-0322-44e6-9d7a-5e66ce9d8991 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 944 time: 0.0489116 Dec 24 05:06:56.562866 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b58a46c7-3369-4588-be4f-51075006302e req-6256d5ce-425b-49f0-89a1-3209858e75b2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426531 Dec 24 05:06:56.703144 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['8f0b0287-0281-4556-ae15-8fe2c2dbf50d'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:06:57.346243 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-d5b9df60-9189-4e2e-9691-9707760c6883 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2046201915&fields=id&tenant_id=8b1a80c6322a493ba10c69a77168b46f HTTP/1.1" status: 200 len: 267 time: 0.0604386 Dec 24 05:06:57.450031 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-dc4847d7-3860-44ff-850c-47acc8537ab8 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:57.451493 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-dc4847d7-3860-44ff-850c-47acc8537ab8 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/networks?id=df2331c3-0dd0-460e-980f-1e2409baa35e HTTP/1.1" status: 200 len: 810 time: 0.0981717 Dec 24 05:06:57.466928 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-808e9396-9320-49f0-adf4-c5d84382d00b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/quotas/8b1a80c6322a493ba10c69a77168b46f HTTP/1.1" status: 200 len: 375 time: 0.0095010 Dec 24 05:06:57.518326 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-057a30f6-2cf3-4347-b0cf-2109d363df91 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=8b1a80c6322a493ba10c69a77168b46f&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0462892 Dec 24 05:06:57.623698 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-52d88f48-587e-49a9-852f-acef8f7f7389 service neutron] 10.222.0.43 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0895512 Dec 24 05:06:57.686883 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc365926-bafd-4f50-80fc-ccde256130cb req-bfc01f30-c153-4ef8-8565-87e7ca7549e2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:57.688378 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-fc365926-bafd-4f50-80fc-ccde256130cb req-bfc01f30-c153-4ef8-8565-87e7ca7549e2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 944 time: 0.0519016 Dec 24 05:06:57.717015 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-bc5b4dab-9262-4e68-8010-893a7776c531 service neutron] 10.222.0.43 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0871611 Dec 24 05:06:57.736435 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-fc365926-bafd-4f50-80fc-ccde256130cb req-5b634126-5606-4892-9de4-ca5e5b013122 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416236 Dec 24 05:06:57.924097 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:58.009029 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-40af9fd2-3ea1-4166-bde4-c8b12315ddde req-14b3cd1e-23e8-4329-a99b-3d112b74f39e tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 210 time: 0.0268283 Dec 24 05:06:58.073184 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 8f0b0287-0281-4556-ae15-8fe2c2dbf50d up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:06:58.124539 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning for port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d completed by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 24 05:06:58.128673 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:06:58.129080 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:58.222185 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:58.245261 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cc21b91f-c07f-40f8-8cf1-a9c343386f03', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8f0b0287-0281-4556-ae15-8fe2c2dbf50d'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:06:58.247538 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bd195c13-f11c-43c9-b1e0-fae95da4d761" -d '{"events": [{"server_uuid": "cc21b91f-c07f-40f8-8cf1-a9c343386f03", "name": "network-vif-plugged", "status": "completed", "tag": "8f0b0287-0281-4556-ae15-8fe2c2dbf50d"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:06:58.261442 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=8f0b0287-0281-4556-ae15-8fe2c2dbf50d,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:06:58.267372 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:58.291356 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:06:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f29aead5-2c63-49c4-a07c-24b5c40ed334 x-openstack-request-id: req-f29aead5-2c63-49c4-a07c-24b5c40ed334 {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:06:58.291644 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cc21b91f-c07f-40f8-8cf1-a9c343386f03", "name": "network-vif-plugged", "status": "completed", "tag": "8f0b0287-0281-4556-ae15-8fe2c2dbf50d", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:06:58.291959 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-f29aead5-2c63-49c4-a07c-24b5c40ed334 {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:06:58.292342 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cc21b91f-c07f-40f8-8cf1-a9c343386f03', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8f0b0287-0281-4556-ae15-8fe2c2dbf50d', 'code': 200} Dec 24 05:06:58.320411 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=8f0b0287-0281-4556-ae15-8fe2c2dbf50d,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:06:58.504279 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af310839-7541-4fbb-8713-660d3e7ee688 req-85c2e319-3c8d-4f3d-b2c4-61fb2590d95b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:58.505854 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-af310839-7541-4fbb-8713-660d3e7ee688 req-85c2e319-3c8d-4f3d-b2c4-61fb2590d95b service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 1098 time: 0.0431709 Dec 24 05:06:58.553540 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-af310839-7541-4fbb-8713-660d3e7ee688 req-c08af5d3-e7a4-4633-a251-4bbdc0b3ca51 service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399351 Dec 24 05:06:58.574059 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:58.885285 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-065cb0d5-7fea-4f2a-951b-f42f3ae4dbe8 req-b6d86e8b-d9bd-4720-9990-958c3f9c52b1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:58.886800 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-065cb0d5-7fea-4f2a-951b-f42f3ae4dbe8 req-b6d86e8b-d9bd-4720-9990-958c3f9c52b1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0648630 Dec 24 05:06:58.938726 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-065cb0d5-7fea-4f2a-951b-f42f3ae4dbe8 req-a361ca43-2ce0-48f2-bb9f-9308409e35cf tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427561 Dec 24 05:06:59.106089 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-76a3e4cf-18d3-4d10-b8e4-255a7352f8dd req-4afecd68-9f88-4354-baae-934ae59e68bd tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 210 time: 0.0271795 Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:59.534961 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:06:59.537416 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:59.537416 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:06:59.537416 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:59.537416 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:06:59.537416 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:59.537416 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:06:59.537416 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:59.537416 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:06:59.537416 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:59.537416 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:06:59.537416 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:06:59.537416 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:06:59.537416 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-2571e571-7179-4421-9fb6-1a4efb3f65bd tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:06:59.538207 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-2571e571-7179-4421-9fb6-1a4efb3f65bd tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.46 "GET /v2.0/networks?id=df2331c3-0dd0-460e-980f-1e2409baa35e HTTP/1.1" status: 200 len: 810 time: 0.1066511 Dec 24 05:06:59.613673 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-53cb9fa8-c2e2-4332-9059-5c05498ccf39 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.46 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8b1a80c6322a493ba10c69a77168b46f HTTP/1.1" status: 200 len: 380 time: 0.0598350 Dec 24 05:06:59.627371 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-7b7a8ed0-57bf-4543-82bc-86393b515c98 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Request body: {'port': {'device_id': 'd51afc95-dcbd-4ab4-9e4f-951d2dd7af88', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'admin_state_up': True, 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'security_groups': ['b4b0be72-ffa9-4e18-8986-808181a3a50d']}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:06:59.737195 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-7b7a8ed0-57bf-4543-82bc-86393b515c98 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Made reservation on behalf of 8b1a80c6322a493ba10c69a77168b46f for: {'port': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:06:59.741037 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-7b7a8ed0-57bf-4543-82bc-86393b515c98 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:06:59.884353 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-7b7a8ed0-57bf-4543-82bc-86393b515c98 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Allocated IP 172.20.0.6 (df2331c3-0dd0-460e-980f-1e2409baa35e/9df81c69-0712-4247-ad21-3b3a089ce4b5/f25ccd41-53b3-4bb9-84e1-824627c3e8e6) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:07:00.028804 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-7b7a8ed0-57bf-4543-82bc-86393b515c98 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:00.097125 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eef68e95-ddbe-4c3f-b535-4d3e4e5da12c req-14c10f55-d523-44fb-8327-49c0d2e303cf tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:00.098624 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-eef68e95-ddbe-4c3f-b535-4d3e4e5da12c req-14c10f55-d523-44fb-8327-49c0d2e303cf tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0787044 Dec 24 05:07:00.100062 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-7b7a8ed0-57bf-4543-82bc-86393b515c98 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:00.164003 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-7b7a8ed0-57bf-4543-82bc-86393b515c98 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Network df2331c3-0dd0-460e-980f-1e2409baa35e is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:07:00.169182 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-7b7a8ed0-57bf-4543-82bc-86393b515c98 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:07:00.178745 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b7a8ed0-57bf-4543-82bc-86393b515c98 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Pushing event updated for resources: {'Port': ['ID=f25ccd41-53b3-4bb9-84e1-824627c3e8e6,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:07:00.184123 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-7b7a8ed0-57bf-4543-82bc-86393b515c98 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:07:00.225160 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-eef68e95-ddbe-4c3f-b535-4d3e4e5da12c req-bc148600-5694-4f53-ad8b-23b4da54c39f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1188302 Dec 24 05:07:00.233053 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67e06036-630a-4a36-b889-01107fbeeea3 req-d64cd2cd-d28b-444f-9db1-68231f68dd1c tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:00.241290 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-67e06036-630a-4a36-b889-01107fbeeea3 req-d64cd2cd-d28b-444f-9db1-68231f68dd1c tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 931 time: 0.0638158 Dec 24 05:07:00.255816 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-7b7a8ed0-57bf-4543-82bc-86393b515c98 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:00.256488 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-7b7a8ed0-57bf-4543-82bc-86393b515c98 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:00.274375 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-7b7a8ed0-57bf-4543-82bc-86393b515c98 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.46 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6506522 Dec 24 05:07:00.288373 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-67e06036-630a-4a36-b889-01107fbeeea3 req-b0daa214-3915-484b-af30-42725f78cfff tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460122 Dec 24 05:07:00.299762 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-df7ef9cd-763f-4075-8ffc-46e297e44865 service neutron] Request body: {'port': {'device_id': 'd51afc95-dcbd-4ab4-9e4f-951d2dd7af88', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81644'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:07:00.355019 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-df7ef9cd-763f-4075-8ffc-46e297e44865 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:00.411810 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-1cc22c70-156a-4509-a507-0c2937e94f87 None None] Provisioning complete for port f25ccd41-53b3-4bb9-84e1-824627c3e8e6 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:07:00.412418 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-1cc22c70-156a-4509-a507-0c2937e94f87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:00.447417 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-1cc22c70-156a-4509-a507-0c2937e94f87 None None] Port f25ccd41-53b3-4bb9-84e1-824627c3e8e6 cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 05:07:00.628703 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-df7ef9cd-763f-4075-8ffc-46e297e44865 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f25ccd41-53b3-4bb9-84e1-824627c3e8e6 {{(pid=102476) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:07:00.636774 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-df7ef9cd-763f-4075-8ffc-46e297e44865 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:00.652634 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.provisioning_blocks [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-df7ef9cd-763f-4075-8ffc-46e297e44865 service neutron] Transition to ACTIVE for port object f25ccd41-53b3-4bb9-84e1-824627c3e8e6 will not be triggered until provisioned by entity L2. {{(pid=102476) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 24 05:07:00.658167 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-df7ef9cd-763f-4075-8ffc-46e297e44865 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:00.715304 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df7ef9cd-763f-4075-8ffc-46e297e44865 service neutron] Pushing event updated for resources: {'Port': ['ID=f25ccd41-53b3-4bb9-84e1-824627c3e8e6,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:07:00.780632 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-df7ef9cd-763f-4075-8ffc-46e297e44865 service neutron] Attempting to bind port f25ccd41-53b3-4bb9-84e1-824627c3e8e6 on host hv-cinder-81644 for vnic_type normal with profile {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:07:00.780976 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-df7ef9cd-763f-4075-8ffc-46e297e44865 service neutron] Attempting to bind port f25ccd41-53b3-4bb9-84e1-824627c3e8e6 by drivers openvswitch,hyperv on host hv-cinder-81644 at level 0 using segments [{'id': 'cb920e21-208e-474e-84a0-615ea3280b8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e'}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:07:00.781307 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-df7ef9cd-763f-4075-8ffc-46e297e44865 service neutron] Attempting to bind port f25ccd41-53b3-4bb9-84e1-824627c3e8e6 on network df2331c3-0dd0-460e-980f-1e2409baa35e {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:07:00.786216 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-df7ef9cd-763f-4075-8ffc-46e297e44865 service neutron] Port f25ccd41-53b3-4bb9-84e1-824627c3e8e6 on network df2331c3-0dd0-460e-980f-1e2409baa35e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81644 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 24 05:07:00.786542 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-df7ef9cd-763f-4075-8ffc-46e297e44865 service neutron] Attempting to bind port f25ccd41-53b3-4bb9-84e1-824627c3e8e6 on network df2331c3-0dd0-460e-980f-1e2409baa35e {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:07:00.792031 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-df7ef9cd-763f-4075-8ffc-46e297e44865 service neutron] Checking agent: {'id': '7a2ffd19-371f-4f7b-a239-eea3b5cfd55b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81644', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'started_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 6, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:07:00.792429 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-df7ef9cd-763f-4075-8ffc-46e297e44865 service neutron] Checking segment: {'id': 'cb920e21-208e-474e-84a0-615ea3280b8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:07:00.792854 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-df7ef9cd-763f-4075-8ffc-46e297e44865 service neutron] Bound using segment: {'id': 'cb920e21-208e-474e-84a0-615ea3280b8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e'} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:07:00.793367 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-df7ef9cd-763f-4075-8ffc-46e297e44865 service neutron] Bound port: f25ccd41-53b3-4bb9-84e1-824627c3e8e6, host: hv-cinder-81644, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'cb920e21-208e-474e-84a0-615ea3280b8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e'}}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:07:00.793630 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-df7ef9cd-763f-4075-8ffc-46e297e44865 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:00.861895 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-df7ef9cd-763f-4075-8ffc-46e297e44865 service neutron] For port f25ccd41-53b3-4bb9-84e1-824627c3e8e6, host hv-cinder-81644, cleared binding levels {{(pid=102476) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:07:00.864876 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-df7ef9cd-763f-4075-8ffc-46e297e44865 service neutron] For port f25ccd41-53b3-4bb9-84e1-824627c3e8e6, host hv-cinder-81644, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=f25ccd41-53b3-4bb9-84e1-824627c3e8e6,segment=NetworkSegment(cb920e21-208e-474e-84a0-615ea3280b8a),segment_id=cb920e21-208e-474e-84a0-615ea3280b8a)] {{(pid=102476) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:07:00.869893 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-df7ef9cd-763f-4075-8ffc-46e297e44865 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:00.909512 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-df7ef9cd-763f-4075-8ffc-46e297e44865 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:00.910255 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-df7ef9cd-763f-4075-8ffc-46e297e44865 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:00.911780 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-df7ef9cd-763f-4075-8ffc-46e297e44865 service neutron] 10.222.0.46 "PUT /v2.0/ports/f25ccd41-53b3-4bb9-84e1-824627c3e8e6 HTTP/1.1" status: 200 len: 1093 time: 0.6164246 Dec 24 05:07:00.912235 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd51afc95-dcbd-4ab4-9e4f-951d2dd7af88', 'tag': 'f25ccd41-53b3-4bb9-84e1-824627c3e8e6'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:07:00.914908 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-02ab9c00-1ed2-4c42-82ad-63b1ee98333f" -d '{"events": [{"name": "network-changed", "server_uuid": "d51afc95-dcbd-4ab4-9e4f-951d2dd7af88", "tag": "f25ccd41-53b3-4bb9-84e1-824627c3e8e6"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:07:00.937085 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df7ef9cd-763f-4075-8ffc-46e297e44865 service neutron] Pushing event updated for resources: {'Port': ['ID=f25ccd41-53b3-4bb9-84e1-824627c3e8e6,revision_number=3']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:07:00.967220 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:07:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0ff615bf-d2e3-41a3-9b39-0d9c89b2cfb5 x-openstack-request-id: req-0ff615bf-d2e3-41a3-9b39-0d9c89b2cfb5 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:07:00.967509 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d51afc95-dcbd-4ab4-9e4f-951d2dd7af88", "tag": "f25ccd41-53b3-4bb9-84e1-824627c3e8e6", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:07:00.967786 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-0ff615bf-d2e3-41a3-9b39-0d9c89b2cfb5 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:07:00.968206 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd51afc95-dcbd-4ab4-9e4f-951d2dd7af88', 'tag': 'f25ccd41-53b3-4bb9-84e1-824627c3e8e6', 'status': 'completed', 'code': 200} Dec 24 05:07:01.044191 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-df8f2399-d728-4521-b6a5-b2ae13af73fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:01.045998 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-df8f2399-d728-4521-b6a5-b2ae13af73fc service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=8b1a80c6322a493ba10c69a77168b46f&device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 1096 time: 0.0442803 Dec 24 05:07:01.125443 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-6559be7b-8e66-4559-9efc-6fe74c5c5e93 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=f25ccd41-53b3-4bb9-84e1-824627c3e8e6 HTTP/1.1" status: 200 len: 217 time: 0.0361950 Dec 24 05:07:01.178079 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-7afb72a2-6f74-4ea1-b0f1-6f6e7b303e7b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:01.179566 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-7afb72a2-6f74-4ea1-b0f1-6f6e7b303e7b service neutron] 10.222.0.46 "GET /v2.0/subnets?id=9df81c69-0712-4247-ad21-3b3a089ce4b5 HTTP/1.1" status: 200 len: 849 time: 0.0471518 Dec 24 05:07:01.227551 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-f62bab89-a19b-4e46-b58f-93a2d1e7c1cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:01.228986 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-f62bab89-a19b-4e46-b58f-93a2d1e7c1cb service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=df2331c3-0dd0-460e-980f-1e2409baa35e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0418060 Dec 24 05:07:01.323246 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-c2d1468e-2f4d-42e9-9b6c-c19ee6227fb3 service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863845 Dec 24 05:07:01.365275 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ccd32cd-444e-491e-8827-2642259c32b5 req-9463ecab-9df4-442d-a64e-8351dfe99e05 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:01.366841 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-2ccd32cd-444e-491e-8827-2642259c32b5 req-9463ecab-9df4-442d-a64e-8351dfe99e05 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0672207 Dec 24 05:07:01.416638 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-2ccd32cd-444e-491e-8827-2642259c32b5 req-19a7a19d-e918-4b75-8210-ec2d3ef6b2c3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431504 Dec 24 05:07:01.453602 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb0e038a-f9e4-47bd-8c22-e9bb8a2521f5 req-78b7c7c0-0238-47bd-a397-4dca306321af tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:01.455097 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-eb0e038a-f9e4-47bd-8c22-e9bb8a2521f5 req-78b7c7c0-0238-47bd-a397-4dca306321af tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 943 time: 0.0921662 Dec 24 05:07:01.458779 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6124fd64-e024-4224-8b30-9ab40c253c7b req-7172e15e-49e5-403f-9cc5-456a0bcb2d9c service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1270845 Dec 24 05:07:01.515571 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-eb0e038a-f9e4-47bd-8c22-e9bb8a2521f5 req-a4ff4a4a-db8e-4d73-b066-d13b14a87cf2 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0532603 Dec 24 05:07:01.544268 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a495644c-c92d-45e9-972c-ec8d3a9ec814 req-2c3ff998-8014-490a-afd7-34aef4370c03 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:01.545814 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a495644c-c92d-45e9-972c-ec8d3a9ec814 req-2c3ff998-8014-490a-afd7-34aef4370c03 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0595343 Dec 24 05:07:01.554590 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 33436) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:07:01.559250 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-ee773fcc-5244-47bb-bdde-d62c76f551d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Request body: {'floatingip': {'port_id': '8f0b0287-0281-4556-ae15-8fe2c2dbf50d'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:07:01.587796 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02ab9c00-1ed2-4c42-82ad-63b1ee98333f req-519bf76e-6375-4aad-8d03-077514f2efcf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:01.589841 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-02ab9c00-1ed2-4c42-82ad-63b1ee98333f req-519bf76e-6375-4aad-8d03-077514f2efcf service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=8b1a80c6322a493ba10c69a77168b46f&device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 1096 time: 0.0468640 Dec 24 05:07:01.598947 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ee773fcc-5244-47bb-bdde-d62c76f551d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for floatingip, before_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:01.700448 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02ab9c00-1ed2-4c42-82ad-63b1ee98333f req-a0e0e41d-530d-4e94-9611-803526429053 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:01.702653 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-02ab9c00-1ed2-4c42-82ad-63b1ee98333f req-a0e0e41d-530d-4e94-9611-803526429053 service neutron] 10.222.0.46 "GET /v2.0/networks?id=df2331c3-0dd0-460e-980f-1e2409baa35e HTTP/1.1" status: 200 len: 911 time: 0.1035914 Dec 24 05:07:01.765664 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-02ab9c00-1ed2-4c42-82ad-63b1ee98333f req-ac1e2c88-5018-499a-bdc2-ee5c24e66903 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=f25ccd41-53b3-4bb9-84e1-824627c3e8e6 HTTP/1.1" status: 200 len: 217 time: 0.0512576 Dec 24 05:07:01.816628 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02ab9c00-1ed2-4c42-82ad-63b1ee98333f req-10aff017-8674-4608-8945-6abaf0700a64 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:01.818126 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-02ab9c00-1ed2-4c42-82ad-63b1ee98333f req-10aff017-8674-4608-8945-6abaf0700a64 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=9df81c69-0712-4247-ad21-3b3a089ce4b5 HTTP/1.1" status: 200 len: 849 time: 0.0489340 Dec 24 05:07:01.902684 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d122597-c78d-453d-a19b-f9b072418252 req-d953cdda-0492-46c7-896c-20629e47476a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:01.904101 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3d122597-c78d-453d-a19b-f9b072418252 req-d953cdda-0492-46c7-896c-20629e47476a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 945 time: 0.0768957 Dec 24 05:07:01.905918 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02ab9c00-1ed2-4c42-82ad-63b1ee98333f req-f50d8097-233d-49ee-9700-063e39455254 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:01.907326 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-02ab9c00-1ed2-4c42-82ad-63b1ee98333f req-f50d8097-233d-49ee-9700-063e39455254 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=df2331c3-0dd0-460e-980f-1e2409baa35e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0788307 Dec 24 05:07:02.011678 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3d122597-c78d-453d-a19b-f9b072418252 req-258be01a-173d-4b10-ade5-8d0cd7e2403f tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0987911 Dec 24 05:07:02.036340 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 33448) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:07:02.047321 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-02ab9c00-1ed2-4c42-82ad-63b1ee98333f req-adc53d24-095b-4a27-a857-0b9fb5aea8d4 service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1152847 Dec 24 05:07:02.149543 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-02ab9c00-1ed2-4c42-82ad-63b1ee98333f req-3bdd4b96-2226-4fcc-beac-7594a6bdcbb2 service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0922773 Dec 24 05:07:02.240036 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0473d2e9-2572-4220-9065-01a30138d10c tempest-TestMinimumBasicScenario-1360830827 tempest-TestMinimumBasicScenario-1360830827-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:02.241613 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-0473d2e9-2572-4220-9065-01a30138d10c tempest-TestMinimumBasicScenario-1360830827 tempest-TestMinimumBasicScenario-1360830827-project-admin] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 1093 time: 0.2042835 Dec 24 05:07:02.244835 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 33452) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:07:02.249441 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-74da54a1-b4ac-418f-96fb-26bdee3a948b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Request body: {'floatingip': {'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'port_id': 'b8dc8fcb-f50d-49a3-9bd0-47110fdb068f', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'fixed_ip_address': '172.20.0.8'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:07:02.278100 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-74da54a1-b4ac-418f-96fb-26bdee3a948b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for floatingip, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:02.397152 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-74da54a1-b4ac-418f-96fb-26bdee3a948b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:02.453820 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ee773fcc-5244-47bb-bdde-d62c76f551d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:02.458781 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ee773fcc-5244-47bb-bdde-d62c76f551d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-545804'] for floatingip, after_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:02.507344 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [None req-74da54a1-b4ac-418f-96fb-26bdee3a948b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Allocated IP 172.27.1.21 (9b4e4b31-551f-45a9-b26a-cb44ee20a17d/f277b899-8779-420e-8a8d-bfcd5eb7f012/88bb6525-2923-4cd6-8cca-8ee494b8d0a9) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:07:02.571744 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.db.l3_db [None req-ee773fcc-5244-47bb-bdde-d62c76f551d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Floating IP c32cf6b1-238e-4d2d-a42b-bc2e6956d8d1 associated. External IP: 172.27.1.122, port: 8f0b0287-0281-4556-ae15-8fe2c2dbf50d. Dec 24 05:07:02.621303 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-74da54a1-b4ac-418f-96fb-26bdee3a948b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:02.654824 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-74da54a1-b4ac-418f-96fb-26bdee3a948b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:02.694038 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74da54a1-b4ac-418f-96fb-26bdee3a948b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:07:02.697419 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-74da54a1-b4ac-418f-96fb-26bdee3a948b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:07:02.700926 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74da54a1-b4ac-418f-96fb-26bdee3a948b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:07:02.705822 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d030bf7f-8f44-4d90-935f-80abdaf4ce21 req-1b5540dd-2deb-4781-b687-508244e47d0b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:02.706769 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d030bf7f-8f44-4d90-935f-80abdaf4ce21 req-1b5540dd-2deb-4781-b687-508244e47d0b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 943 time: 0.0920537 Dec 24 05:07:02.722868 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74da54a1-b4ac-418f-96fb-26bdee3a948b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Pushing event updated for resources: {'Port': ['ID=88bb6525-2923-4cd6-8cca-8ee494b8d0a9,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:07:02.826057 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d030bf7f-8f44-4d90-935f-80abdaf4ce21 req-8315e7bf-efe8-4146-b4dc-f450dea9f540 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1122634 Dec 24 05:07:02.856048 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ee773fcc-5244-47bb-bdde-d62c76f551d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Router d1392df8-0562-4659-9906-2d085b726626 has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102477) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:07:02.965198 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ee773fcc-5244-47bb-bdde-d62c76f551d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102477) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:07:02.969737 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ee773fcc-5244-47bb-bdde-d62c76f551d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for floatingip, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:02.975795 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9c8bcba-ee67-45a1-ae85-6a05e5dd0328 None None] Sync routers for ids ['d1392df8-0562-4659-9906-2d085b726626'] in dv-cinder-816443-2-iscsi {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:07:02.986992 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9c8bcba-ee67-45a1-ae85-6a05e5dd0328 None None] Routers {'d1392df8-0562-4659-9906-2d085b726626'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:07:02.987603 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-d9c8bcba-ee67-45a1-ae85-6a05e5dd0328 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:06:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['d1392df8-0562-4659-9906-2d085b726626'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:07:03.006554 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-ee773fcc-5244-47bb-bdde-d62c76f551d5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "PUT /v2.0/floatingips/c32cf6b1-238e-4d2d-a42b-bc2e6956d8d1 HTTP/1.1" status: 200 len: 991 time: 1.4481101 Dec 24 05:07:03.006554 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cc21b91f-c07f-40f8-8cf1-a9c343386f03', 'tag': '8f0b0287-0281-4556-ae15-8fe2c2dbf50d'}] {{(pid=102477) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:07:03.007043 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d3e3d7a262849d185e72ba84ca6adca9bb1fee52649b04b101352e7e29a99ca8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8a7d1aa2-6187-4973-a563-26848e60681b" -d '{"events": [{"name": "network-changed", "server_uuid": "cc21b91f-c07f-40f8-8cf1-a9c343386f03", "tag": "8f0b0287-0281-4556-ae15-8fe2c2dbf50d"}]}' {{(pid=102477) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:07:03.114648 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-74da54a1-b4ac-418f-96fb-26bdee3a948b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:03.122894 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:07:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-075b1b56-2f14-4a97-90fc-43f08087ef29 x-openstack-request-id: req-075b1b56-2f14-4a97-90fc-43f08087ef29 {{(pid=102477) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:07:03.123175 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cc21b91f-c07f-40f8-8cf1-a9c343386f03", "tag": "8f0b0287-0281-4556-ae15-8fe2c2dbf50d", "status": "completed", "code": 200}]} {{(pid=102477) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:07:03.123426 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-075b1b56-2f14-4a97-90fc-43f08087ef29 {{(pid=102477) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:07:03.123816 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cc21b91f-c07f-40f8-8cf1-a9c343386f03', 'tag': '8f0b0287-0281-4556-ae15-8fe2c2dbf50d', 'status': 'completed', 'code': 200} Dec 24 05:07:03.129457 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-d9c8bcba-ee67-45a1-ae85-6a05e5dd0328 None None] Set router d1392df8-0562-4659-9906-2d085b726626 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:07:03.188494 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-74da54a1-b4ac-418f-96fb-26bdee3a948b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:03.275821 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a7d1aa2-6187-4973-a563-26848e60681b req-00636bc9-31a4-4b87-a622-6ccdd6631f81 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:03.277336 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8a7d1aa2-6187-4973-a563-26848e60681b req-00636bc9-31a4-4b87-a622-6ccdd6631f81 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=6c9c47f70b8d4da5827a8ef4349559ab&device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 1098 time: 0.0869560 Dec 24 05:07:03.393675 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-d9c8bcba-ee67-45a1-ae85-6a05e5dd0328 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1392df8-0562-4659-9906-2d085b726626', 'name': 'tempest-AttachVolumeShelveTestJSON-634320677-router', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148'}], 'enable_snat': True}, 'gw_port_id': 'd5be979e-f11f-424a-bd46-164029481a60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:06Z', 'updated_at': '2021-12-24T04:59:13Z', 'revision_number': 4, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'gw_port': {'id': 'd5be979e-f11f-424a-bd46-164029481a60', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:30:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:07Z', 'updated_at': '2021-12-24T04:59:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': 'c32cf6b1-238e-4d2d-a42b-bc2e6956d8d1', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'floating_ip_address': '172.27.1.122', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': 'd1392df8-0562-4659-9906-2d085b726626', 'port_id': '8f0b0287-0281-4556-ae15-8fe2c2dbf50d', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 562, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'mac_address': 'fa:16:3e:da:a5:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc21b91f-c07f-40f8-8cf1-a9c343386f03', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:06:46Z', 'updated_at': '2021-12-24T05:07:02Z', 'revision_number': 1, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3e72624e-ab22-45c6-b262-91a63ca05279', 'name': '', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'mac_address': 'fa:16:3e:38:ea:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:12Z', 'updated_at': '2021-12-24T04:59:19Z', 'revision_number': 5, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'subnets': [{'id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:07:03.424223 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9c8bcba-ee67-45a1-ae85-6a05e5dd0328 None None] Checking router: d1392df8-0562-4659-9906-2d085b726626 for host: dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:07:03.432706 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9c8bcba-ee67-45a1-ae85-6a05e5dd0328 None None] Routers {'d1392df8-0562-4659-9906-2d085b726626'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:07:03.433184 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a7d1aa2-6187-4973-a563-26848e60681b req-87cf2d94-6914-45b2-b94b-deda1be53b73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:03.433302 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-d9c8bcba-ee67-45a1-ae85-6a05e5dd0328 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:06:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['d1392df8-0562-4659-9906-2d085b726626'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:07:03.434681 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8a7d1aa2-6187-4973-a563-26848e60681b req-87cf2d94-6914-45b2-b94b-deda1be53b73 service neutron] 10.222.0.46 "GET /v2.0/networks?id=c908572e-3b6b-470c-8b88-35b51f1472c6 HTTP/1.1" status: 200 len: 917 time: 0.1480317 Dec 24 05:07:03.443025 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-74da54a1-b4ac-418f-96fb-26bdee3a948b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:03.452914 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-74da54a1-b4ac-418f-96fb-26bdee3a948b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:03.539899 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-d9c8bcba-ee67-45a1-ae85-6a05e5dd0328 None None] Set router d1392df8-0562-4659-9906-2d085b726626 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:07:03.767317 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-d9c8bcba-ee67-45a1-ae85-6a05e5dd0328 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1392df8-0562-4659-9906-2d085b726626', 'name': 'tempest-AttachVolumeShelveTestJSON-634320677-router', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148'}], 'enable_snat': True}, 'gw_port_id': 'd5be979e-f11f-424a-bd46-164029481a60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:06Z', 'updated_at': '2021-12-24T04:59:13Z', 'revision_number': 4, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'gw_port': {'id': 'd5be979e-f11f-424a-bd46-164029481a60', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:30:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:07Z', 'updated_at': '2021-12-24T04:59:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': 'c32cf6b1-238e-4d2d-a42b-bc2e6956d8d1', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'floating_ip_address': '172.27.1.122', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': 'd1392df8-0562-4659-9906-2d085b726626', 'port_id': '8f0b0287-0281-4556-ae15-8fe2c2dbf50d', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 562, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'mac_address': 'fa:16:3e:da:a5:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc21b91f-c07f-40f8-8cf1-a9c343386f03', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:06:46Z', 'updated_at': '2021-12-24T05:07:02Z', 'revision_number': 1, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3e72624e-ab22-45c6-b262-91a63ca05279', 'name': '', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'mac_address': 'fa:16:3e:38:ea:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:12Z', 'updated_at': '2021-12-24T04:59:19Z', 'revision_number': 5, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'subnets': [{'id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:07:03.792456 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9c8bcba-ee67-45a1-ae85-6a05e5dd0328 None None] The sync data for ids ['d1392df8-0562-4659-9906-2d085b726626'] in dv-cinder-816443-2-iscsi is: [{'id': 'd1392df8-0562-4659-9906-2d085b726626', 'name': 'tempest-AttachVolumeShelveTestJSON-634320677-router', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148'}], 'enable_snat': True}, 'gw_port_id': 'd5be979e-f11f-424a-bd46-164029481a60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:06Z', 'updated_at': '2021-12-24T04:59:13Z', 'revision_number': 4, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'gw_port': {'id': 'd5be979e-f11f-424a-bd46-164029481a60', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:30:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:07Z', 'updated_at': '2021-12-24T04:59:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': 'c32cf6b1-238e-4d2d-a42b-bc2e6956d8d1', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'floating_ip_address': '172.27.1.122', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': 'd1392df8-0562-4659-9906-2d085b726626', 'port_id': '8f0b0287-0281-4556-ae15-8fe2c2dbf50d', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 562, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'mac_address': 'fa:16:3e:da:a5:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc21b91f-c07f-40f8-8cf1-a9c343386f03', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:06:46Z', 'updated_at': '2021-12-24T05:07:02Z', 'revision_number': 1, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3e72624e-ab22-45c6-b262-91a63ca05279', 'name': '', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'mac_address': 'fa:16:3e:38:ea:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:12Z', 'updated_at': '2021-12-24T04:59:19Z', 'revision_number': 5, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'subnets': [{'id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:07:03.849165 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74da54a1-b4ac-418f-96fb-26bdee3a948b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Pushing event updated for resources: {'Port': ['ID=88bb6525-2923-4cd6-8cca-8ee494b8d0a9,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:07:03.855648 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8a7d1aa2-6187-4973-a563-26848e60681b req-5f4573a5-64a9-4c3b-a569-c66d5651fd8b service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8f0b0287-0281-4556-ae15-8fe2c2dbf50d HTTP/1.1" status: 200 len: 999 time: 0.4107108 Dec 24 05:07:03.859129 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-74da54a1-b4ac-418f-96fb-26bdee3a948b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-545804'] for floatingip, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:03.984424 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dcf8c607-8991-4527-bc2f-8b281d621674 None None] New status for floating IP c32cf6b1-238e-4d2d-a42b-bc2e6956d8d1: ACTIVE {{(pid=102479) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 24 05:07:04.006273 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a7d1aa2-6187-4973-a563-26848e60681b req-85a9369d-70c5-48f5-b060-66bc4b025192 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:04.008193 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8a7d1aa2-6187-4973-a563-26848e60681b req-85a9369d-70c5-48f5-b060-66bc4b025192 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=699b398d-7f9d-4acb-bc18-ac32f35377c3 HTTP/1.1" status: 200 len: 855 time: 0.1147032 Dec 24 05:07:04.066819 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2912832-8ae5-4fad-9170-d7fbdb509f09 req-4372510a-fe12-4893-91bd-e00e84bd3851 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:04.068328 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f2912832-8ae5-4fad-9170-d7fbdb509f09 req-4372510a-fe12-4893-91bd-e00e84bd3851 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 943 time: 0.1637285 Dec 24 05:07:04.073566 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.l3_db [None req-74da54a1-b4ac-418f-96fb-26bdee3a948b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Floating IP 17ceaa33-3c33-43ef-a6f5-a82143007f2e associated. External IP: 172.27.1.21, port: b8dc8fcb-f50d-49a3-9bd0-47110fdb068f. Dec 24 05:07:04.150089 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a7d1aa2-6187-4973-a563-26848e60681b req-e1ef9c70-55b3-4ed5-a6ac-e4566d469116 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:04.151576 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8a7d1aa2-6187-4973-a563-26848e60681b req-e1ef9c70-55b3-4ed5-a6ac-e4566d469116 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=c908572e-3b6b-470c-8b88-35b51f1472c6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1356778 Dec 24 05:07:04.173528 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f2912832-8ae5-4fad-9170-d7fbdb509f09 req-d9eb5259-e5e1-4244-9f58-c5521179d40d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0962071 Dec 24 05:07:04.342242 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8a7d1aa2-6187-4973-a563-26848e60681b req-f865eb4d-2841-4cfd-ab4e-3ecb17ca9091 service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1398773 Dec 24 05:07:04.454334 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-74da54a1-b4ac-418f-96fb-26bdee3a948b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Router a17d8253-42dc-43b3-b8fe-d8352c4bfc8f has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102476) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:07:04.482864 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8a7d1aa2-6187-4973-a563-26848e60681b req-b640439c-ed67-4da6-94b2-97c4b06b5803 service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1076961 Dec 24 05:07:04.580175 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-74da54a1-b4ac-418f-96fb-26bdee3a948b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:07:04.590284 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f105aa3-2719-474c-b0dd-b5a15392bd93 None None] Sync routers for ids ['a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'] in dv-cinder-816443-2-iscsi {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:07:04.599977 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-74da54a1-b4ac-418f-96fb-26bdee3a948b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for floatingip, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:04.605304 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f105aa3-2719-474c-b0dd-b5a15392bd93 None None] Routers {'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:07:04.605955 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-0f105aa3-2719-474c-b0dd-b5a15392bd93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:06:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:07:04.628603 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-74da54a1-b4ac-418f-96fb-26bdee3a948b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.3826690 Dec 24 05:07:04.629197 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ae7a102d-4793-4384-bc31-07d28018c9df', 'tag': 'b8dc8fcb-f50d-49a3-9bd0-47110fdb068f'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:07:04.631417 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1e366c8c-c5d7-4081-8662-792d7318c2e5" -d '{"events": [{"name": "network-changed", "server_uuid": "ae7a102d-4793-4384-bc31-07d28018c9df", "tag": "b8dc8fcb-f50d-49a3-9bd0-47110fdb068f"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:07:04.631940 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 33466) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:07:04.636658 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-35be3e53-7ef8-49bb-9a7a-4d884f327c9b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1293532538', 'description': 'tempest-secgroup-smoke-1293532538 description', 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:07:04.664061 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-35be3e53-7ef8-49bb-9a7a-4d884f327c9b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:04.669065 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:07:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-32990b0c-aa61-4722-a097-06ae062b6978 x-openstack-request-id: req-32990b0c-aa61-4722-a097-06ae062b6978 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:07:04.669360 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ae7a102d-4793-4384-bc31-07d28018c9df", "tag": "b8dc8fcb-f50d-49a3-9bd0-47110fdb068f", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:07:04.669614 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-32990b0c-aa61-4722-a097-06ae062b6978 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:07:04.670014 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ae7a102d-4793-4384-bc31-07d28018c9df', 'tag': 'b8dc8fcb-f50d-49a3-9bd0-47110fdb068f', 'status': 'completed', 'code': 200} Dec 24 05:07:04.717607 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-0f105aa3-2719-474c-b0dd-b5a15392bd93 None None] Set router a17d8253-42dc-43b3-b8fe-d8352c4bfc8f gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:07:04.736849 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-35be3e53-7ef8-49bb-9a7a-4d884f327c9b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:04.741704 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-35be3e53-7ef8-49bb-9a7a-4d884f327c9b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:04.773205 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-35be3e53-7ef8-49bb-9a7a-4d884f327c9b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:04.773881 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e366c8c-c5d7-4081-8662-792d7318c2e5 req-df1f2051-7420-4148-9c24-90bf00485bee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:04.774724 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-35be3e53-7ef8-49bb-9a7a-4d884f327c9b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.1417003 Dec 24 05:07:04.776207 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1e366c8c-c5d7-4081-8662-792d7318c2e5 req-df1f2051-7420-4148-9c24-90bf00485bee service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=f081e71a66b74c3bb12e1bec9d9a5cd1&device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 1098 time: 0.0482328 Dec 24 05:07:04.776800 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35be3e53-7ef8-49bb-9a7a-4d884f327c9b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Pushing event updated for resources: {'SecurityGroup': ['ID=bc3c93b3-eec1-4f52-a952-c229f892877e,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:07:04.777830 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 33470) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:07:04.782878 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-fd539558-a53d-4e2c-9e6f-6e38b22f4052 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Request body: {'security_group_rule': {'security_group_id': 'bc3c93b3-eec1-4f52-a952-c229f892877e', 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:07:04.879624 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-fd539558-a53d-4e2c-9e6f-6e38b22f4052 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:04.917374 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e366c8c-c5d7-4081-8662-792d7318c2e5 req-60cc305b-bec5-4746-9dc5-69ea1aea4daa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:04.918959 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1e366c8c-c5d7-4081-8662-792d7318c2e5 req-60cc305b-bec5-4746-9dc5-69ea1aea4daa service neutron] 10.222.0.46 "GET /v2.0/networks?id=f6c8eead-66df-4cba-abce-78ee3b037ee2 HTTP/1.1" status: 200 len: 915 time: 0.1314621 Dec 24 05:07:04.984085 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-fd539558-a53d-4e2c-9e6f-6e38b22f4052 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:04.989830 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-fd539558-a53d-4e2c-9e6f-6e38b22f4052 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:05.015548 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd539558-a53d-4e2c-9e6f-6e38b22f4052 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6bd45730-8afc-45a7-884a-415200a211cb,revision_number=0']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:07:05.019708 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1e366c8c-c5d7-4081-8662-792d7318c2e5 req-9ad597c9-e35b-4aa3-a808-9ccf49f24abe service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b8dc8fcb-f50d-49a3-9bd0-47110fdb068f HTTP/1.1" status: 200 len: 998 time: 0.0895171 Dec 24 05:07:05.028035 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-fd539558-a53d-4e2c-9e6f-6e38b22f4052 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:05.029459 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-fd539558-a53d-4e2c-9e6f-6e38b22f4052 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2504363 Dec 24 05:07:05.032352 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 33472) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:07:05.037252 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-3ef00628-d681-475a-9200-2ef33a10234b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Request body: {'security_group_rule': {'security_group_id': 'bc3c93b3-eec1-4f52-a952-c229f892877e', 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:07:05.068094 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-3ef00628-d681-475a-9200-2ef33a10234b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:05.079511 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e366c8c-c5d7-4081-8662-792d7318c2e5 req-6daf386d-cb04-4616-9ab9-d70ff960b9f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:05.081039 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1e366c8c-c5d7-4081-8662-792d7318c2e5 req-6daf386d-cb04-4616-9ab9-d70ff960b9f7 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=11836946-2718-402d-9e36-6ad89714906f HTTP/1.1" status: 200 len: 853 time: 0.0504892 Dec 24 05:07:05.089516 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-0f105aa3-2719-474c-b0dd-b5a15392bd93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'name': 'tempest-TestMinimumBasicScenario-953343402-router', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248'}], 'enable_snat': True}, 'gw_port_id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:01Z', 'updated_at': '2021-12-24T05:06:04Z', 'revision_number': 4, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'gw_port': {'id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:e8:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 488, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:02Z', 'updated_at': '2021-12-24T05:06:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': '17ceaa33-3c33-43ef-a6f5-a82143007f2e', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'floating_ip_address': '172.27.1.21', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'port_id': 'b8dc8fcb-f50d-49a3-9bd0-47110fdb068f', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 566, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2', 'mac_address': 'fa:16:3e:ad:e4:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae7a102d-4793-4384-bc31-07d28018c9df', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:07:02Z', 'updated_at': '2021-12-24T05:07:02Z', 'revision_number': 0, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6dd40189-9984-4e72-8831-3e9d864c65b9', 'name': '', 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'mac_address': 'fa:16:3e:cf:37:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '11836946-2718-402d-9e36-6ad89714906f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:04Z', 'updated_at': '2021-12-24T05:06:09Z', 'revision_number': 5, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'subnets': [{'id': '11836946-2718-402d-9e36-6ad89714906f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:07:05.119362 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f105aa3-2719-474c-b0dd-b5a15392bd93 None None] Checking router: a17d8253-42dc-43b3-b8fe-d8352c4bfc8f for host: dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:07:05.128676 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f105aa3-2719-474c-b0dd-b5a15392bd93 None None] Routers {'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:07:05.129295 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-0f105aa3-2719-474c-b0dd-b5a15392bd93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:06:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:07:05.133631 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e366c8c-c5d7-4081-8662-792d7318c2e5 req-7be11848-edda-400e-82b6-a92a67455a5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:05.134663 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-3ef00628-d681-475a-9200-2ef33a10234b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:05.135088 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1e366c8c-c5d7-4081-8662-792d7318c2e5 req-7be11848-edda-400e-82b6-a92a67455a5e service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=f6c8eead-66df-4cba-abce-78ee3b037ee2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0456247 Dec 24 05:07:05.139847 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-3ef00628-d681-475a-9200-2ef33a10234b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:05.163615 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-3ef00628-d681-475a-9200-2ef33a10234b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:05.168100 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-3ef00628-d681-475a-9200-2ef33a10234b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1344543 Dec 24 05:07:05.169130 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 33474) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:07:05.173711 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-ca19793b-349e-4cc0-973f-27dad6b8e56e tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Request body: {'security_group_rule': {'security_group_id': 'bc3c93b3-eec1-4f52-a952-c229f892877e', 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:07:05.180333 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ef00628-d681-475a-9200-2ef33a10234b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4ee0a1ae-fd94-406e-8da5-e940c28ee887,revision_number=0']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:07:05.213270 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ca19793b-349e-4cc0-973f-27dad6b8e56e tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:05.235107 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1e366c8c-c5d7-4081-8662-792d7318c2e5 req-91d852ef-2ef8-4141-9ded-690d2f968a58 service neutron] 10.222.0.46 "GET /v2.0/networks/f6c8eead-66df-4cba-abce-78ee3b037ee2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0920222 Dec 24 05:07:05.245029 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-0f105aa3-2719-474c-b0dd-b5a15392bd93 None None] Set router a17d8253-42dc-43b3-b8fe-d8352c4bfc8f gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:07:05.318085 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ca19793b-349e-4cc0-973f-27dad6b8e56e tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:05.326341 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ca19793b-349e-4cc0-973f-27dad6b8e56e tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:05.340463 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f548bae8-c85b-4150-ac61-bfd45b432c27 req-aa0919f9-3e10-4464-b57a-373f66149511 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:05.342123 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f548bae8-c85b-4150-ac61-bfd45b432c27 req-aa0919f9-3e10-4464-b57a-373f66149511 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 943 time: 0.0778372 Dec 24 05:07:05.343421 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1e366c8c-c5d7-4081-8662-792d7318c2e5 req-3c8e452c-307d-497d-8d3a-a973d68ca3ed service neutron] 10.222.0.46 "GET /v2.0/networks/f6c8eead-66df-4cba-abce-78ee3b037ee2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0950732 Dec 24 05:07:05.363309 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca19793b-349e-4cc0-973f-27dad6b8e56e tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2cb07c74-0766-4f02-ae7b-5594d21b56a4,revision_number=0']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:07:05.384581 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ca19793b-349e-4cc0-973f-27dad6b8e56e tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:05.386174 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-ca19793b-349e-4cc0-973f-27dad6b8e56e tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2158790 Dec 24 05:07:05.389473 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 33480) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:07:05.394592 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-d0fe53fe-e22b-4eb5-aa8a-7beca407486f tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Request body: {'security_group_rule': {'security_group_id': 'bc3c93b3-eec1-4f52-a952-c229f892877e', 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:07:05.420398 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f548bae8-c85b-4150-ac61-bfd45b432c27 req-8e10a6a8-21d9-4806-b8aa-67c33ce8dfea tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0673089 Dec 24 05:07:05.427022 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d0fe53fe-e22b-4eb5-aa8a-7beca407486f tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:05.486320 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d0fe53fe-e22b-4eb5-aa8a-7beca407486f tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:05.490230 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d0fe53fe-e22b-4eb5-aa8a-7beca407486f tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:05.507039 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0fe53fe-e22b-4eb5-aa8a-7beca407486f tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e70ca40e-faf3-4375-8e86-264fe18e7c56,revision_number=0']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:07:05.518517 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d0fe53fe-e22b-4eb5-aa8a-7beca407486f tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:05.519744 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-d0fe53fe-e22b-4eb5-aa8a-7beca407486f tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1287229 Dec 24 05:07:05.520061 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-0f105aa3-2719-474c-b0dd-b5a15392bd93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'name': 'tempest-TestMinimumBasicScenario-953343402-router', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248'}], 'enable_snat': True}, 'gw_port_id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:01Z', 'updated_at': '2021-12-24T05:06:04Z', 'revision_number': 4, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'gw_port': {'id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:e8:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 488, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:02Z', 'updated_at': '2021-12-24T05:06:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': '17ceaa33-3c33-43ef-a6f5-a82143007f2e', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'floating_ip_address': '172.27.1.21', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'port_id': 'b8dc8fcb-f50d-49a3-9bd0-47110fdb068f', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 566, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2', 'mac_address': 'fa:16:3e:ad:e4:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae7a102d-4793-4384-bc31-07d28018c9df', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:07:02Z', 'updated_at': '2021-12-24T05:07:02Z', 'revision_number': 0, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6dd40189-9984-4e72-8831-3e9d864c65b9', 'name': '', 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'mac_address': 'fa:16:3e:cf:37:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '11836946-2718-402d-9e36-6ad89714906f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:04Z', 'updated_at': '2021-12-24T05:06:09Z', 'revision_number': 5, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'subnets': [{'id': '11836946-2718-402d-9e36-6ad89714906f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:07:05.523018 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 33482) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:07:05.527337 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-45cd2e77-e02c-4a4a-aa41-fea07589fa7a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Request body: {'security_group_rule': {'security_group_id': 'bc3c93b3-eec1-4f52-a952-c229f892877e', 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:07:05.548063 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f105aa3-2719-474c-b0dd-b5a15392bd93 None None] The sync data for ids ['a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'] in dv-cinder-816443-2-iscsi is: [{'id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'name': 'tempest-TestMinimumBasicScenario-953343402-router', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248'}], 'enable_snat': True}, 'gw_port_id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:01Z', 'updated_at': '2021-12-24T05:06:04Z', 'revision_number': 4, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'gw_port': {'id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:e8:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 488, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:02Z', 'updated_at': '2021-12-24T05:06:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': '17ceaa33-3c33-43ef-a6f5-a82143007f2e', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'floating_ip_address': '172.27.1.21', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'port_id': 'b8dc8fcb-f50d-49a3-9bd0-47110fdb068f', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 566, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2', 'mac_address': 'fa:16:3e:ad:e4:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae7a102d-4793-4384-bc31-07d28018c9df', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:07:02Z', 'updated_at': '2021-12-24T05:07:02Z', 'revision_number': 0, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6dd40189-9984-4e72-8831-3e9d864c65b9', 'name': '', 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'mac_address': 'fa:16:3e:cf:37:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '11836946-2718-402d-9e36-6ad89714906f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:04Z', 'updated_at': '2021-12-24T05:06:09Z', 'revision_number': 5, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'subnets': [{'id': '11836946-2718-402d-9e36-6ad89714906f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:07:05.556915 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.securitygroups_db [None req-45cd2e77-e02c-4a4a-aa41-fea07589fa7a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Project f081e71a66b74c3bb12e1bec9d9a5cd1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 24 05:07:05.562289 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-45cd2e77-e02c-4a4a-aa41-fea07589fa7a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:05.621345 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-45cd2e77-e02c-4a4a-aa41-fea07589fa7a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:05.625916 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-45cd2e77-e02c-4a4a-aa41-fea07589fa7a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:05.647504 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45cd2e77-e02c-4a4a-aa41-fea07589fa7a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=db8b8769-48c2-4135-b831-1c25db092155,revision_number=0']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:07:05.651678 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-45cd2e77-e02c-4a4a-aa41-fea07589fa7a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:05.652980 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-45cd2e77-e02c-4a4a-aa41-fea07589fa7a tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1289015 Dec 24 05:07:05.655677 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 33484) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:07:05.659923 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-cf394348-f57f-42cf-a354-ddf09957b8e0 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Request body: {'security_group_rule': {'security_group_id': 'bc3c93b3-eec1-4f52-a952-c229f892877e', 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:07:05.683771 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.securitygroups_db [None req-cf394348-f57f-42cf-a354-ddf09957b8e0 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Project f081e71a66b74c3bb12e1bec9d9a5cd1 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 24 05:07:05.689533 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-cf394348-f57f-42cf-a354-ddf09957b8e0 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:05.750863 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8e114f0-1ace-4eef-b075-b300ec7c1b55 None None] New status for floating IP 17ceaa33-3c33-43ef-a6f5-a82143007f2e: ACTIVE {{(pid=102479) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 24 05:07:05.752089 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-cf394348-f57f-42cf-a354-ddf09957b8e0 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:05.759826 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-cf394348-f57f-42cf-a354-ddf09957b8e0 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:05.779431 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf394348-f57f-42cf-a354-ddf09957b8e0 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=24136a42-df68-47c6-979d-cb6563ac8d39,revision_number=0']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:07:05.785905 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-cf394348-f57f-42cf-a354-ddf09957b8e0 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:05.786708 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-cf394348-f57f-42cf-a354-ddf09957b8e0 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1300955 Dec 24 05:07:05.881646 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9a1012df-1b91-4b3b-b31c-38d41f69bd77 req-8585c0e4-60e9-4ec9-ba71-fe090c4b865f tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1293532538&fields=id&tenant_id=f081e71a66b74c3bb12e1bec9d9a5cd1 HTTP/1.1" status: 200 len: 267 time: 0.0466392 Dec 24 05:07:05.938026 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a1012df-1b91-4b3b-b31c-38d41f69bd77 req-29b7456e-f9d7-4da0-afca-bb81be50929c tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:05.939400 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9a1012df-1b91-4b3b-b31c-38d41f69bd77 req-29b7456e-f9d7-4da0-afca-bb81be50929c tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 945 time: 0.0514150 Dec 24 05:07:05.951684 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-9a1012df-1b91-4b3b-b31c-38d41f69bd77 req-ae0f4ded-09a1-4464-a302-6201b862e933 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Request body: {'port': {'security_groups': ['0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52', 'bc3c93b3-eec1-4f52-a952-c229f892877e']}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:07:06.023501 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-9a1012df-1b91-4b3b-b31c-38d41f69bd77 req-ae0f4ded-09a1-4464-a302-6201b862e933 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:06.215805 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-9a1012df-1b91-4b3b-b31c-38d41f69bd77 req-ae0f4ded-09a1-4464-a302-6201b862e933 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] For port b8dc8fcb-f50d-49a3-9bd0-47110fdb068f, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=b8dc8fcb-f50d-49a3-9bd0-47110fdb068f,segment=NetworkSegment(2d8c6ac9-499a-46a9-971d-99edaae74aeb),segment_id=2d8c6ac9-499a-46a9-971d-99edaae74aeb)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:07:06.246790 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-9a1012df-1b91-4b3b-b31c-38d41f69bd77 req-ae0f4ded-09a1-4464-a302-6201b862e933 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:06.253560 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-9a1012df-1b91-4b3b-b31c-38d41f69bd77 req-ae0f4ded-09a1-4464-a302-6201b862e933 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:06.286768 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['b8dc8fcb-f50d-49a3-9bd0-47110fdb068f'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:07:06.301668 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a1012df-1b91-4b3b-b31c-38d41f69bd77 req-ae0f4ded-09a1-4464-a302-6201b862e933 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:06.302519 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-9a1012df-1b91-4b3b-b31c-38d41f69bd77 req-ae0f4ded-09a1-4464-a302-6201b862e933 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:06.305066 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9a1012df-1b91-4b3b-b31c-38d41f69bd77 req-ae0f4ded-09a1-4464-a302-6201b862e933 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "PUT /v2.0/ports/b8dc8fcb-f50d-49a3-9bd0-47110fdb068f HTTP/1.1" status: 200 len: 981 time: 0.3571887 Dec 24 05:07:06.334893 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae0f4ded-09a1-4464-a302-6201b862e933 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Pushing event updated for resources: {'Port': ['ID=b8dc8fcb-f50d-49a3-9bd0-47110fdb068f,revision_number=6']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:07:06.440759 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c43dd5c-e95a-4af5-b146-bf5f8242c996 req-3bd485dd-7af7-4d7b-a8d8-90f2120fab5c tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:06.443066 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5c43dd5c-e95a-4af5-b146-bf5f8242c996 req-3bd485dd-7af7-4d7b-a8d8-90f2120fab5c tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 984 time: 0.0640671 Dec 24 05:07:06.481022 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['b8dc8fcb-f50d-49a3-9bd0-47110fdb068f'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:07:06.515541 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5c43dd5c-e95a-4af5-b146-bf5f8242c996 req-156dd4de-cb3b-4a48-8ac2-569fa0cbb3ff tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=bc3c93b3-eec1-4f52-a952-c229f892877e&id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0647855 Dec 24 05:07:06.597110 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-a5760a2c-b60c-409a-b8c0-ee09436430e1 None None] Provisioning complete for port b8dc8fcb-f50d-49a3-9bd0-47110fdb068f triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:07:06.597392 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-a5760a2c-b60c-409a-b8c0-ee09436430e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:06.611397 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e18ec0e8-6e1a-4642-9569-58634453b75d req-31aaf986-29a2-41bf-8b90-477c36229962 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:06.612944 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e18ec0e8-6e1a-4642-9569-58634453b75d req-31aaf986-29a2-41bf-8b90-477c36229962 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 943 time: 0.0497713 Dec 24 05:07:06.666073 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e18ec0e8-6e1a-4642-9569-58634453b75d req-7243717a-70c1-4acd-b788-cea1426f9b0e tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469897 Dec 24 05:07:06.670803 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ae7a102d-4793-4384-bc31-07d28018c9df', 'tag': 'b8dc8fcb-f50d-49a3-9bd0-47110fdb068f'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:07:06.673242 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a6b96ce1-3124-4de7-b94c-6fdd5575775a" -d '{"events": [{"name": "network-changed", "server_uuid": "ae7a102d-4793-4384-bc31-07d28018c9df", "tag": "b8dc8fcb-f50d-49a3-9bd0-47110fdb068f"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:07:06.709640 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:07:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0f38a084-c560-4cb5-a776-b1886302f06f x-openstack-request-id: req-0f38a084-c560-4cb5-a776-b1886302f06f {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:07:06.709927 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ae7a102d-4793-4384-bc31-07d28018c9df", "tag": "b8dc8fcb-f50d-49a3-9bd0-47110fdb068f", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:07:06.710180 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-0f38a084-c560-4cb5-a776-b1886302f06f {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:07:06.711308 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ae7a102d-4793-4384-bc31-07d28018c9df', 'tag': 'b8dc8fcb-f50d-49a3-9bd0-47110fdb068f', 'status': 'completed', 'code': 200} Dec 24 05:07:06.803454 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6b96ce1-3124-4de7-b94c-6fdd5575775a req-59c009b3-f8aa-4e9e-ac9b-a2f68473af8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:06.806091 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a6b96ce1-3124-4de7-b94c-6fdd5575775a req-59c009b3-f8aa-4e9e-ac9b-a2f68473af8d service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=f081e71a66b74c3bb12e1bec9d9a5cd1&device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 1137 time: 0.0440316 Dec 24 05:07:06.901397 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6b96ce1-3124-4de7-b94c-6fdd5575775a req-aa6d47b2-cfde-4298-9e8f-e4dd8b5ab4aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:06.902864 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a6b96ce1-3124-4de7-b94c-6fdd5575775a req-aa6d47b2-cfde-4298-9e8f-e4dd8b5ab4aa service neutron] 10.222.0.46 "GET /v2.0/networks?id=f6c8eead-66df-4cba-abce-78ee3b037ee2 HTTP/1.1" status: 200 len: 915 time: 0.0883412 Dec 24 05:07:06.975169 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a6b96ce1-3124-4de7-b94c-6fdd5575775a req-752a99f7-ad89-4222-ac00-6ee9c1adb5e6 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b8dc8fcb-f50d-49a3-9bd0-47110fdb068f HTTP/1.1" status: 200 len: 1000 time: 0.0636322 Dec 24 05:07:07.027208 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6b96ce1-3124-4de7-b94c-6fdd5575775a req-5bbdcade-792b-49a2-8ef5-b639f75f1950 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:07.028717 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a6b96ce1-3124-4de7-b94c-6fdd5575775a req-5bbdcade-792b-49a2-8ef5-b639f75f1950 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=11836946-2718-402d-9e36-6ad89714906f HTTP/1.1" status: 200 len: 853 time: 0.0440891 Dec 24 05:07:07.075228 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6b96ce1-3124-4de7-b94c-6fdd5575775a req-da129f69-9982-4845-8118-96d8732bf46c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:07.076697 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a6b96ce1-3124-4de7-b94c-6fdd5575775a req-da129f69-9982-4845-8118-96d8732bf46c service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=f6c8eead-66df-4cba-abce-78ee3b037ee2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0400348 Dec 24 05:07:07.171538 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a6b96ce1-3124-4de7-b94c-6fdd5575775a req-00eee07e-e0fb-448c-85e7-bb2b9a0bf90d service neutron] 10.222.0.46 "GET /v2.0/networks/f6c8eead-66df-4cba-abce-78ee3b037ee2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0853164 Dec 24 05:07:07.259331 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a6b96ce1-3124-4de7-b94c-6fdd5575775a req-1dccfa70-9233-4728-8c9c-62921c0b1952 service neutron] 10.222.0.46 "GET /v2.0/networks/f6c8eead-66df-4cba-abce-78ee3b037ee2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0795939 Dec 24 05:07:07.790399 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77c01fec-9650-4d0d-9856-699d7626a140 req-a9a4253c-3c6f-4f0e-abd7-af83eae35ef1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:07.791829 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-77c01fec-9650-4d0d-9856-699d7626a140 req-a9a4253c-3c6f-4f0e-abd7-af83eae35ef1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 943 time: 0.0539393 Dec 24 05:07:07.843346 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-77c01fec-9650-4d0d-9856-699d7626a140 req-d0bfae8d-14e7-4449-a414-874f59b52730 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430033 Dec 24 05:07:08.974382 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-713a1fb5-33d3-4755-ad3c-2ea95747334a req-e18a86de-2643-479e-8803-9369a366190a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:08.975834 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-713a1fb5-33d3-4755-ad3c-2ea95747334a req-e18a86de-2643-479e-8803-9369a366190a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 943 time: 0.0536835 Dec 24 05:07:09.025902 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-713a1fb5-33d3-4755-ad3c-2ea95747334a req-0bf876ee-f024-4581-8c73-181ade5ae2e1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439553 Dec 24 05:07:10.134927 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device f25ccd41-53b3-4bb9-84e1-824627c3e8e6 details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 05:07:10.165081 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-878a24af-88bc-4be3-874f-ea4383ad1f81 req-a7f8a8a0-f0ff-4452-8d88-e2e08b087010 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:10.166700 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-878a24af-88bc-4be3-874f-ea4383ad1f81 req-a7f8a8a0-f0ff-4452-8d88-e2e08b087010 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 943 time: 0.0602021 Dec 24 05:07:10.215984 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-878a24af-88bc-4be3-874f-ea4383ad1f81 req-6cf3cb4e-d9df-4f12-98d2-6bca0ac38c1b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432651 Dec 24 05:07:10.229848 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port f25ccd41-53b3-4bb9-84e1-824627c3e8e6, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=f25ccd41-53b3-4bb9-84e1-824627c3e8e6,segment=NetworkSegment(cb920e21-208e-474e-84a0-615ea3280b8a),segment_id=cb920e21-208e-474e-84a0-615ea3280b8a)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:07:10.240640 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': 'f25ccd41-53b3-4bb9-84e1-824627c3e8e6', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'port_id': 'f25ccd41-53b3-4bb9-84e1-824627c3e8e6', 'mac_address': 'fa:16:3e:ea:7b:34', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 122, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 05:07:10.281292 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:10.294647 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f25ccd41-53b3-4bb9-84e1-824627c3e8e6 {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:07:10.314280 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port f25ccd41-53b3-4bb9-84e1-824627c3e8e6, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=f25ccd41-53b3-4bb9-84e1-824627c3e8e6,segment=NetworkSegment(cb920e21-208e-474e-84a0-615ea3280b8a),segment_id=cb920e21-208e-474e-84a0-615ea3280b8a)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:07:10.320137 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:10.373123 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=f25ccd41-53b3-4bb9-84e1-824627c3e8e6,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:07:10.770762 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['f25ccd41-53b3-4bb9-84e1-824627c3e8e6'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:07:11.338914 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d91354a-2095-426f-af00-1cf59e63d021 req-b618e222-59c7-441a-a612-cf988b73df85 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:11.340381 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3d91354a-2095-426f-af00-1cf59e63d021 req-b618e222-59c7-441a-a612-cf988b73df85 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 944 time: 0.0516012 Dec 24 05:07:11.395708 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3d91354a-2095-426f-af00-1cf59e63d021 req-53a29310-31b9-45a9-8982-e6fcbb13a43b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0492046 Dec 24 05:07:12.147437 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device f25ccd41-53b3-4bb9-84e1-824627c3e8e6 up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:07:12.201387 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning for port f25ccd41-53b3-4bb9-84e1-824627c3e8e6 completed by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 24 05:07:12.205617 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port f25ccd41-53b3-4bb9-84e1-824627c3e8e6 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:07:12.205993 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:12.285436 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:12.312623 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd51afc95-dcbd-4ab4-9e4f-951d2dd7af88', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f25ccd41-53b3-4bb9-84e1-824627c3e8e6'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:07:12.317172 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c795c3b9-b160-4e73-860a-69bb9f2790af" -d '{"events": [{"server_uuid": "d51afc95-dcbd-4ab4-9e4f-951d2dd7af88", "name": "network-vif-plugged", "status": "completed", "tag": "f25ccd41-53b3-4bb9-84e1-824627c3e8e6"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:07:12.331279 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port f25ccd41-53b3-4bb9-84e1-824627c3e8e6, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=f25ccd41-53b3-4bb9-84e1-824627c3e8e6,segment=NetworkSegment(cb920e21-208e-474e-84a0-615ea3280b8a),segment_id=cb920e21-208e-474e-84a0-615ea3280b8a)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:07:12.338080 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:12.362575 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:07:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1dd6f4c5-bda7-4b37-ab03-2f0adac98815 x-openstack-request-id: req-1dd6f4c5-bda7-4b37-ab03-2f0adac98815 {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:07:12.362862 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d51afc95-dcbd-4ab4-9e4f-951d2dd7af88", "name": "network-vif-plugged", "status": "completed", "tag": "f25ccd41-53b3-4bb9-84e1-824627c3e8e6", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:07:12.363111 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-1dd6f4c5-bda7-4b37-ab03-2f0adac98815 {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:07:12.363503 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd51afc95-dcbd-4ab4-9e4f-951d2dd7af88', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f25ccd41-53b3-4bb9-84e1-824627c3e8e6', 'code': 200} Dec 24 05:07:12.388541 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=f25ccd41-53b3-4bb9-84e1-824627c3e8e6,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:07:12.519818 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b706f69b-6349-478c-8e21-bb713811231d req-53218b6a-f5d5-48e6-a72a-7623c67b626c tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:12.521362 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b706f69b-6349-478c-8e21-bb713811231d req-53218b6a-f5d5-48e6-a72a-7623c67b626c tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 945 time: 0.0557501 Dec 24 05:07:12.582789 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b706f69b-6349-478c-8e21-bb713811231d req-9bac524e-adcb-4783-88e2-2c44e1d3c675 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0540438 Dec 24 05:07:12.612764 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-477e7c0a-b130-431c-8cc5-7eb11213c4f1 req-09dbab97-e627-4eee-b210-584f7417fc8c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:12.614234 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-477e7c0a-b130-431c-8cc5-7eb11213c4f1 req-09dbab97-e627-4eee-b210-584f7417fc8c service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 1098 time: 0.0442364 Dec 24 05:07:12.666452 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-477e7c0a-b130-431c-8cc5-7eb11213c4f1 req-72c1ef63-83d7-48cc-875e-bbb8aca6bcbb service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407796 Dec 24 05:07:13.718171 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2635a05d-cc75-4b37-a0f4-37d1fd668940 req-49c90484-c206-4730-81ea-bae7412c9967 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:13.719641 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2635a05d-cc75-4b37-a0f4-37d1fd668940 req-49c90484-c206-4730-81ea-bae7412c9967 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 945 time: 0.0571461 Dec 24 05:07:13.778922 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2635a05d-cc75-4b37-a0f4-37d1fd668940 req-e09a4421-12f3-47f7-99e5-f07e581d14a0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0502675 Dec 24 05:07:14.903733 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aebeaec-0631-44e7-b9e9-864edf19cbc0 req-a779257b-2e10-4052-9205-8063affb3bf4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:14.905479 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8aebeaec-0631-44e7-b9e9-864edf19cbc0 req-a779257b-2e10-4052-9205-8063affb3bf4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 945 time: 0.0502837 Dec 24 05:07:14.957145 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8aebeaec-0631-44e7-b9e9-864edf19cbc0 req-6a1b19d2-0594-4a36-8733-9068202b932c tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456133 Dec 24 05:07:15.093308 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58267493-0de5-4246-ae41-4c6e859a99b8 req-71d71948-ab31-4650-9d51-955951be543d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:15.094655 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-58267493-0de5-4246-ae41-4c6e859a99b8 req-71d71948-ab31-4650-9d51-955951be543d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 945 time: 0.0533969 Dec 24 05:07:15.148993 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-58267493-0de5-4246-ae41-4c6e859a99b8 req-c169979c-2cd9-4fa9-b93b-fa291a2c6d8a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454247 Dec 24 05:07:15.177268 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 33532) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:07:15.263881 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b4944e8-ab5a-4edb-8e74-4bea431d439a tempest-TestVolumeBootPattern-1420950562 tempest-TestVolumeBootPattern-1420950562-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:15.265663 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-7b4944e8-ab5a-4edb-8e74-4bea431d439a tempest-TestVolumeBootPattern-1420950562 tempest-TestVolumeBootPattern-1420950562-project-admin] 10.222.0.43 "GET /v2.0/ports?device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 1093 time: 0.0867805 Dec 24 05:07:15.268336 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 33536) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:07:15.272462 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-407b83b9-40a8-4886-994f-a053cd68f315 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Request body: {'floatingip': {'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'port_id': 'f25ccd41-53b3-4bb9-84e1-824627c3e8e6', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'fixed_ip_address': '172.20.0.6'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:07:15.298822 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-407b83b9-40a8-4886-994f-a053cd68f315 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for floatingip, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:15.402142 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-407b83b9-40a8-4886-994f-a053cd68f315 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:15.517961 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [None req-407b83b9-40a8-4886-994f-a053cd68f315 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Allocated IP 172.27.1.207 (9b4e4b31-551f-45a9-b26a-cb44ee20a17d/f277b899-8779-420e-8a8d-bfcd5eb7f012/baf7ca44-439e-4b17-91b8-d3a9fe7a64b1) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:07:15.626843 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-407b83b9-40a8-4886-994f-a053cd68f315 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:15.664168 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-407b83b9-40a8-4886-994f-a053cd68f315 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:15.702765 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-407b83b9-40a8-4886-994f-a053cd68f315 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:07:15.705742 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-407b83b9-40a8-4886-994f-a053cd68f315 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:07:15.709221 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [None req-407b83b9-40a8-4886-994f-a053cd68f315 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:07:15.714818 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-407b83b9-40a8-4886-994f-a053cd68f315 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Pushing event updated for resources: {'Port': ['ID=baf7ca44-439e-4b17-91b8-d3a9fe7a64b1,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:07:16.365242 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-407b83b9-40a8-4886-994f-a053cd68f315 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:16.436156 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-407b83b9-40a8-4886-994f-a053cd68f315 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:16.586644 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-407b83b9-40a8-4886-994f-a053cd68f315 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:16.593362 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-407b83b9-40a8-4886-994f-a053cd68f315 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:16.663737 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-407b83b9-40a8-4886-994f-a053cd68f315 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Pushing event updated for resources: {'Port': ['ID=baf7ca44-439e-4b17-91b8-d3a9fe7a64b1,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:07:16.675721 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-407b83b9-40a8-4886-994f-a053cd68f315 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-545804'] for floatingip, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:16.776310 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.l3_db [None req-407b83b9-40a8-4886-994f-a053cd68f315 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Floating IP 6fbeb9ef-353a-4f33-9ebc-492b12a0ebd9 associated. External IP: 172.27.1.207, port: f25ccd41-53b3-4bb9-84e1-824627c3e8e6. Dec 24 05:07:17.005539 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-407b83b9-40a8-4886-994f-a053cd68f315 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Router 9df11fe3-ba73-4793-a582-0e00f27a374d has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102476) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:07:17.127847 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-407b83b9-40a8-4886-994f-a053cd68f315 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:07:17.138297 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bb42c6e-178f-4aed-b7ae-76e081776412 None None] Sync routers for ids ['9df11fe3-ba73-4793-a582-0e00f27a374d'] in dv-cinder-816443-2-iscsi {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:07:17.148488 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-407b83b9-40a8-4886-994f-a053cd68f315 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for floatingip, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:17.149213 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bb42c6e-178f-4aed-b7ae-76e081776412 None None] Routers {'9df11fe3-ba73-4793-a582-0e00f27a374d'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:07:17.149837 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-7bb42c6e-178f-4aed-b7ae-76e081776412 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:06:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['9df11fe3-ba73-4793-a582-0e00f27a374d'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:07:17.178888 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-407b83b9-40a8-4886-994f-a053cd68f315 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.9095271 Dec 24 05:07:17.179522 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd51afc95-dcbd-4ab4-9e4f-951d2dd7af88', 'tag': 'f25ccd41-53b3-4bb9-84e1-824627c3e8e6'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:07:17.181974 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ee0a007c-33d0-47a5-a8ff-3f2a2bb7a2d8" -d '{"events": [{"name": "network-changed", "server_uuid": "d51afc95-dcbd-4ab4-9e4f-951d2dd7af88", "tag": "f25ccd41-53b3-4bb9-84e1-824627c3e8e6"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:07:17.221270 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:07:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-067887bb-1f26-4dc3-9ca3-f6386e275329 x-openstack-request-id: req-067887bb-1f26-4dc3-9ca3-f6386e275329 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:07:17.221554 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d51afc95-dcbd-4ab4-9e4f-951d2dd7af88", "tag": "f25ccd41-53b3-4bb9-84e1-824627c3e8e6", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:07:17.221807 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-067887bb-1f26-4dc3-9ca3-f6386e275329 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:07:17.222204 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd51afc95-dcbd-4ab4-9e4f-951d2dd7af88', 'tag': 'f25ccd41-53b3-4bb9-84e1-824627c3e8e6', 'status': 'completed', 'code': 200} Dec 24 05:07:17.259402 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-7bb42c6e-178f-4aed-b7ae-76e081776412 None None] Set router 9df11fe3-ba73-4793-a582-0e00f27a374d gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:07:17.321533 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee0a007c-33d0-47a5-a8ff-3f2a2bb7a2d8 req-fea7c49d-7cfc-4ce3-817f-2b0a0e361485 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:17.323200 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ee0a007c-33d0-47a5-a8ff-3f2a2bb7a2d8 req-fea7c49d-7cfc-4ce3-817f-2b0a0e361485 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=8b1a80c6322a493ba10c69a77168b46f&device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 1098 time: 0.0502858 Dec 24 05:07:17.416213 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee0a007c-33d0-47a5-a8ff-3f2a2bb7a2d8 req-2d780d6f-edf9-4254-8727-01747423d60b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:17.417844 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ee0a007c-33d0-47a5-a8ff-3f2a2bb7a2d8 req-2d780d6f-edf9-4254-8727-01747423d60b service neutron] 10.222.0.46 "GET /v2.0/networks?id=df2331c3-0dd0-460e-980f-1e2409baa35e HTTP/1.1" status: 200 len: 911 time: 0.0859182 Dec 24 05:07:17.486437 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-7bb42c6e-178f-4aed-b7ae-76e081776412 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': '6fbeb9ef-353a-4f33-9ebc-492b12a0ebd9', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'floating_ip_address': '172.27.1.207', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'port_id': 'f25ccd41-53b3-4bb9-84e1-824627c3e8e6', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 577, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'mac_address': 'fa:16:3e:ea:7b:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd51afc95-dcbd-4ab4-9e4f-951d2dd7af88', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:07:15Z', 'updated_at': '2021-12-24T05:07:15Z', 'revision_number': 0, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '826094e8-3c74-4e96-9507-84128f7209f1', 'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'mac_address': 'fa:16:3e:b3:73:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:21Z', 'updated_at': '2021-12-24T05:06:27Z', 'revision_number': 5, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'subnets': [{'id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:07:17.488180 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ee0a007c-33d0-47a5-a8ff-3f2a2bb7a2d8 req-e894b363-240b-4d3c-ba5b-b923066f0b9a service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=f25ccd41-53b3-4bb9-84e1-824627c3e8e6 HTTP/1.1" status: 200 len: 999 time: 0.0614736 Dec 24 05:07:17.512086 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bb42c6e-178f-4aed-b7ae-76e081776412 None None] Checking router: 9df11fe3-ba73-4793-a582-0e00f27a374d for host: dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:07:17.520447 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bb42c6e-178f-4aed-b7ae-76e081776412 None None] Routers {'9df11fe3-ba73-4793-a582-0e00f27a374d'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:07:17.521085 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-7bb42c6e-178f-4aed-b7ae-76e081776412 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:06:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['9df11fe3-ba73-4793-a582-0e00f27a374d'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:07:17.537526 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee0a007c-33d0-47a5-a8ff-3f2a2bb7a2d8 req-c51c7aa0-9a67-439f-8986-e768b647287a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:17.538962 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ee0a007c-33d0-47a5-a8ff-3f2a2bb7a2d8 req-c51c7aa0-9a67-439f-8986-e768b647287a service neutron] 10.222.0.46 "GET /v2.0/subnets?id=9df81c69-0712-4247-ad21-3b3a089ce4b5 HTTP/1.1" status: 200 len: 849 time: 0.0424438 Dec 24 05:07:17.586278 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee0a007c-33d0-47a5-a8ff-3f2a2bb7a2d8 req-499c1ea2-7aca-414c-af1e-f3edfb8ad1e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:17.587851 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ee0a007c-33d0-47a5-a8ff-3f2a2bb7a2d8 req-499c1ea2-7aca-414c-af1e-f3edfb8ad1e4 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=df2331c3-0dd0-460e-980f-1e2409baa35e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0405636 Dec 24 05:07:17.626169 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-7bb42c6e-178f-4aed-b7ae-76e081776412 None None] Set router 9df11fe3-ba73-4793-a582-0e00f27a374d gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:07:17.691614 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ee0a007c-33d0-47a5-a8ff-3f2a2bb7a2d8 req-6f15049e-5d32-4331-9f51-c18bb48919fa service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0869563 Dec 24 05:07:17.787378 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ee0a007c-33d0-47a5-a8ff-3f2a2bb7a2d8 req-5c15c213-d21f-43f8-a0a7-9f1fca9265d3 service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0876994 Dec 24 05:07:17.971741 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-7bb42c6e-178f-4aed-b7ae-76e081776412 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': '6fbeb9ef-353a-4f33-9ebc-492b12a0ebd9', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'floating_ip_address': '172.27.1.207', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'port_id': 'f25ccd41-53b3-4bb9-84e1-824627c3e8e6', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 577, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'mac_address': 'fa:16:3e:ea:7b:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd51afc95-dcbd-4ab4-9e4f-951d2dd7af88', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:07:15Z', 'updated_at': '2021-12-24T05:07:15Z', 'revision_number': 0, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '826094e8-3c74-4e96-9507-84128f7209f1', 'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'mac_address': 'fa:16:3e:b3:73:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:21Z', 'updated_at': '2021-12-24T05:06:27Z', 'revision_number': 5, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'subnets': [{'id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:07:17.997354 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bb42c6e-178f-4aed-b7ae-76e081776412 None None] The sync data for ids ['9df11fe3-ba73-4793-a582-0e00f27a374d'] in dv-cinder-816443-2-iscsi is: [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': '6fbeb9ef-353a-4f33-9ebc-492b12a0ebd9', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'floating_ip_address': '172.27.1.207', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'port_id': 'f25ccd41-53b3-4bb9-84e1-824627c3e8e6', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 577, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'mac_address': 'fa:16:3e:ea:7b:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd51afc95-dcbd-4ab4-9e4f-951d2dd7af88', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:07:15Z', 'updated_at': '2021-12-24T05:07:15Z', 'revision_number': 0, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '826094e8-3c74-4e96-9507-84128f7209f1', 'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'mac_address': 'fa:16:3e:b3:73:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:21Z', 'updated_at': '2021-12-24T05:06:27Z', 'revision_number': 5, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'subnets': [{'id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:07:18.185311 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66196a70-d75e-4373-b112-402cd77f0d75 None None] New status for floating IP 6fbeb9ef-353a-4f33-9ebc-492b12a0ebd9: ACTIVE {{(pid=102479) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 24 05:07:20.431534 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:23.208627 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-a61fab1b-f20a-4d9e-abbf-9dade158e9d5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:25.243367 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-db8eee47-93f7-42ff-b557-3f26749a1ee0 req-e142e904-c147-48dd-bf38-2cf92d6f916e service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0420837 Dec 24 05:07:25.263464 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-ee86d0a5-0754-4ba0-b63e-948d834480e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:25.365638 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db8eee47-93f7-42ff-b557-3f26749a1ee0 req-c305b553-472f-4e7b-a1ec-c2697e18b1ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:25.367115 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-db8eee47-93f7-42ff-b557-3f26749a1ee0 req-c305b553-472f-4e7b-a1ec-c2697e18b1ee service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=f081e71a66b74c3bb12e1bec9d9a5cd1&device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 1137 time: 0.0472863 Dec 24 05:07:25.481973 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db8eee47-93f7-42ff-b557-3f26749a1ee0 req-4c39c76d-f18a-4398-a077-5b608d612658 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:25.483502 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-db8eee47-93f7-42ff-b557-3f26749a1ee0 req-4c39c76d-f18a-4398-a077-5b608d612658 service neutron] 10.222.0.46 "GET /v2.0/networks?id=f6c8eead-66df-4cba-abce-78ee3b037ee2 HTTP/1.1" status: 200 len: 915 time: 0.0950751 Dec 24 05:07:25.548897 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-db8eee47-93f7-42ff-b557-3f26749a1ee0 req-e38f1c27-bfa6-4d52-9e75-9eabd25b070e service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b8dc8fcb-f50d-49a3-9bd0-47110fdb068f HTTP/1.1" status: 200 len: 1000 time: 0.0575776 Dec 24 05:07:25.599016 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db8eee47-93f7-42ff-b557-3f26749a1ee0 req-676334f4-807e-49a9-8ffc-302e61045977 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:25.600557 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-db8eee47-93f7-42ff-b557-3f26749a1ee0 req-676334f4-807e-49a9-8ffc-302e61045977 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=11836946-2718-402d-9e36-6ad89714906f HTTP/1.1" status: 200 len: 853 time: 0.0449035 Dec 24 05:07:25.659863 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db8eee47-93f7-42ff-b557-3f26749a1ee0 req-b626ee9d-6ece-4425-accd-94545f195c1c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:07:25.661411 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-db8eee47-93f7-42ff-b557-3f26749a1ee0 req-b626ee9d-6ece-4425-accd-94545f195c1c service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=f6c8eead-66df-4cba-abce-78ee3b037ee2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0530922 Dec 24 05:07:25.754404 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-db8eee47-93f7-42ff-b557-3f26749a1ee0 req-f4376475-582d-4cba-9514-a55528e8a223 service neutron] 10.222.0.46 "GET /v2.0/networks/f6c8eead-66df-4cba-abce-78ee3b037ee2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0846500 Dec 24 05:07:25.850748 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-db8eee47-93f7-42ff-b557-3f26749a1ee0 req-a7ad244e-d2d5-42c9-b121-10b4ee745992 service neutron] 10.222.0.46 "GET /v2.0/networks/f6c8eead-66df-4cba-abce-78ee3b037ee2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0880530 Dec 24 05:07:26.491518 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:27.929168 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:28.422556 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:07:28.584978 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:50.423744 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:53.204941 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-a14805cf-377e-4304-a173-3795a78787ab None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:55.280614 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-f4a3be3a-6c5c-4960-b29e-d0eb765cb112 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:56.501104 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:57.940149 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:07:58.582985 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:08:05.426589 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:08:18.169845 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0983b06e-d54c-47f0-abfe-9a6a9c75d6aa req-13e9d397-0133-49d7-b619-75188d3935d9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:18.171310 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0983b06e-d54c-47f0-abfe-9a6a9c75d6aa req-13e9d397-0133-49d7-b619-75188d3935d9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 984 time: 0.0746925 Dec 24 05:08:18.196002 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff464bc-9fe4-45d7-9fe4-a72297f0b38c req-7b9f784a-812c-4e10-a4ac-55423b73d7e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:18.197443 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9ff464bc-9fe4-45d7-9fe4-a72297f0b38c req-7b9f784a-812c-4e10-a4ac-55423b73d7e4 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=f081e71a66b74c3bb12e1bec9d9a5cd1&device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 1137 time: 0.0648577 Dec 24 05:08:18.264600 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0983b06e-d54c-47f0-abfe-9a6a9c75d6aa req-8c4ef909-4aae-4889-b884-6d11e7bdf131 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=bc3c93b3-eec1-4f52-a952-c229f892877e&id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0863638 Dec 24 05:08:18.316694 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff464bc-9fe4-45d7-9fe4-a72297f0b38c req-7772019d-1f3e-4de7-8cc2-1267fc5c2b81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:18.318737 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9ff464bc-9fe4-45d7-9fe4-a72297f0b38c req-7772019d-1f3e-4de7-8cc2-1267fc5c2b81 service neutron] 10.222.0.46 "GET /v2.0/networks?id=f6c8eead-66df-4cba-abce-78ee3b037ee2 HTTP/1.1" status: 200 len: 915 time: 0.1108632 Dec 24 05:08:18.388471 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9ff464bc-9fe4-45d7-9fe4-a72297f0b38c req-19d16388-eab4-4ef0-bbea-8ca71dbc19aa service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b8dc8fcb-f50d-49a3-9bd0-47110fdb068f HTTP/1.1" status: 200 len: 1000 time: 0.0611784 Dec 24 05:08:18.437289 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff464bc-9fe4-45d7-9fe4-a72297f0b38c req-73e8448f-9dd7-4858-8638-cdb6138bb7e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:18.438831 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9ff464bc-9fe4-45d7-9fe4-a72297f0b38c req-73e8448f-9dd7-4858-8638-cdb6138bb7e5 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=11836946-2718-402d-9e36-6ad89714906f HTTP/1.1" status: 200 len: 853 time: 0.0421381 Dec 24 05:08:18.484832 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff464bc-9fe4-45d7-9fe4-a72297f0b38c req-7022b89c-dd6c-41cf-8c9a-7ea331e6690b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:18.486240 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9ff464bc-9fe4-45d7-9fe4-a72297f0b38c req-7022b89c-dd6c-41cf-8c9a-7ea331e6690b service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=f6c8eead-66df-4cba-abce-78ee3b037ee2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0401540 Dec 24 05:08:18.579797 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9ff464bc-9fe4-45d7-9fe4-a72297f0b38c req-4973cee0-516a-44e3-9636-df1ba62d2a0f service neutron] 10.222.0.46 "GET /v2.0/networks/f6c8eead-66df-4cba-abce-78ee3b037ee2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0851324 Dec 24 05:08:18.671712 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9ff464bc-9fe4-45d7-9fe4-a72297f0b38c req-5d41cc1f-4a9e-4b00-9994-ddaded044ea9 service neutron] 10.222.0.46 "GET /v2.0/networks/f6c8eead-66df-4cba-abce-78ee3b037ee2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0825591 Dec 24 05:08:19.391132 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f77780c-4ddc-455c-a335-d2acd043d6f7 req-b342f73c-207b-45a8-ad1e-df13820f6173 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:19.392555 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6f77780c-4ddc-455c-a335-d2acd043d6f7 req-b342f73c-207b-45a8-ad1e-df13820f6173 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 984 time: 0.0536752 Dec 24 05:08:19.452726 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6f77780c-4ddc-455c-a335-d2acd043d6f7 req-2795c009-f84f-4c9b-8609-358b31aa03a1 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=bc3c93b3-eec1-4f52-a952-c229f892877e&id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0536578 Dec 24 05:08:20.444683 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:08:20.581558 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64b4885a-c8c5-4144-b105-ff381a9bb1ed req-d19d98c8-340d-42c7-9a5b-d3d7aa50ef14 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:20.582941 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-64b4885a-c8c5-4144-b105-ff381a9bb1ed req-d19d98c8-340d-42c7-9a5b-d3d7aa50ef14 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 984 time: 0.0577669 Dec 24 05:08:20.645086 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-64b4885a-c8c5-4144-b105-ff381a9bb1ed req-89b474d4-5bff-41a6-ac35-796332a8e6af tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=bc3c93b3-eec1-4f52-a952-c229f892877e&id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0544457 Dec 24 05:08:21.777772 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee29af08-fe70-4ab0-a918-78dba7fb7983 req-2947772e-2b1b-4e39-be0f-24d6fa76c7f6 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:21.779539 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ee29af08-fe70-4ab0-a918-78dba7fb7983 req-2947772e-2b1b-4e39-be0f-24d6fa76c7f6 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 984 time: 0.0565290 Dec 24 05:08:21.843797 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ee29af08-fe70-4ab0-a918-78dba7fb7983 req-10cc24de-f022-44dd-a5f2-34483063e8bb tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=bc3c93b3-eec1-4f52-a952-c229f892877e&id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0578756 Dec 24 05:08:22.978974 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cbad2f4-b362-4d2c-8c9c-376413641e16 req-4aa5ad37-775a-4c40-b377-52a0e6fafe27 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:22.980451 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3cbad2f4-b362-4d2c-8c9c-376413641e16 req-4aa5ad37-775a-4c40-b377-52a0e6fafe27 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 984 time: 0.0520921 Dec 24 05:08:23.044151 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3cbad2f4-b362-4d2c-8c9c-376413641e16 req-6849cb12-a477-4829-9fc7-f1d5bf1341f3 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=bc3c93b3-eec1-4f52-a952-c229f892877e&id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0574777 Dec 24 05:08:23.201220 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-f06931d7-02f5-43aa-a961-5cc67277dda8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:08:24.179283 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c633779f-4c08-401f-8435-8cc005ccf260 req-e2764513-e6ba-4368-bd13-cbd9f01e4960 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:24.181635 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c633779f-4c08-401f-8435-8cc005ccf260 req-e2764513-e6ba-4368-bd13-cbd9f01e4960 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 984 time: 0.0530877 Dec 24 05:08:24.242973 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c633779f-4c08-401f-8435-8cc005ccf260 req-70a0e1c0-bf67-4049-a6c2-79e71380cd99 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=bc3c93b3-eec1-4f52-a952-c229f892877e&id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0551012 Dec 24 05:08:25.275155 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-f8853ce7-982c-4a15-8369-8afd5045abfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:08:25.367187 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f317d5ca-bc05-4346-9e79-2e6c7386fd68 req-dbc0650a-4b54-44df-b87d-eb257aa29475 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:25.368790 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f317d5ca-bc05-4346-9e79-2e6c7386fd68 req-dbc0650a-4b54-44df-b87d-eb257aa29475 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 984 time: 0.0495439 Dec 24 05:08:25.432643 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f317d5ca-bc05-4346-9e79-2e6c7386fd68 req-2b0b87a2-b8f8-4c6c-a4a6-8015ec2bb37f tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=bc3c93b3-eec1-4f52-a952-c229f892877e&id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0545874 Dec 24 05:08:26.494404 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:08:26.564032 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d04263d0-d00c-46b5-9a6a-4f19292f9df3 req-91b6398e-cce1-4530-b65f-40d2fe6dd785 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:26.565543 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d04263d0-d00c-46b5-9a6a-4f19292f9df3 req-91b6398e-cce1-4530-b65f-40d2fe6dd785 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 984 time: 0.0540171 Dec 24 05:08:26.632440 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d04263d0-d00c-46b5-9a6a-4f19292f9df3 req-77dd7829-a592-4c30-9ed7-364e076e9fc0 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=bc3c93b3-eec1-4f52-a952-c229f892877e&id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0576320 Dec 24 05:08:27.236221 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5479dd91-aee8-4e2d-a300-087a6cdc98db req-291ed910-c0b0-4494-836c-d83c260a93d8 service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0454292 Dec 24 05:08:27.309223 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5479dd91-aee8-4e2d-a300-087a6cdc98db req-356917d5-a5c9-4bfb-b932-781394cf723f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:27.310765 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5479dd91-aee8-4e2d-a300-087a6cdc98db req-356917d5-a5c9-4bfb-b932-781394cf723f service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=6c9c47f70b8d4da5827a8ef4349559ab&device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 1098 time: 0.0414374 Dec 24 05:08:27.418478 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5479dd91-aee8-4e2d-a300-087a6cdc98db req-03832928-39a3-4b28-afb8-2592c1c2179d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:27.419933 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5479dd91-aee8-4e2d-a300-087a6cdc98db req-03832928-39a3-4b28-afb8-2592c1c2179d service neutron] 10.222.0.46 "GET /v2.0/networks?id=c908572e-3b6b-470c-8b88-35b51f1472c6 HTTP/1.1" status: 200 len: 917 time: 0.0871439 Dec 24 05:08:27.490666 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5479dd91-aee8-4e2d-a300-087a6cdc98db req-7519e0ba-cdcc-4315-810f-da5cd5fb3cb1 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8f0b0287-0281-4556-ae15-8fe2c2dbf50d HTTP/1.1" status: 200 len: 1001 time: 0.0623791 Dec 24 05:08:27.538895 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5479dd91-aee8-4e2d-a300-087a6cdc98db req-b33fccd1-644e-4c5f-bebd-c63726603db6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:27.540345 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5479dd91-aee8-4e2d-a300-087a6cdc98db req-b33fccd1-644e-4c5f-bebd-c63726603db6 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=699b398d-7f9d-4acb-bc18-ac32f35377c3 HTTP/1.1" status: 200 len: 855 time: 0.0426381 Dec 24 05:08:27.591840 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5479dd91-aee8-4e2d-a300-087a6cdc98db req-7e012c36-d7ff-4103-bc26-a7c9cbbb8250 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:27.593429 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5479dd91-aee8-4e2d-a300-087a6cdc98db req-7e012c36-d7ff-4103-bc26-a7c9cbbb8250 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=c908572e-3b6b-470c-8b88-35b51f1472c6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0452285 Dec 24 05:08:27.692122 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5479dd91-aee8-4e2d-a300-087a6cdc98db req-2e007bd3-96f0-4390-b2be-27c785c306a8 service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0907757 Dec 24 05:08:27.815945 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a732ca5-f86f-4656-b006-63f309747a74 req-0ebc34e5-e1aa-4155-bb5f-9e3f1b7224dd tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:27.817468 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1a732ca5-f86f-4656-b006-63f309747a74 req-0ebc34e5-e1aa-4155-bb5f-9e3f1b7224dd tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 984 time: 0.1012087 Dec 24 05:08:27.819669 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5479dd91-aee8-4e2d-a300-087a6cdc98db req-61bb7615-725c-4e58-8f58-912363a66bba service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1208785 Dec 24 05:08:27.879795 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1a732ca5-f86f-4656-b006-63f309747a74 req-c6ba4bc1-14b3-4b33-8ad0-6bd30183bf71 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=bc3c93b3-eec1-4f52-a952-c229f892877e&id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0556138 Dec 24 05:08:27.935387 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:08:28.577845 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:08:29.018165 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3753b7aa-028c-4c6c-ace7-749b703b651d req-a3e857e3-4e86-4229-8ef4-5c39c5c538e5 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:29.019650 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3753b7aa-028c-4c6c-ace7-749b703b651d req-a3e857e3-4e86-4229-8ef4-5c39c5c538e5 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 984 time: 0.0570219 Dec 24 05:08:29.085004 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3753b7aa-028c-4c6c-ace7-749b703b651d req-bdb8f6a1-6abf-4988-beb7-e3a1117c6fe1 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=bc3c93b3-eec1-4f52-a952-c229f892877e&id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0589554 Dec 24 05:08:30.230870 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dfb6316-25e8-430a-b07a-c682c04b5dc3 req-fb492a3b-d4b6-4c35-8b86-7c2fe3a7b715 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:30.232358 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5dfb6316-25e8-430a-b07a-c682c04b5dc3 req-fb492a3b-d4b6-4c35-8b86-7c2fe3a7b715 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 984 time: 0.0659950 Dec 24 05:08:30.300197 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5dfb6316-25e8-430a-b07a-c682c04b5dc3 req-90d09aae-9cce-4a1c-b6ee-b4a508adb2de tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=bc3c93b3-eec1-4f52-a952-c229f892877e&id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0561512 Dec 24 05:08:41.193448 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1ea5c3c-96f4-477d-8b49-ebd52284ef3d req-b39ae926-3dd4-4504-b4f8-524498c5f67d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:41.194819 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f1ea5c3c-96f4-477d-8b49-ebd52284ef3d req-b39ae926-3dd4-4504-b4f8-524498c5f67d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0535271 Dec 24 05:08:41.242314 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f1ea5c3c-96f4-477d-8b49-ebd52284ef3d req-60002564-b962-47a7-b897-11cf746ce5ce tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414374 Dec 24 05:08:42.377119 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01302268-5c08-48ca-a472-c0c4e3a4bccc req-19aabd59-e5cf-4f1a-ac7d-9335d6c8f4e0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:42.378669 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-01302268-5c08-48ca-a472-c0c4e3a4bccc req-19aabd59-e5cf-4f1a-ac7d-9335d6c8f4e0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0524087 Dec 24 05:08:42.426630 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:08:42.428557 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-01302268-5c08-48ca-a472-c0c4e3a4bccc req-b53c77e9-51b8-4f59-a3e9-490202d6b202 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429049 Dec 24 05:08:43.572360 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad906e32-d910-486f-bf80-8bc8266b076c req-1bf9774f-db70-4d3b-8d75-881191f87a23 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:43.573752 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ad906e32-d910-486f-bf80-8bc8266b076c req-1bf9774f-db70-4d3b-8d75-881191f87a23 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0556061 Dec 24 05:08:43.631919 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ad906e32-d910-486f-bf80-8bc8266b076c req-3a01dde2-74cb-4855-b441-e74d99cac101 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0491536 Dec 24 05:08:44.771157 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b1745b3-57df-4e82-9747-f159e58252c3 req-60f5935e-9446-49b3-b50e-05638f04d013 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:44.772629 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4b1745b3-57df-4e82-9747-f159e58252c3 req-60f5935e-9446-49b3-b50e-05638f04d013 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0614774 Dec 24 05:08:44.826222 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4b1745b3-57df-4e82-9747-f159e58252c3 req-a24151c2-521f-4c67-8f10-66b36d659021 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446484 Dec 24 05:08:45.962803 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7db6e6a-7d2c-438f-9f3d-aee928a50f94 req-a65af07a-27ee-4cb3-9f24-36dc3adff994 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:45.964280 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f7db6e6a-7d2c-438f-9f3d-aee928a50f94 req-a65af07a-27ee-4cb3-9f24-36dc3adff994 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0557425 Dec 24 05:08:46.014107 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f7db6e6a-7d2c-438f-9f3d-aee928a50f94 req-eaa4132f-8076-413e-983a-a697f3f74219 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437181 Dec 24 05:08:47.152898 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5df75d0-c3c3-400b-b880-40ffd3c8336b req-e90a7798-b598-4014-bc73-48f072e87382 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:47.154369 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c5df75d0-c3c3-400b-b880-40ffd3c8336b req-e90a7798-b598-4014-bc73-48f072e87382 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0496886 Dec 24 05:08:47.201167 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c5df75d0-c3c3-400b-b880-40ffd3c8336b req-4c224911-0121-4d20-90a3-224fb25fdabc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406160 Dec 24 05:08:48.342742 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e339c066-aa20-4b65-b009-ef418f80f839 req-b9642705-968a-45d0-98ed-081b08de862c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:48.344259 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e339c066-aa20-4b65-b009-ef418f80f839 req-b9642705-968a-45d0-98ed-081b08de862c tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0509694 Dec 24 05:08:48.395521 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e339c066-aa20-4b65-b009-ef418f80f839 req-6c11b87e-9ea3-40c6-ab5e-8d41807aa05a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422218 Dec 24 05:08:49.519751 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-598cfedf-9e21-4e44-9bc9-f1a75f31d9c3 req-01c960db-2083-4d84-9546-1edc1539feec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:49.521262 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-598cfedf-9e21-4e44-9bc9-f1a75f31d9c3 req-01c960db-2083-4d84-9546-1edc1539feec tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0479908 Dec 24 05:08:49.574534 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-598cfedf-9e21-4e44-9bc9-f1a75f31d9c3 req-1b8fbdf5-7262-4075-95d3-9e3c7a945f4e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445352 Dec 24 05:08:50.442155 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:08:50.713079 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0177255c-98a3-4e4c-8349-dc6515b23b06 req-e54ac2be-b8e9-48c0-8fe0-994b5e881e4a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:50.714564 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0177255c-98a3-4e4c-8349-dc6515b23b06 req-e54ac2be-b8e9-48c0-8fe0-994b5e881e4a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0505121 Dec 24 05:08:50.764966 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0177255c-98a3-4e4c-8349-dc6515b23b06 req-b3504927-18c1-4d7e-bb99-8182727f2070 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443308 Dec 24 05:08:51.893371 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e25617ff-98c1-4b38-bcbe-68457d388089 req-a25ab3dd-6151-4161-af7a-a2b33cbb06b4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:51.894938 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e25617ff-98c1-4b38-bcbe-68457d388089 req-a25ab3dd-6151-4161-af7a-a2b33cbb06b4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0500028 Dec 24 05:08:51.943680 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e25617ff-98c1-4b38-bcbe-68457d388089 req-6b5c4b26-2c8e-444f-80b2-c6948322cc26 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426097 Dec 24 05:08:53.076984 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f0528a6-2fbe-4ee1-a059-a9bb6947c067 req-cf92d549-395f-4e29-bfdd-8080eee9a60e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:53.078478 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7f0528a6-2fbe-4ee1-a059-a9bb6947c067 req-cf92d549-395f-4e29-bfdd-8080eee9a60e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0492470 Dec 24 05:08:53.130520 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7f0528a6-2fbe-4ee1-a059-a9bb6947c067 req-56fed1d9-4f47-45d3-9d71-0722a5d47dc8 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454364 Dec 24 05:08:53.196190 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-77de6ca3-0b6e-4e52-b9ac-0f9c2ef07cca None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:08:54.300119 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67e15678-abdd-455d-9d16-3fc34bb95c48 req-f71cfa22-ace2-4321-906b-bd18e4addf3b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:54.301714 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-67e15678-abdd-455d-9d16-3fc34bb95c48 req-f71cfa22-ace2-4321-906b-bd18e4addf3b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0689511 Dec 24 05:08:54.355530 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-67e15678-abdd-455d-9d16-3fc34bb95c48 req-85474a0b-df81-40e4-84e8-270fda6cd517 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462551 Dec 24 05:08:54.622718 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 8f0b0287-0281-4556-ae15-8fe2c2dbf50d details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 05:08:54.734224 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=8f0b0287-0281-4556-ae15-8fe2c2dbf50d,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:08:54.749603 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': '8f0b0287-0281-4556-ae15-8fe2c2dbf50d', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'port_id': '8f0b0287-0281-4556-ae15-8fe2c2dbf50d', 'mac_address': 'fa:16:3e:da:a5:13', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 05:08:54.792946 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:08:54.808239 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 8f0b0287-0281-4556-ae15-8fe2c2dbf50d {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:08:54.829291 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=8f0b0287-0281-4556-ae15-8fe2c2dbf50d,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:08:54.835938 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:08:54.899224 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=8f0b0287-0281-4556-ae15-8fe2c2dbf50d,revision_number=6']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:08:54.907249 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:08:54.907603 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:08:54.907953 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:08:54.908290 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:08:54.908621 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:08:54.908975 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:08:54.909350 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:08:54.909626 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:08:54.909944 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:08:54.910274 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:08:54.910667 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:08:54.910880 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:08:54.911210 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:08:55.016567 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['8f0b0287-0281-4556-ae15-8fe2c2dbf50d'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:08:55.270175 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b9b6b3d-7c7a-41ab-8d71-0966bc42d73d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:08:55.484560 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b27c7492-c4b8-4f02-9857-737604cd19a9 req-70d9d3c4-25f7-4847-a404-2acba5f851a5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:55.486270 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b27c7492-c4b8-4f02-9857-737604cd19a9 req-70d9d3c4-25f7-4847-a404-2acba5f851a5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 944 time: 0.0533454 Dec 24 05:08:55.534549 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b27c7492-c4b8-4f02-9857-737604cd19a9 req-6b01cb90-82fa-41c4-a0f3-271645050016 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419061 Dec 24 05:08:56.501050 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:08:56.647352 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 8f0b0287-0281-4556-ae15-8fe2c2dbf50d up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:08:56.663498 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b33b610-4103-4ea3-9573-335d1f1a9829 req-5c22df7a-04d1-4984-82c1-129cdf76efdb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:56.665047 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8b33b610-4103-4ea3-9573-335d1f1a9829 req-5c22df7a-04d1-4984-82c1-129cdf76efdb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 944 time: 0.0549648 Dec 24 05:08:56.696674 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:08:56.696980 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:08:56.713279 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8b33b610-4103-4ea3-9573-335d1f1a9829 req-aca8ee9d-ceaf-47e6-8e6e-d7d0f425b9f4 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420046 Dec 24 05:08:56.775584 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:08:56.798266 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cc21b91f-c07f-40f8-8cf1-a9c343386f03', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8f0b0287-0281-4556-ae15-8fe2c2dbf50d'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:08:56.800493 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e9bcf3b3-b285-440c-b057-93aed2903697" -d '{"events": [{"server_uuid": "cc21b91f-c07f-40f8-8cf1-a9c343386f03", "name": "network-vif-plugged", "status": "completed", "tag": "8f0b0287-0281-4556-ae15-8fe2c2dbf50d"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:08:56.813033 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=8f0b0287-0281-4556-ae15-8fe2c2dbf50d,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:08:56.819106 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:08:56.844143 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:08:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5d8bbae4-e409-4676-8010-902fb415a1d0 x-openstack-request-id: req-5d8bbae4-e409-4676-8010-902fb415a1d0 {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:08:56.844462 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cc21b91f-c07f-40f8-8cf1-a9c343386f03", "name": "network-vif-plugged", "status": "completed", "tag": "8f0b0287-0281-4556-ae15-8fe2c2dbf50d", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:08:56.844828 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-5d8bbae4-e409-4676-8010-902fb415a1d0 {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:08:56.845416 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cc21b91f-c07f-40f8-8cf1-a9c343386f03', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8f0b0287-0281-4556-ae15-8fe2c2dbf50d', 'code': 200} Dec 24 05:08:56.871145 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=8f0b0287-0281-4556-ae15-8fe2c2dbf50d,revision_number=7']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:08:57.850900 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-141ae250-49dd-4ba3-8115-fff8db22771b req-df80b778-2184-4fd2-b0da-531a0fc2f8d6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:57.852392 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-141ae250-49dd-4ba3-8115-fff8db22771b req-df80b778-2184-4fd2-b0da-531a0fc2f8d6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0545757 Dec 24 05:08:57.900294 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-141ae250-49dd-4ba3-8115-fff8db22771b req-61f18f0e-5e41-4500-a731-a38f5891869e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418186 Dec 24 05:08:57.938392 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:08:58.608840 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:08:59.049415 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc5c2ab2-40c9-4245-b9ca-60d99c9d06ec req-1a2f723c-b92a-4527-a418-901e2e025670 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:08:59.051787 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bc5c2ab2-40c9-4245-b9ca-60d99c9d06ec req-1a2f723c-b92a-4527-a418-901e2e025670 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0673440 Dec 24 05:08:59.104920 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bc5c2ab2-40c9-4245-b9ca-60d99c9d06ec req-86e387b9-de0f-4aeb-9c99-ee85bcf3a19d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446179 Dec 24 05:09:00.258807 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a85b65d5-44b4-498a-893f-9a82b7b7d073 req-519d0166-ed1c-476f-81a4-aab783b9f1b1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:00.260339 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a85b65d5-44b4-498a-893f-9a82b7b7d073 req-519d0166-ed1c-476f-81a4-aab783b9f1b1 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0538101 Dec 24 05:09:00.322559 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a85b65d5-44b4-498a-893f-9a82b7b7d073 req-d115dcba-0b55-40bc-80ed-fcf9dd12461f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0537503 Dec 24 05:09:01.466596 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a12aea0-0729-4279-a214-627dd00f2de0 req-873118be-11d9-4362-94ef-af410d9b6cfd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:01.468951 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6a12aea0-0729-4279-a214-627dd00f2de0 req-873118be-11d9-4362-94ef-af410d9b6cfd tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0550663 Dec 24 05:09:01.520580 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6a12aea0-0729-4279-a214-627dd00f2de0 req-677dde59-abd7-41df-8db5-12f6f234c535 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442717 Dec 24 05:09:02.667161 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a02e1f88-5497-4271-b47e-21d8b4cc44fc req-b40d7b2f-ae26-4c1e-94f9-a1b13c60a9f2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:02.668695 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a02e1f88-5497-4271-b47e-21d8b4cc44fc req-b40d7b2f-ae26-4c1e-94f9-a1b13c60a9f2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0554295 Dec 24 05:09:02.723201 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a02e1f88-5497-4271-b47e-21d8b4cc44fc req-412d352e-0a95-4ebb-abd6-2dafa1e5c32e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0464098 Dec 24 05:09:03.853755 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b19c244-77de-4db5-a6bd-c8bea3439e6b req-b5c13cfa-2255-4197-aa7b-3b39bb42aa0d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:03.855940 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5b19c244-77de-4db5-a6bd-c8bea3439e6b req-b5c13cfa-2255-4197-aa7b-3b39bb42aa0d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0540586 Dec 24 05:09:03.912805 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5b19c244-77de-4db5-a6bd-c8bea3439e6b req-0c8529e1-516a-415b-9ffd-aea17a686359 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0503540 Dec 24 05:09:05.051917 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bae67733-c5d3-4859-abbf-36b1bfd58405 req-81edb7d8-7380-4bb1-b97b-2594388e3b89 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:05.053752 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-bae67733-c5d3-4859-abbf-36b1bfd58405 req-81edb7d8-7380-4bb1-b97b-2594388e3b89 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0596292 Dec 24 05:09:05.110409 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-bae67733-c5d3-4859-abbf-36b1bfd58405 req-e7f05faf-1add-4ac0-9138-92b24d9f372a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0500081 Dec 24 05:09:06.241733 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a05adc9-ed90-492d-8cf3-d8ce71bd1e68 req-5ca5b42c-c29a-437f-b486-ee095cfa1142 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:06.244145 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2a05adc9-ed90-492d-8cf3-d8ce71bd1e68 req-5ca5b42c-c29a-437f-b486-ee095cfa1142 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0516491 Dec 24 05:09:06.296048 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2a05adc9-ed90-492d-8cf3-d8ce71bd1e68 req-ecad11bd-f3af-472e-9659-9534f9a43f9a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454767 Dec 24 05:09:07.425353 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c580569e-3fcf-49ad-b35d-554b88ff6ff4 req-eed9afc5-b1e8-4300-b3e1-54ea324a5031 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:07.426852 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c580569e-3fcf-49ad-b35d-554b88ff6ff4 req-eed9afc5-b1e8-4300-b3e1-54ea324a5031 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0538146 Dec 24 05:09:07.481776 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c580569e-3fcf-49ad-b35d-554b88ff6ff4 req-1b5aa7ad-86be-47e9-add6-131252e66fe2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0483966 Dec 24 05:09:07.950417 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acffec12-1103-44f0-b492-f2f4601b80a8 req-3b8f0dcd-08b6-4b1e-bd0b-2e5b845c7191 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:07.951899 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-acffec12-1103-44f0-b492-f2f4601b80a8 req-3b8f0dcd-08b6-4b1e-bd0b-2e5b845c7191 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=6c9c47f70b8d4da5827a8ef4349559ab&device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 1098 time: 0.0479102 Dec 24 05:09:08.045436 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acffec12-1103-44f0-b492-f2f4601b80a8 req-2f64fe00-4dd0-46d8-a695-ed290037476d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:08.046851 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-acffec12-1103-44f0-b492-f2f4601b80a8 req-2f64fe00-4dd0-46d8-a695-ed290037476d service neutron] 10.222.0.46 "GET /v2.0/networks?id=c908572e-3b6b-470c-8b88-35b51f1472c6 HTTP/1.1" status: 200 len: 917 time: 0.0879958 Dec 24 05:09:08.112341 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-acffec12-1103-44f0-b492-f2f4601b80a8 req-f0dc976e-4eb8-4d83-b4bf-0ddb9bc00de5 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8f0b0287-0281-4556-ae15-8fe2c2dbf50d HTTP/1.1" status: 200 len: 1001 time: 0.0577166 Dec 24 05:09:08.163298 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acffec12-1103-44f0-b492-f2f4601b80a8 req-2467b031-41a9-4fa7-b840-3d289cabdd27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:08.164733 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-acffec12-1103-44f0-b492-f2f4601b80a8 req-2467b031-41a9-4fa7-b840-3d289cabdd27 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=699b398d-7f9d-4acb-bc18-ac32f35377c3 HTTP/1.1" status: 200 len: 855 time: 0.0459166 Dec 24 05:09:08.212343 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acffec12-1103-44f0-b492-f2f4601b80a8 req-0f2e1b53-2c53-4190-92ec-c60ca712f77a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:08.213936 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-acffec12-1103-44f0-b492-f2f4601b80a8 req-0f2e1b53-2c53-4190-92ec-c60ca712f77a service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=c908572e-3b6b-470c-8b88-35b51f1472c6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0405433 Dec 24 05:09:08.312229 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-acffec12-1103-44f0-b492-f2f4601b80a8 req-e16c8d57-f9e1-44ef-b28f-2406dc06945f service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0907686 Dec 24 05:09:08.409514 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-acffec12-1103-44f0-b492-f2f4601b80a8 req-d395beb0-a4a5-4b22-bc2b-0c4ed4dd778c service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0901270 Dec 24 05:09:08.611752 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12dcc922-c162-41f2-acbf-359e78bf9468 req-93eaebbc-c451-4d0d-bab1-79022c79dc60 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:08.613290 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-12dcc922-c162-41f2-acbf-359e78bf9468 req-93eaebbc-c451-4d0d-bab1-79022c79dc60 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.0531232 Dec 24 05:09:08.665649 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-12dcc922-c162-41f2-acbf-359e78bf9468 req-448f8d27-b648-4333-a5df-055fef9b89ed tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430870 Dec 24 05:09:09.858753 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b9c9bc0-2b53-418e-b75d-b83bbcf8f183 req-84dcef2e-d12c-4a5a-9c82-c6418b389093 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:09.860252 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-9b9c9bc0-2b53-418e-b75d-b83bbcf8f183 req-84dcef2e-d12c-4a5a-9c82-c6418b389093 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 945 time: 0.1073563 Dec 24 05:09:09.919026 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-9b9c9bc0-2b53-418e-b75d-b83bbcf8f183 req-21d82abb-ffa5-4d4e-8565-afb18f18a9ea tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0526445 Dec 24 05:09:10.733252 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 8f0b0287-0281-4556-ae15-8fe2c2dbf50d no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:09:10.815756 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:10.840572 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cc21b91f-c07f-40f8-8cf1-a9c343386f03', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8f0b0287-0281-4556-ae15-8fe2c2dbf50d'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:09:10.842892 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2098120b-a920-4fe7-bbc9-175cf6c6afd1" -d '{"events": [{"server_uuid": "cc21b91f-c07f-40f8-8cf1-a9c343386f03", "name": "network-vif-unplugged", "status": "completed", "tag": "8f0b0287-0281-4556-ae15-8fe2c2dbf50d"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:09:10.855882 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=8f0b0287-0281-4556-ae15-8fe2c2dbf50d,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:09:10.861590 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:10.884100 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Fri, 24 Dec 2021 05:09:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aa5798fb-999f-41a5-98fc-c231197a5645 x-openstack-request-id: req-aa5798fb-999f-41a5-98fc-c231197a5645 {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:09:10.884369 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cc21b91f-c07f-40f8-8cf1-a9c343386f03", "name": "network-vif-unplugged", "status": "failed", "tag": "8f0b0287-0281-4556-ae15-8fe2c2dbf50d", "code": 422}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:09:10.884634 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-aa5798fb-999f-41a5-98fc-c231197a5645 {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:09:10.885029 dv-cinder-816443-2-iscsi neutron-server[102478]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'cc21b91f-c07f-40f8-8cf1-a9c343386f03', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '8f0b0287-0281-4556-ae15-8fe2c2dbf50d', 'code': 422} returned with failed status Dec 24 05:09:10.909912 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=8f0b0287-0281-4556-ae15-8fe2c2dbf50d,revision_number=8']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:11.244421 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dbdb45a-92f9-4953-aaaa-98699f2c66ba req-135a7007-a8a2-4447-81b5-1a1977134b76 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:11.245916 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3dbdb45a-92f9-4953-aaaa-98699f2c66ba req-135a7007-a8a2-4447-81b5-1a1977134b76 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 943 time: 0.2515612 Dec 24 05:09:11.298047 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3dbdb45a-92f9-4953-aaaa-98699f2c66ba req-81bb8c1b-9a19-4981-b300-6797aa858016 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435684 Dec 24 05:09:12.417890 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9e692fb-6f08-43a9-8838-f80fc173f90d req-a0f81d60-0dc7-4cb4-8c13-57f97d863396 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:12.419355 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c9e692fb-6f08-43a9-8838-f80fc173f90d req-a0f81d60-0dc7-4cb4-8c13-57f97d863396 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 943 time: 0.0719206 Dec 24 05:09:12.453168 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8245bbed-cacf-48ee-a1b3-998c4d721cf5 req-bec86016-02c2-4cae-90f8-c461e9814ffe service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0673263 Dec 24 05:09:12.476717 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c9e692fb-6f08-43a9-8838-f80fc173f90d req-0b785e4a-2d2c-476d-9ab6-1e02026f4515 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0505588 Dec 24 05:09:13.309980 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8245bbed-cacf-48ee-a1b3-998c4d721cf5 req-6c38e487-bcbf-4aa8-bb34-c51a6c79e05b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:13.311508 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8245bbed-cacf-48ee-a1b3-998c4d721cf5 req-6c38e487-bcbf-4aa8-bb34-c51a6c79e05b service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03&tenant_id=6c9c47f70b8d4da5827a8ef4349559ab HTTP/1.1" status: 200 len: 1096 time: 0.0463824 Dec 24 05:09:13.390399 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8245bbed-cacf-48ee-a1b3-998c4d721cf5 req-e76ff702-3a93-4eea-8806-7841b8e22c2b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:13.391882 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8245bbed-cacf-48ee-a1b3-998c4d721cf5 req-e76ff702-3a93-4eea-8806-7841b8e22c2b service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=6c9c47f70b8d4da5827a8ef4349559ab&device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 1096 time: 0.0419378 Dec 24 05:09:13.484580 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8245bbed-cacf-48ee-a1b3-998c4d721cf5 req-2200407e-8b14-489c-846d-0d1ebf4e8e20 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:13.486076 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8245bbed-cacf-48ee-a1b3-998c4d721cf5 req-2200407e-8b14-489c-846d-0d1ebf4e8e20 service neutron] 10.222.0.46 "GET /v2.0/networks?id=c908572e-3b6b-470c-8b88-35b51f1472c6 HTTP/1.1" status: 200 len: 917 time: 0.0865192 Dec 24 05:09:13.575797 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8245bbed-cacf-48ee-a1b3-998c4d721cf5 req-7db3f3ac-0165-444d-8977-0a690ecc7c8d service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8f0b0287-0281-4556-ae15-8fe2c2dbf50d HTTP/1.1" status: 200 len: 999 time: 0.0823076 Dec 24 05:09:13.645494 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8245bbed-cacf-48ee-a1b3-998c4d721cf5 req-9e463611-b6a8-44c4-8305-071bb173728c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:13.646959 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8245bbed-cacf-48ee-a1b3-998c4d721cf5 req-9e463611-b6a8-44c4-8305-071bb173728c service neutron] 10.222.0.46 "GET /v2.0/subnets?id=699b398d-7f9d-4acb-bc18-ac32f35377c3 HTTP/1.1" status: 200 len: 855 time: 0.0545886 Dec 24 05:09:13.655576 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2613e9e6-9bea-46de-a48a-fc314649c8d5 req-58b5ca51-9a0a-4354-9f7c-e885b419be71 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:13.656962 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2613e9e6-9bea-46de-a48a-fc314649c8d5 req-58b5ca51-9a0a-4354-9f7c-e885b419be71 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 943 time: 0.1008012 Dec 24 05:09:14.015033 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8245bbed-cacf-48ee-a1b3-998c4d721cf5 req-a01e2213-2de6-4ca8-93ea-7f5a58b58a6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:14.016456 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8245bbed-cacf-48ee-a1b3-998c4d721cf5 req-a01e2213-2de6-4ca8-93ea-7f5a58b58a6f service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=c908572e-3b6b-470c-8b88-35b51f1472c6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.3586481 Dec 24 05:09:14.019831 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2613e9e6-9bea-46de-a48a-fc314649c8d5 req-9aa1b53f-22df-41eb-829a-62b422779e48 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3547490 Dec 24 05:09:14.109758 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8245bbed-cacf-48ee-a1b3-998c4d721cf5 req-3a1746a4-ed1a-4390-91d7-c5cebbb1cdad service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842774 Dec 24 05:09:14.217571 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8245bbed-cacf-48ee-a1b3-998c4d721cf5 req-57a046db-bacc-4873-9f83-31eb6f42b932 service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0998478 Dec 24 05:09:14.744456 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 8f0b0287-0281-4556-ae15-8fe2c2dbf50d no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:09:15.148813 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-337b8c25-7034-4d17-b571-58767f6c4f8d req-8c5b50c1-1a7d-4eda-9ef9-230f9124047d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:15.150412 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-337b8c25-7034-4d17-b571-58767f6c4f8d req-8c5b50c1-1a7d-4eda-9ef9-230f9124047d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 943 time: 0.0527213 Dec 24 05:09:15.209533 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-337b8c25-7034-4d17-b571-58767f6c4f8d req-9466a4c2-6ca3-4777-8815-2604b58c25ed tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0510068 Dec 24 05:09:16.336050 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ad86e47-8c21-4704-b402-4e1ad4fb9d84 req-98cdf236-3235-4a34-b577-bc971ad9b30f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:16.344028 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7ad86e47-8c21-4704-b402-4e1ad4fb9d84 req-98cdf236-3235-4a34-b577-bc971ad9b30f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 943 time: 0.0590565 Dec 24 05:09:16.390540 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7ad86e47-8c21-4704-b402-4e1ad4fb9d84 req-0f2f9725-9d9c-4d10-8784-bb8b7fbaadc2 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456283 Dec 24 05:09:17.529443 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d0e663f-9b03-4d60-83f8-05bbe8a69651 req-38d1927d-91cd-483e-b33f-121c729d9007 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:17.531144 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0d0e663f-9b03-4d60-83f8-05bbe8a69651 req-38d1927d-91cd-483e-b33f-121c729d9007 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 943 time: 0.0510671 Dec 24 05:09:17.584929 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0d0e663f-9b03-4d60-83f8-05bbe8a69651 req-8dbc9a01-ec64-49a8-8697-d86f62acc6e0 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0474904 Dec 24 05:09:18.811155 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16ef1bd2-27bb-453d-a63f-83818d5fff21 req-49523e5e-c54c-4617-821b-aa4bb44a116a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:18.812710 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-16ef1bd2-27bb-453d-a63f-83818d5fff21 req-49523e5e-c54c-4617-821b-aa4bb44a116a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 943 time: 0.0524631 Dec 24 05:09:18.864132 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-16ef1bd2-27bb-453d-a63f-83818d5fff21 req-59ce47da-0ce3-47db-bf16-8f0e447694cc tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453103 Dec 24 05:09:19.426156 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:09:19.995166 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c87aa52-011b-489c-9c97-1806f658e578 req-c6eac844-7957-4d7b-ac01-f85c03b4c556 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:19.996708 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-9c87aa52-011b-489c-9c97-1806f658e578 req-c6eac844-7957-4d7b-ac01-f85c03b4c556 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 943 time: 0.0528328 Dec 24 05:09:20.050980 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-9c87aa52-011b-489c-9c97-1806f658e578 req-a987f05c-74f2-44a0-9b88-fd4dd6b235f3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0480585 Dec 24 05:09:20.435180 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:21.189194 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fb10cf1-c805-4e84-acbe-484c5158e070 req-7eed7697-8a0d-4324-bca4-a4b7042368a9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:21.190712 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8fb10cf1-c805-4e84-acbe-484c5158e070 req-7eed7697-8a0d-4324-bca4-a4b7042368a9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 943 time: 0.0606575 Dec 24 05:09:21.247717 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8fb10cf1-c805-4e84-acbe-484c5158e070 req-76341bf7-de0f-43a9-94d6-8db1a5ccb318 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0507357 Dec 24 05:09:22.375824 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f70f6ba5-0e13-4668-b566-96de31f15fe7 req-96abec44-272c-4651-a34f-12380eea6744 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:22.377372 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f70f6ba5-0e13-4668-b566-96de31f15fe7 req-96abec44-272c-4651-a34f-12380eea6744 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 943 time: 0.0522888 Dec 24 05:09:22.423884 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f70f6ba5-0e13-4668-b566-96de31f15fe7 req-b4d02f5d-c485-4e2d-ae57-b67900574a1e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405905 Dec 24 05:09:23.200346 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-2ae2e7be-766b-48ee-8b63-1d28aa3c91a2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:23.558478 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe30f7a5-63ea-4af5-9069-ba34d152958a req-eb33d5ab-8fe3-40aa-88e9-fe36b2ab6ce3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:23.560275 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-fe30f7a5-63ea-4af5-9069-ba34d152958a req-eb33d5ab-8fe3-40aa-88e9-fe36b2ab6ce3 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 943 time: 0.0536644 Dec 24 05:09:23.613159 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-fe30f7a5-63ea-4af5-9069-ba34d152958a req-36e59a1b-5faf-4de6-988a-1c21410b39f5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456257 Dec 24 05:09:24.751407 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2453f9c-df7d-4bb2-bb61-7524a8df643b req-c27d3818-54fb-4621-a98f-ac2099eae379 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:24.752979 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d2453f9c-df7d-4bb2-bb61-7524a8df643b req-c27d3818-54fb-4621-a98f-ac2099eae379 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 943 time: 0.0599504 Dec 24 05:09:24.800928 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d2453f9c-df7d-4bb2-bb61-7524a8df643b req-d01b8a5e-1f4e-4741-936b-daec9fb27987 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419412 Dec 24 05:09:25.274207 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-37260d1f-472f-43ba-92d8-13eb87affc3a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:25.931101 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d477490c-d5e9-409f-8ea3-14e1b6796f84 req-3ccc568b-1f23-4ea8-97d9-5eaa0693402a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:25.932605 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d477490c-d5e9-409f-8ea3-14e1b6796f84 req-3ccc568b-1f23-4ea8-97d9-5eaa0693402a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 943 time: 0.0485857 Dec 24 05:09:25.979464 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d477490c-d5e9-409f-8ea3-14e1b6796f84 req-c92d6145-ffda-4d20-9cf0-09b0241a9003 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408707 Dec 24 05:09:26.507318 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:27.119887 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c10f50-d48d-4775-8af0-863b69dc5659 req-5e1227e3-1bd3-48b0-ba3d-e7cfa6af1417 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:27.121492 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-95c10f50-d48d-4775-8af0-863b69dc5659 req-5e1227e3-1bd3-48b0-ba3d-e7cfa6af1417 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 943 time: 0.0564947 Dec 24 05:09:27.168954 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-95c10f50-d48d-4775-8af0-863b69dc5659 req-44bec65c-ef6c-42b7-9e53-eeb54ed72104 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414093 Dec 24 05:09:27.941896 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:28.302925 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f5583b5-bc88-486c-b1e8-cad0efad4652 req-d3c4d8d4-c817-4232-9a91-869e7934a36b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:28.304927 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6f5583b5-bc88-486c-b1e8-cad0efad4652 req-d3c4d8d4-c817-4232-9a91-869e7934a36b tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 943 time: 0.0602317 Dec 24 05:09:28.354675 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6f5583b5-bc88-486c-b1e8-cad0efad4652 req-9faac846-39de-4114-b7d8-84af119bc451 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434680 Dec 24 05:09:28.591910 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:29.437755 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a9aa4b50-9f6e-4fb1-9a14-5e76e43e3043 req-8b043c45-fcb9-4d7d-af1b-bc51c4fd4633 service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0912266 Dec 24 05:09:29.480704 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd102da7-574e-47e7-8dca-afa2ed1811d5 req-173db0d2-d76d-421a-b085-a5985d474862 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:29.482204 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-dd102da7-574e-47e7-8dca-afa2ed1811d5 req-173db0d2-d76d-421a-b085-a5985d474862 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 943 time: 0.0525723 Dec 24 05:09:29.517698 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9aa4b50-9f6e-4fb1-9a14-5e76e43e3043 req-f882bee2-22f4-4ba0-acc0-b547b52ec73c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:29.519246 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a9aa4b50-9f6e-4fb1-9a14-5e76e43e3043 req-f882bee2-22f4-4ba0-acc0-b547b52ec73c service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=8b1a80c6322a493ba10c69a77168b46f&device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 1098 time: 0.0399172 Dec 24 05:09:29.532050 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-dd102da7-574e-47e7-8dca-afa2ed1811d5 req-b48be32e-a837-4421-aac9-289fde3f75ee tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434098 Dec 24 05:09:29.643917 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9aa4b50-9f6e-4fb1-9a14-5e76e43e3043 req-7a2cd96a-df3e-48c1-9507-2bcfe2f3a733 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:29.645356 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a9aa4b50-9f6e-4fb1-9a14-5e76e43e3043 req-7a2cd96a-df3e-48c1-9507-2bcfe2f3a733 service neutron] 10.222.0.46 "GET /v2.0/networks?id=df2331c3-0dd0-460e-980f-1e2409baa35e HTTP/1.1" status: 200 len: 911 time: 0.1042545 Dec 24 05:09:29.712999 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a9aa4b50-9f6e-4fb1-9a14-5e76e43e3043 req-8c52146f-134e-415b-a4be-7906f25b3c79 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=f25ccd41-53b3-4bb9-84e1-824627c3e8e6 HTTP/1.1" status: 200 len: 1001 time: 0.0589728 Dec 24 05:09:29.765970 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9aa4b50-9f6e-4fb1-9a14-5e76e43e3043 req-eea56a93-ce07-4505-9324-0b026c202aec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:29.767481 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a9aa4b50-9f6e-4fb1-9a14-5e76e43e3043 req-eea56a93-ce07-4505-9324-0b026c202aec service neutron] 10.222.0.46 "GET /v2.0/subnets?id=9df81c69-0712-4247-ad21-3b3a089ce4b5 HTTP/1.1" status: 200 len: 849 time: 0.0466592 Dec 24 05:09:29.813748 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9aa4b50-9f6e-4fb1-9a14-5e76e43e3043 req-e5a8a911-8039-4628-9f26-cfce91bcd672 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:29.815264 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a9aa4b50-9f6e-4fb1-9a14-5e76e43e3043 req-e5a8a911-8039-4628-9f26-cfce91bcd672 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=df2331c3-0dd0-460e-980f-1e2409baa35e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0392919 Dec 24 05:09:29.827319 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [req-a9aa4b50-9f6e-4fb1-9a14-5e76e43e3043 req-dcd1735e-0e25-4953-b439-6d888164cd70 service neutron] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102476) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 24 05:09:29.828240 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a9aa4b50-9f6e-4fb1-9a14-5e76e43e3043 req-dcd1735e-0e25-4953-b439-6d888164cd70 service neutron] 10.222.0.46 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0047486 Dec 24 05:09:29.947554 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a9aa4b50-9f6e-4fb1-9a14-5e76e43e3043 req-424342ea-6b5e-4e9b-8aff-688f5ddf96a1 service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1106713 Dec 24 05:09:30.040345 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a9aa4b50-9f6e-4fb1-9a14-5e76e43e3043 req-328c81ce-bcaf-4ef7-b71c-113ce05e3ac0 service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0852091 Dec 24 05:09:30.662698 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de743f1c-18ab-4ef9-b7d3-6ed6841acdb3 req-ef5f1c97-8bd8-4d13-a8e7-f2ccdd95f10d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:30.664233 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-de743f1c-18ab-4ef9-b7d3-6ed6841acdb3 req-ef5f1c97-8bd8-4d13-a8e7-f2ccdd95f10d tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 943 time: 0.0511050 Dec 24 05:09:30.720869 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-de743f1c-18ab-4ef9-b7d3-6ed6841acdb3 req-132848e5-be11-48f0-b677-8f958606e578 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0504060 Dec 24 05:09:30.833008 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 8f0b0287-0281-4556-ae15-8fe2c2dbf50d details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 05:09:30.939032 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=8f0b0287-0281-4556-ae15-8fe2c2dbf50d,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:09:30.950040 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': '8f0b0287-0281-4556-ae15-8fe2c2dbf50d', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'port_id': '8f0b0287-0281-4556-ae15-8fe2c2dbf50d', 'mac_address': 'fa:16:3e:da:a5:13', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 05:09:30.989096 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:31.001858 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8f0b0287-0281-4556-ae15-8fe2c2dbf50d {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:09:31.021240 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=8f0b0287-0281-4556-ae15-8fe2c2dbf50d,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:09:31.028463 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:31.081986 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=8f0b0287-0281-4556-ae15-8fe2c2dbf50d,revision_number=9']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:31.623334 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['8f0b0287-0281-4556-ae15-8fe2c2dbf50d'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:09:31.848336 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62a1a30d-4ba9-4c14-9e92-9a9efde79e8c req-cbf93f63-42ca-471c-a5db-07689d601749 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:31.849861 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-62a1a30d-4ba9-4c14-9e92-9a9efde79e8c req-cbf93f63-42ca-471c-a5db-07689d601749 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 944 time: 0.0560930 Dec 24 05:09:31.905187 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-62a1a30d-4ba9-4c14-9e92-9a9efde79e8c req-0e293e43-4d8b-44de-a783-a72aba7f02f7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0460408 Dec 24 05:09:32.848079 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 8f0b0287-0281-4556-ae15-8fe2c2dbf50d up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:09:32.911584 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:09:32.911931 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:32.990568 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:33.013463 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cc21b91f-c07f-40f8-8cf1-a9c343386f03', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8f0b0287-0281-4556-ae15-8fe2c2dbf50d'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:09:33.015704 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-08032458-6253-4a52-97a7-9465120d7f14" -d '{"events": [{"server_uuid": "cc21b91f-c07f-40f8-8cf1-a9c343386f03", "name": "network-vif-plugged", "status": "completed", "tag": "8f0b0287-0281-4556-ae15-8fe2c2dbf50d"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:09:33.028023 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=8f0b0287-0281-4556-ae15-8fe2c2dbf50d,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:09:33.033887 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29f4b241-7968-4645-bfad-0201a9a8e157 req-10c452f6-7ac2-4bda-8d2a-2ef13107b590 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:33.034363 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:33.035642 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-29f4b241-7968-4645-bfad-0201a9a8e157 req-10c452f6-7ac2-4bda-8d2a-2ef13107b590 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 944 time: 0.0573950 Dec 24 05:09:33.059971 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:09:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-36aca39c-f9d8-46c2-9a1b-16ea8c2882e4 x-openstack-request-id: req-36aca39c-f9d8-46c2-9a1b-16ea8c2882e4 {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:09:33.060266 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cc21b91f-c07f-40f8-8cf1-a9c343386f03", "name": "network-vif-plugged", "status": "completed", "tag": "8f0b0287-0281-4556-ae15-8fe2c2dbf50d", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:09:33.060519 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-36aca39c-f9d8-46c2-9a1b-16ea8c2882e4 {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:09:33.060938 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cc21b91f-c07f-40f8-8cf1-a9c343386f03', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8f0b0287-0281-4556-ae15-8fe2c2dbf50d', 'code': 200} Dec 24 05:09:33.084098 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-29f4b241-7968-4645-bfad-0201a9a8e157 req-0b00a467-cde9-4a6a-970b-c24085c2590a tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427055 Dec 24 05:09:33.086625 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=8f0b0287-0281-4556-ae15-8fe2c2dbf50d,revision_number=10']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:33.314043 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a879825f-caa8-4183-9982-c5f43ec55dee req-a9ac9cb4-f686-4f28-ace5-fe7fc1d79589 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:33.315736 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a879825f-caa8-4183-9982-c5f43ec55dee req-a9ac9cb4-f686-4f28-ace5-fe7fc1d79589 service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 1099 time: 0.0424612 Dec 24 05:09:33.361654 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a879825f-caa8-4183-9982-c5f43ec55dee req-71867bc7-f6d3-4b10-888b-862fff35902a service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0381689 Dec 24 05:09:34.220687 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb642ad0-87f7-4d1c-94cc-8571e1e6ff33 req-ce0d916e-4747-4dbe-ba8a-21e82ac1031e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:34.222242 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-cb642ad0-87f7-4d1c-94cc-8571e1e6ff33 req-ce0d916e-4747-4dbe-ba8a-21e82ac1031e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 946 time: 0.0588517 Dec 24 05:09:34.273209 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-cb642ad0-87f7-4d1c-94cc-8571e1e6ff33 req-deb0adab-f2f9-453a-bbf3-f4920d7e0664 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421569 Dec 24 05:09:35.397380 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b65b785-6737-442c-a03a-8be87b515ed6 req-97dc2948-7d79-4816-94fe-7bea9dd4f135 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:35.398938 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7b65b785-6737-442c-a03a-8be87b515ed6 req-97dc2948-7d79-4816-94fe-7bea9dd4f135 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 946 time: 0.0524154 Dec 24 05:09:35.448417 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-7b65b785-6737-442c-a03a-8be87b515ed6 req-787de83a-a77d-40d2-9bce-936d6909638f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431163 Dec 24 05:09:35.824807 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49091bfb-066c-4903-9766-84ce38727cc1 req-7612ec33-cdd8-459c-8505-b4ac0528a2f0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:35.826288 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-49091bfb-066c-4903-9766-84ce38727cc1 req-7612ec33-cdd8-459c-8505-b4ac0528a2f0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 945 time: 0.0545855 Dec 24 05:09:35.877068 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-49091bfb-066c-4903-9766-84ce38727cc1 req-39a7a60d-c310-40bb-aa90-aa7662405a02 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444973 Dec 24 05:09:36.580271 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06262651-12f0-4619-8f8d-f3ff1dc430ee req-879c8130-1742-4a73-92e9-0db1d48040ba tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:36.581769 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-06262651-12f0-4619-8f8d-f3ff1dc430ee req-879c8130-1742-4a73-92e9-0db1d48040ba tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 946 time: 0.0481908 Dec 24 05:09:36.633043 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-06262651-12f0-4619-8f8d-f3ff1dc430ee req-547163b1-a0a1-452a-8d14-fe01dae7c9a9 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445719 Dec 24 05:09:37.018335 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc4a1107-8f2b-4b72-9585-cacff4c0727a req-70575e2c-8beb-426a-aee9-a140120ffbbf tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:37.020412 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-cc4a1107-8f2b-4b72-9585-cacff4c0727a req-70575e2c-8beb-426a-aee9-a140120ffbbf tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 945 time: 0.0613952 Dec 24 05:09:37.076973 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-cc4a1107-8f2b-4b72-9585-cacff4c0727a req-069b5250-48c9-4037-95b4-ce9934c4a414 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474422 Dec 24 05:09:37.859958 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9655cca9-d2fd-44f3-ae36-2e48bf44d08d req-00579d4e-1655-44d9-80d3-c91498b1edce tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:37.861949 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9655cca9-d2fd-44f3-ae36-2e48bf44d08d req-00579d4e-1655-44d9-80d3-c91498b1edce tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.46 "GET /v2.0/ports?device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 945 time: 0.0676053 Dec 24 05:09:37.960426 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-9655cca9-d2fd-44f3-ae36-2e48bf44d08d req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Deleting port f25ccd41-53b3-4bb9-84e1-824627c3e8e6 {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:09:37.961267 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-9655cca9-d2fd-44f3-ae36-2e48bf44d08d req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:38.057748 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-9655cca9-d2fd-44f3-ae36-2e48bf44d08d req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] For port f25ccd41-53b3-4bb9-84e1-824627c3e8e6, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=f25ccd41-53b3-4bb9-84e1-824627c3e8e6,segment=NetworkSegment(cb920e21-208e-474e-84a0-615ea3280b8a),segment_id=cb920e21-208e-474e-84a0-615ea3280b8a)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:09:38.058495 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-9655cca9-d2fd-44f3-ae36-2e48bf44d08d req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:38.198618 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f34f63cf-13a3-4cda-b379-f63f0678c7af req-5c0e83ba-2a70-41d9-a10c-cd90221d1708 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:38.200091 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f34f63cf-13a3-4cda-b379-f63f0678c7af req-5c0e83ba-2a70-41d9-a10c-cd90221d1708 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 945 time: 0.0500102 Dec 24 05:09:38.233773 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-9655cca9-d2fd-44f3-ae36-2e48bf44d08d req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:38.234116 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-9655cca9-d2fd-44f3-ae36-2e48bf44d08d req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-545804'] for floatingip, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:38.234452 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.l3_db [req-9655cca9-d2fd-44f3-ae36-2e48bf44d08d req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Floating IP 6fbeb9ef-353a-4f33-9ebc-492b12a0ebd9 disassociated. External IP: 172.27.1.207, port: f25ccd41-53b3-4bb9-84e1-824627c3e8e6. Dec 24 05:09:38.234790 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-9655cca9-d2fd-44f3-ae36-2e48bf44d08d req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling delete_port for f25ccd41-53b3-4bb9-84e1-824627c3e8e6 owned by compute:nova {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:09:38.250213 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f34f63cf-13a3-4cda-b379-f63f0678c7af req-48702736-5b52-420e-83a8-4850f0bddf00 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435243 Dec 24 05:09:38.376590 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-9655cca9-d2fd-44f3-ae36-2e48bf44d08d req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:38.404478 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Pushing event deleted for resources: {'Port': ['ID=f25ccd41-53b3-4bb9-84e1-824627c3e8e6,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:38.415091 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:38.415454 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:38.415795 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:38.416113 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:38.416444 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:38.416833 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:38.417154 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:38.417476 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:38.417805 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:38.418122 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:38.418440 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:38.418752 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:38.419052 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:38.540547 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [req-9655cca9-d2fd-44f3-ae36-2e48bf44d08d req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Router 9df11fe3-ba73-4793-a582-0e00f27a374d has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102476) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:09:38.656473 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-9655cca9-d2fd-44f3-ae36-2e48bf44d08d req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:09:38.668004 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbbf1097-b77a-4dfd-880b-f999eef54b68 None None] Sync routers for ids ['9df11fe3-ba73-4793-a582-0e00f27a374d'] in dv-cinder-816443-2-iscsi {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:09:38.678680 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbbf1097-b77a-4dfd-880b-f999eef54b68 None None] Routers {'9df11fe3-ba73-4793-a582-0e00f27a374d'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:09:38.679279 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-cbbf1097-b77a-4dfd-880b-f999eef54b68 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:09:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['9df11fe3-ba73-4793-a582-0e00f27a374d'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:09:38.695353 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-9655cca9-d2fd-44f3-ae36-2e48bf44d08d req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] No DVR routers for this DVR port f25ccd41-53b3-4bb9-84e1-824627c3e8e6 on host hv-cinder-81644 {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:09:38.697964 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-9655cca9-d2fd-44f3-ae36-2e48bf44d08d req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:38.701270 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9655cca9-d2fd-44f3-ae36-2e48bf44d08d req-8d5b5ff5-9e3c-4ce5-8143-6785cbb7be40 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.46 "DELETE /v2.0/ports/f25ccd41-53b3-4bb9-84e1-824627c3e8e6 HTTP/1.1" status: 204 len: 173 time: 0.8324673 Dec 24 05:09:38.701712 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd51afc95-dcbd-4ab4-9e4f-951d2dd7af88', 'name': 'network-vif-deleted', 'tag': 'f25ccd41-53b3-4bb9-84e1-824627c3e8e6'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:09:38.703953 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bc858dd5-a98a-4c34-8385-2977c3c7c344" -d '{"events": [{"server_uuid": "d51afc95-dcbd-4ab4-9e4f-951d2dd7af88", "name": "network-vif-deleted", "tag": "f25ccd41-53b3-4bb9-84e1-824627c3e8e6"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:09:38.742151 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:09:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9a99e702-c26c-4a9f-9bd4-7a000ad7495a x-openstack-request-id: req-9a99e702-c26c-4a9f-9bd4-7a000ad7495a {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:09:38.742503 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d51afc95-dcbd-4ab4-9e4f-951d2dd7af88", "name": "network-vif-deleted", "tag": "f25ccd41-53b3-4bb9-84e1-824627c3e8e6", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:09:38.742739 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-9a99e702-c26c-4a9f-9bd4-7a000ad7495a {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:09:38.743136 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd51afc95-dcbd-4ab4-9e4f-951d2dd7af88', 'name': 'network-vif-deleted', 'tag': 'f25ccd41-53b3-4bb9-84e1-824627c3e8e6', 'status': 'completed', 'code': 200} Dec 24 05:09:38.924219 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-cbbf1097-b77a-4dfd-880b-f999eef54b68 None None] Set router 9df11fe3-ba73-4793-a582-0e00f27a374d gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:09:39.131696 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-cbbf1097-b77a-4dfd-880b-f999eef54b68 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '826094e8-3c74-4e96-9507-84128f7209f1', 'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'mac_address': 'fa:16:3e:b3:73:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:21Z', 'updated_at': '2021-12-24T05:06:27Z', 'revision_number': 5, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'subnets': [{'id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:09:39.158960 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbbf1097-b77a-4dfd-880b-f999eef54b68 None None] Checking router: 9df11fe3-ba73-4793-a582-0e00f27a374d for host: dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:09:39.168359 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbbf1097-b77a-4dfd-880b-f999eef54b68 None None] Routers {'9df11fe3-ba73-4793-a582-0e00f27a374d'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:09:39.168995 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-cbbf1097-b77a-4dfd-880b-f999eef54b68 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:09:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['9df11fe3-ba73-4793-a582-0e00f27a374d'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:09:39.291878 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-cbbf1097-b77a-4dfd-880b-f999eef54b68 None None] Set router 9df11fe3-ba73-4793-a582-0e00f27a374d gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:09:39.361452 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c588da71-8afa-4d90-94da-52d0b6b4311a req-bcca7c07-de36-42b9-8f98-df2817cabc12 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=d51afc95-dcbd-4ab4-9e4f-951d2dd7af88 HTTP/1.1" status: 200 len: 210 time: 0.0260801 Dec 24 05:09:39.498084 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-cbbf1097-b77a-4dfd-880b-f999eef54b68 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '826094e8-3c74-4e96-9507-84128f7209f1', 'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'mac_address': 'fa:16:3e:b3:73:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:21Z', 'updated_at': '2021-12-24T05:06:27Z', 'revision_number': 5, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'subnets': [{'id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:09:39.526029 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbbf1097-b77a-4dfd-880b-f999eef54b68 None None] The sync data for ids ['9df11fe3-ba73-4793-a582-0e00f27a374d'] in dv-cinder-816443-2-iscsi is: [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '826094e8-3c74-4e96-9507-84128f7209f1', 'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'mac_address': 'fa:16:3e:b3:73:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:21Z', 'updated_at': '2021-12-24T05:06:27Z', 'revision_number': 5, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'subnets': [{'id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:09:39.755435 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1beaa802-59e8-49ea-bb97-dcb4e7621775 None None] New status for floating IP 6fbeb9ef-353a-4f33-9ebc-492b12a0ebd9: DOWN {{(pid=102479) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 24 05:09:40.583842 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-33a0ad16-3d57-42c8-9535-0c971a65f3eb tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2046201915&fields=id&tenant_id=8b1a80c6322a493ba10c69a77168b46f HTTP/1.1" status: 200 len: 267 time: 0.0466232 Dec 24 05:09:40.693627 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-cb452da4-bdee-46bd-b20e-14807b23f279 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:40.695097 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-cb452da4-bdee-46bd-b20e-14807b23f279 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/networks?id=df2331c3-0dd0-460e-980f-1e2409baa35e HTTP/1.1" status: 200 len: 810 time: 0.1017234 Dec 24 05:09:40.712358 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-5fee73f7-b4ec-42a0-94a0-9979fb8d04e9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/quotas/8b1a80c6322a493ba10c69a77168b46f HTTP/1.1" status: 200 len: 375 time: 0.0094471 Dec 24 05:09:40.763063 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-164e1aa1-fd89-41a8-bfe4-e0736b5dc2c8 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=8b1a80c6322a493ba10c69a77168b46f&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0455258 Dec 24 05:09:40.831796 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-2c5e82cd-7a56-4f6d-a8cd-b467176bfdf3 service neutron] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102477) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 24 05:09:40.833005 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-2c5e82cd-7a56-4f6d-a8cd-b467176bfdf3 service neutron] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0584376 Dec 24 05:09:40.860962 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device f25ccd41-53b3-4bb9-84e1-824627c3e8e6 no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:09:40.880584 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] No Port match for: f25ccd41-53b3-4bb9-84e1-824627c3e8e6 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:09:40.880950 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device f25ccd41-53b3-4bb9-84e1-824627c3e8e6 not bound to the agent host hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:09:40.930202 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-28de2667-da3f-40a6-96f5-d6b9fd21fb95 service neutron] 10.222.0.43 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0874159 Dec 24 05:09:41.025103 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-ee167b5b-05ea-4200-a901-4fc3ea05b228 service neutron] 10.222.0.43 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0886042 Dec 24 05:09:41.326933 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-961fcb28-74d6-4d84-84be-18c0f5258ffa req-a74d393b-c4ff-46e1-8363-95ee3a2a22ef tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 210 time: 0.0285559 Dec 24 05:09:42.201301 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d57fa499-dc26-404c-a2ea-bb9d0b59e791 req-ab85143d-c5c2-4ae1-96b2-8ebe4b4770b2 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1293532538&fields=id&tenant_id=f081e71a66b74c3bb12e1bec9d9a5cd1 HTTP/1.1" status: 200 len: 267 time: 0.0546420 Dec 24 05:09:42.259780 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d57fa499-dc26-404c-a2ea-bb9d0b59e791 req-b7b2d816-383a-44d1-948e-df8f8342ed83 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:42.261364 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d57fa499-dc26-404c-a2ea-bb9d0b59e791 req-b7b2d816-383a-44d1-948e-df8f8342ed83 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 984 time: 0.0527613 Dec 24 05:09:42.273417 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [req-d57fa499-dc26-404c-a2ea-bb9d0b59e791 req-558a08fc-fd2b-4029-80de-be5dde1228f9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Request body: {'port': {'security_groups': ['0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52']}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:09:42.342003 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [req-d57fa499-dc26-404c-a2ea-bb9d0b59e791 req-558a08fc-fd2b-4029-80de-be5dde1228f9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:42.452307 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3b758615-b060-4278-a548-af417eb3797a req-62fc2532-5d1e-4cf7-a3a5-92a88f5df75e tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 210 time: 0.0495064 Dec 24 05:09:42.522800 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-daccedb6-9254-45b4-bcc3-1c50a2d16d51 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:42.524517 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-daccedb6-9254-45b4-bcc3-1c50a2d16d51 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.46 "GET /v2.0/networks?id=df2331c3-0dd0-460e-980f-1e2409baa35e HTTP/1.1" status: 200 len: 810 time: 0.1313226 Dec 24 05:09:42.567756 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.db [req-d57fa499-dc26-404c-a2ea-bb9d0b59e791 req-558a08fc-fd2b-4029-80de-be5dde1228f9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] For port b8dc8fcb-f50d-49a3-9bd0-47110fdb068f, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=b8dc8fcb-f50d-49a3-9bd0-47110fdb068f,segment=NetworkSegment(2d8c6ac9-499a-46a9-971d-99edaae74aeb),segment_id=2d8c6ac9-499a-46a9-971d-99edaae74aeb)] {{(pid=102477) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:09:42.596920 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [req-d57fa499-dc26-404c-a2ea-bb9d0b59e791 req-558a08fc-fd2b-4029-80de-be5dde1228f9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for port, precommit_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:42.602440 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [req-d57fa499-dc26-404c-a2ea-bb9d0b59e791 req-558a08fc-fd2b-4029-80de-be5dde1228f9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29535615'] for port, after_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:42.616175 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-6634964e-bcd7-497f-8f69-ffc31543fee7 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.46 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8b1a80c6322a493ba10c69a77168b46f HTTP/1.1" status: 200 len: 380 time: 0.0572891 Dec 24 05:09:42.627278 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-0fd31671-1cf9-46fb-89c6-3074e516083a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Request body: {'port': {'device_id': '067b7d98-4174-409c-85af-47a2dbf63a71', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'admin_state_up': True, 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'security_groups': ['b4b0be72-ffa9-4e18-8986-808181a3a50d']}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:09:42.638521 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['b8dc8fcb-f50d-49a3-9bd0-47110fdb068f'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:09:42.649587 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d57fa499-dc26-404c-a2ea-bb9d0b59e791 req-558a08fc-fd2b-4029-80de-be5dde1228f9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:42.650804 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [req-d57fa499-dc26-404c-a2ea-bb9d0b59e791 req-558a08fc-fd2b-4029-80de-be5dde1228f9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:42.655536 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d57fa499-dc26-404c-a2ea-bb9d0b59e791 req-558a08fc-fd2b-4029-80de-be5dde1228f9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "PUT /v2.0/ports/b8dc8fcb-f50d-49a3-9bd0-47110fdb068f HTTP/1.1" status: 200 len: 942 time: 0.3872571 Dec 24 05:09:42.656029 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ae7a102d-4793-4384-bc31-07d28018c9df', 'tag': 'b8dc8fcb-f50d-49a3-9bd0-47110fdb068f'}] {{(pid=102477) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:09:42.658400 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d3e3d7a262849d185e72ba84ca6adca9bb1fee52649b04b101352e7e29a99ca8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aaa73d63-986f-402c-a8df-1a191c1af3a3" -d '{"events": [{"name": "network-changed", "server_uuid": "ae7a102d-4793-4384-bc31-07d28018c9df", "tag": "b8dc8fcb-f50d-49a3-9bd0-47110fdb068f"}]}' {{(pid=102477) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:09:42.663247 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34088) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:09:42.708350 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-558a08fc-fd2b-4029-80de-be5dde1228f9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Pushing event updated for resources: {'Port': ['ID=b8dc8fcb-f50d-49a3-9bd0-47110fdb068f,revision_number=7']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:42.715707 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:09:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-231756c8-bebd-4368-a774-04e7b2273d13 x-openstack-request-id: req-231756c8-bebd-4368-a774-04e7b2273d13 {{(pid=102477) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:09:42.715987 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ae7a102d-4793-4384-bc31-07d28018c9df", "tag": "b8dc8fcb-f50d-49a3-9bd0-47110fdb068f", "status": "completed", "code": 200}]} {{(pid=102477) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:09:42.716236 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-231756c8-bebd-4368-a774-04e7b2273d13 {{(pid=102477) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:09:42.716768 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ae7a102d-4793-4384-bc31-07d28018c9df', 'tag': 'b8dc8fcb-f50d-49a3-9bd0-47110fdb068f', 'status': 'completed', 'code': 200} Dec 24 05:09:42.726855 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558a08fc-fd2b-4029-80de-be5dde1228f9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:42.727205 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558a08fc-fd2b-4029-80de-be5dde1228f9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:42.727542 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558a08fc-fd2b-4029-80de-be5dde1228f9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:42.728344 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558a08fc-fd2b-4029-80de-be5dde1228f9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:42.728344 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558a08fc-fd2b-4029-80de-be5dde1228f9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:42.728555 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558a08fc-fd2b-4029-80de-be5dde1228f9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:42.728852 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558a08fc-fd2b-4029-80de-be5dde1228f9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:42.729177 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558a08fc-fd2b-4029-80de-be5dde1228f9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:42.729503 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558a08fc-fd2b-4029-80de-be5dde1228f9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:42.729829 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558a08fc-fd2b-4029-80de-be5dde1228f9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:42.730151 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558a08fc-fd2b-4029-80de-be5dde1228f9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:42.731219 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558a08fc-fd2b-4029-80de-be5dde1228f9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:42.731219 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-558a08fc-fd2b-4029-80de-be5dde1228f9 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:42.757801 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-09be005a-e7ce-4274-893e-599376181238 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:42.778023 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['b8dc8fcb-f50d-49a3-9bd0-47110fdb068f'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:09:42.789833 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-09be005a-e7ce-4274-893e-599376181238 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:42.817757 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaa73d63-986f-402c-a8df-1a191c1af3a3 req-5c8dbd22-da5c-4f5d-95e6-e9314e1828f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:42.821403 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aaa73d63-986f-402c-a8df-1a191c1af3a3 req-5c8dbd22-da5c-4f5d-95e6-e9314e1828f5 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=f081e71a66b74c3bb12e1bec9d9a5cd1&device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 1098 time: 0.0619764 Dec 24 05:09:42.860691 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-0fd31671-1cf9-46fb-89c6-3074e516083a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Made reservation on behalf of 8b1a80c6322a493ba10c69a77168b46f for: {'port': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:09:42.865195 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-0fd31671-1cf9-46fb-89c6-3074e516083a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:42.868403 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-09be005a-e7ce-4274-893e-599376181238 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:42.876480 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-09be005a-e7ce-4274-893e-599376181238 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:42.879384 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-09be005a-e7ce-4274-893e-599376181238 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "DELETE /v2.0/security-groups/bc3c93b3-eec1-4f52-a952-c229f892877e HTTP/1.1" status: 204 len: 168 time: 0.2147920 Dec 24 05:09:42.884899 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34092) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:09:42.940937 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09be005a-e7ce-4274-893e-599376181238 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=bc3c93b3-eec1-4f52-a952-c229f892877e,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:43.010231 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaa73d63-986f-402c-a8df-1a191c1af3a3 req-7c41ce27-a346-47d8-91f2-bb5c95a07bec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:43.012231 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aaa73d63-986f-402c-a8df-1a191c1af3a3 req-7c41ce27-a346-47d8-91f2-bb5c95a07bec service neutron] 10.222.0.46 "GET /v2.0/networks?id=f6c8eead-66df-4cba-abce-78ee3b037ee2 HTTP/1.1" status: 200 len: 915 time: 0.1807270 Dec 24 05:09:43.016787 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-78ea399a-7f51-455b-91a3-49bdc9ad7897 None None] Provisioning complete for port b8dc8fcb-f50d-49a3-9bd0-47110fdb068f triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:09:43.016787 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-78ea399a-7f51-455b-91a3-49bdc9ad7897 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:43.088598 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-5223e630-41bb-4399-9f29-2f2c6e91ac50 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Deleting port 88bb6525-2923-4cd6-8cca-8ee494b8d0a9 {{(pid=102477) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:09:43.089165 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-5223e630-41bb-4399-9f29-2f2c6e91ac50 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:43.129163 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-0fd31671-1cf9-46fb-89c6-3074e516083a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Allocated IP 172.20.0.13 (df2331c3-0dd0-460e-980f-1e2409baa35e/9df81c69-0712-4247-ad21-3b3a089ce4b5/4f943d44-a70c-4b88-9cac-b16783cab1e5) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:09:43.138155 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aaa73d63-986f-402c-a8df-1a191c1af3a3 req-b46c0db9-4b48-4db6-8b9e-0244b682423c service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b8dc8fcb-f50d-49a3-9bd0-47110fdb068f HTTP/1.1" status: 200 len: 1000 time: 0.1154454 Dec 24 05:09:43.176871 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-5223e630-41bb-4399-9f29-2f2c6e91ac50 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:43.177331 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-5223e630-41bb-4399-9f29-2f2c6e91ac50 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:43.191873 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-5223e630-41bb-4399-9f29-2f2c6e91ac50 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling delete_port for 88bb6525-2923-4cd6-8cca-8ee494b8d0a9 owned by network:floatingip {{(pid=102477) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:09:43.226164 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaa73d63-986f-402c-a8df-1a191c1af3a3 req-bf9e010b-9da8-4d86-a83f-454f34c34309 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:43.227633 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aaa73d63-986f-402c-a8df-1a191c1af3a3 req-bf9e010b-9da8-4d86-a83f-454f34c34309 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=11836946-2718-402d-9e36-6ad89714906f HTTP/1.1" status: 200 len: 853 time: 0.0820825 Dec 24 05:09:43.323917 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaa73d63-986f-402c-a8df-1a191c1af3a3 req-47778a44-b3d9-4d2a-9f13-418421f5afbb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:43.325543 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aaa73d63-986f-402c-a8df-1a191c1af3a3 req-47778a44-b3d9-4d2a-9f13-418421f5afbb service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=f6c8eead-66df-4cba-abce-78ee3b037ee2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0884609 Dec 24 05:09:43.371188 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-5223e630-41bb-4399-9f29-2f2c6e91ac50 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:43.372881 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-0fd31671-1cf9-46fb-89c6-3074e516083a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:43.394702 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5223e630-41bb-4399-9f29-2f2c6e91ac50 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Pushing event deleted for resources: {'Port': ['ID=88bb6525-2923-4cd6-8cca-8ee494b8d0a9,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:43.453813 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aaa73d63-986f-402c-a8df-1a191c1af3a3 req-c30aafdb-9145-4e96-b9ef-e3fbbc970c2c service neutron] 10.222.0.46 "GET /v2.0/networks/f6c8eead-66df-4cba-abce-78ee3b037ee2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1169643 Dec 24 05:09:43.459614 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-0fd31671-1cf9-46fb-89c6-3074e516083a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:43.467680 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-5223e630-41bb-4399-9f29-2f2c6e91ac50 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks [] for floatingip, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:43.468008 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.db.l3_db [None req-5223e630-41bb-4399-9f29-2f2c6e91ac50 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Floating IP 17ceaa33-3c33-43ef-a6f5-a82143007f2e disassociated (deleted). External IP: 172.27.1.21, port: b8dc8fcb-f50d-49a3-9bd0-47110fdb068f. Dec 24 05:09:43.532062 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-0fd31671-1cf9-46fb-89c6-3074e516083a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Network df2331c3-0dd0-460e-980f-1e2409baa35e is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:09:43.563861 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-0fd31671-1cf9-46fb-89c6-3074e516083a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:09:43.569078 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-0fd31671-1cf9-46fb-89c6-3074e516083a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:09:43.597550 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fd31671-1cf9-46fb-89c6-3074e516083a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Pushing event updated for resources: {'Port': ['ID=4f943d44-a70c-4b88-9cac-b16783cab1e5,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:43.626821 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae504dee-fcc1-4321-8223-9775fddbbe85 req-b73eaabc-f9e9-4e2c-929c-8c4043e86ffc tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:43.628277 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ae504dee-fcc1-4321-8223-9775fddbbe85 req-b73eaabc-f9e9-4e2c-929c-8c4043e86ffc tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 932 time: 0.0715511 Dec 24 05:09:43.635649 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aaa73d63-986f-402c-a8df-1a191c1af3a3 req-0a57b0ca-03a9-4e47-89a9-4165f2fde3f3 service neutron] 10.222.0.46 "GET /v2.0/networks/f6c8eead-66df-4cba-abce-78ee3b037ee2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1736889 Dec 24 05:09:43.641399 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-0fd31671-1cf9-46fb-89c6-3074e516083a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:43.642010 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-0fd31671-1cf9-46fb-89c6-3074e516083a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:43.662020 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-0fd31671-1cf9-46fb-89c6-3074e516083a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.46 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0389645 Dec 24 05:09:43.681062 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-a3a581d1-6c61-4263-a70e-df042955e5b0 service neutron] Request body: {'port': {'device_id': '067b7d98-4174-409c-85af-47a2dbf63a71', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81644'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:09:43.742663 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-a3a581d1-6c61-4263-a70e-df042955e5b0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:43.757515 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ae504dee-fcc1-4321-8223-9775fddbbe85 req-41e98479-62e5-44bb-8e25-eb97bd218c93 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0931964 Dec 24 05:09:43.777515 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5223e630-41bb-4399-9f29-2f2c6e91ac50 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Router a17d8253-42dc-43b3-b8fe-d8352c4bfc8f has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102477) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:09:43.842834 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-41c02062-ae4d-4f93-8ebc-2e8b59dd32d6 None None] Provisioning complete for port 4f943d44-a70c-4b88-9cac-b16783cab1e5 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:09:43.844102 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-41c02062-ae4d-4f93-8ebc-2e8b59dd32d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:43.883452 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-41c02062-ae4d-4f93-8ebc-2e8b59dd32d6 None None] Port 4f943d44-a70c-4b88-9cac-b16783cab1e5 cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 05:09:43.894105 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5223e630-41bb-4399-9f29-2f2c6e91ac50 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102477) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:09:43.899257 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-5223e630-41bb-4399-9f29-2f2c6e91ac50 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for floatingip, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:43.904951 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0adf389-6b39-49de-a757-54e452a4c7a1 None None] Sync routers for ids ['a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'] in dv-cinder-816443-2-iscsi {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:09:43.915360 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0adf389-6b39-49de-a757-54e452a4c7a1 None None] Routers {'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:09:43.916111 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-b0adf389-6b39-49de-a757-54e452a4c7a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:09:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:09:43.929826 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-5223e630-41bb-4399-9f29-2f2c6e91ac50 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "DELETE /v2.0/floatingips/17ceaa33-3c33-43ef-a6f5-a82143007f2e HTTP/1.1" status: 204 len: 168 time: 1.0406928 Dec 24 05:09:44.028247 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-b0adf389-6b39-49de-a757-54e452a4c7a1 None None] Set router a17d8253-42dc-43b3-b8fe-d8352c4bfc8f gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:09:44.035278 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-a3a581d1-6c61-4263-a70e-df042955e5b0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4f943d44-a70c-4b88-9cac-b16783cab1e5 {{(pid=102476) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:09:44.043530 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-a3a581d1-6c61-4263-a70e-df042955e5b0 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:44.057991 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.provisioning_blocks [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-a3a581d1-6c61-4263-a70e-df042955e5b0 service neutron] Transition to ACTIVE for port object 4f943d44-a70c-4b88-9cac-b16783cab1e5 will not be triggered until provisioned by entity L2. {{(pid=102476) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 24 05:09:44.063386 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-a3a581d1-6c61-4263-a70e-df042955e5b0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:44.124742 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3a581d1-6c61-4263-a70e-df042955e5b0 service neutron] Pushing event updated for resources: {'Port': ['ID=4f943d44-a70c-4b88-9cac-b16783cab1e5,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:44.228197 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-a3a581d1-6c61-4263-a70e-df042955e5b0 service neutron] Attempting to bind port 4f943d44-a70c-4b88-9cac-b16783cab1e5 on host hv-cinder-81644 for vnic_type normal with profile {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:09:44.228555 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-a3a581d1-6c61-4263-a70e-df042955e5b0 service neutron] Attempting to bind port 4f943d44-a70c-4b88-9cac-b16783cab1e5 by drivers openvswitch,hyperv on host hv-cinder-81644 at level 0 using segments [{'id': 'cb920e21-208e-474e-84a0-615ea3280b8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e'}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:09:44.231048 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-a3a581d1-6c61-4263-a70e-df042955e5b0 service neutron] Attempting to bind port 4f943d44-a70c-4b88-9cac-b16783cab1e5 on network df2331c3-0dd0-460e-980f-1e2409baa35e {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:09:44.241536 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-a3a581d1-6c61-4263-a70e-df042955e5b0 service neutron] Port 4f943d44-a70c-4b88-9cac-b16783cab1e5 on network df2331c3-0dd0-460e-980f-1e2409baa35e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81644 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 24 05:09:44.242170 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-a3a581d1-6c61-4263-a70e-df042955e5b0 service neutron] Attempting to bind port 4f943d44-a70c-4b88-9cac-b16783cab1e5 on network df2331c3-0dd0-460e-980f-1e2409baa35e {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:09:44.249861 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-a3a581d1-6c61-4263-a70e-df042955e5b0 service neutron] Checking agent: {'id': '7a2ffd19-371f-4f7b-a239-eea3b5cfd55b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81644', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'started_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 9, 20), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:09:44.250542 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-a3a581d1-6c61-4263-a70e-df042955e5b0 service neutron] Checking segment: {'id': 'cb920e21-208e-474e-84a0-615ea3280b8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:09:44.251381 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-a3a581d1-6c61-4263-a70e-df042955e5b0 service neutron] Bound using segment: {'id': 'cb920e21-208e-474e-84a0-615ea3280b8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e'} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:09:44.254694 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-a3a581d1-6c61-4263-a70e-df042955e5b0 service neutron] Bound port: 4f943d44-a70c-4b88-9cac-b16783cab1e5, host: hv-cinder-81644, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'cb920e21-208e-474e-84a0-615ea3280b8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e'}}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:09:44.254694 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-a3a581d1-6c61-4263-a70e-df042955e5b0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:44.274756 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-b0adf389-6b39-49de-a757-54e452a4c7a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'name': 'tempest-TestMinimumBasicScenario-953343402-router', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248'}], 'enable_snat': True}, 'gw_port_id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:01Z', 'updated_at': '2021-12-24T05:06:04Z', 'revision_number': 4, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'gw_port': {'id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:e8:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 488, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:02Z', 'updated_at': '2021-12-24T05:06:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '6dd40189-9984-4e72-8831-3e9d864c65b9', 'name': '', 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'mac_address': 'fa:16:3e:cf:37:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '11836946-2718-402d-9e36-6ad89714906f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:04Z', 'updated_at': '2021-12-24T05:06:09Z', 'revision_number': 5, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'subnets': [{'id': '11836946-2718-402d-9e36-6ad89714906f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:09:44.301299 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0adf389-6b39-49de-a757-54e452a4c7a1 None None] Checking router: a17d8253-42dc-43b3-b8fe-d8352c4bfc8f for host: dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:09:44.310075 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0adf389-6b39-49de-a757-54e452a4c7a1 None None] Routers {'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:09:44.310709 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-b0adf389-6b39-49de-a757-54e452a4c7a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:09:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:09:44.321902 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-a3a581d1-6c61-4263-a70e-df042955e5b0 service neutron] For port 4f943d44-a70c-4b88-9cac-b16783cab1e5, host hv-cinder-81644, cleared binding levels {{(pid=102476) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:09:44.325818 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-a3a581d1-6c61-4263-a70e-df042955e5b0 service neutron] For port 4f943d44-a70c-4b88-9cac-b16783cab1e5, host hv-cinder-81644, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=4f943d44-a70c-4b88-9cac-b16783cab1e5,segment=NetworkSegment(cb920e21-208e-474e-84a0-615ea3280b8a),segment_id=cb920e21-208e-474e-84a0-615ea3280b8a)] {{(pid=102476) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:09:44.331566 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-a3a581d1-6c61-4263-a70e-df042955e5b0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:44.367476 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-a3a581d1-6c61-4263-a70e-df042955e5b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:44.368102 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-a3a581d1-6c61-4263-a70e-df042955e5b0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:44.369522 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-a3a581d1-6c61-4263-a70e-df042955e5b0 service neutron] 10.222.0.46 "PUT /v2.0/ports/4f943d44-a70c-4b88-9cac-b16783cab1e5 HTTP/1.1" status: 200 len: 1094 time: 0.6929233 Dec 24 05:09:44.369949 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '067b7d98-4174-409c-85af-47a2dbf63a71', 'tag': '4f943d44-a70c-4b88-9cac-b16783cab1e5'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:09:44.372236 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3ebf67cc-2b02-4d0d-be21-5f5a9cbada4f" -d '{"events": [{"name": "network-changed", "server_uuid": "067b7d98-4174-409c-85af-47a2dbf63a71", "tag": "4f943d44-a70c-4b88-9cac-b16783cab1e5"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:09:44.395249 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3a581d1-6c61-4263-a70e-df042955e5b0 service neutron] Pushing event updated for resources: {'Port': ['ID=4f943d44-a70c-4b88-9cac-b16783cab1e5,revision_number=3']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:44.440057 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-b0adf389-6b39-49de-a757-54e452a4c7a1 None None] Set router a17d8253-42dc-43b3-b8fe-d8352c4bfc8f gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:09:44.442674 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:09:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8fbd592d-d82c-4f9a-8190-5b0bf8bf61a1 x-openstack-request-id: req-8fbd592d-d82c-4f9a-8190-5b0bf8bf61a1 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:09:44.442674 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "067b7d98-4174-409c-85af-47a2dbf63a71", "tag": "4f943d44-a70c-4b88-9cac-b16783cab1e5", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:09:44.442924 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-8fbd592d-d82c-4f9a-8190-5b0bf8bf61a1 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:09:44.443869 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '067b7d98-4174-409c-85af-47a2dbf63a71', 'tag': '4f943d44-a70c-4b88-9cac-b16783cab1e5', 'status': 'completed', 'code': 200} Dec 24 05:09:44.499176 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-58b73435-20d8-4057-9264-2053f26eb232 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:44.500833 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-58b73435-20d8-4057-9264-2053f26eb232 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=8b1a80c6322a493ba10c69a77168b46f&device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 1097 time: 0.0428822 Dec 24 05:09:44.554752 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-24f36ccc-2725-443c-9575-69caa803aff3 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4f943d44-a70c-4b88-9cac-b16783cab1e5 HTTP/1.1" status: 200 len: 217 time: 0.0392103 Dec 24 05:09:44.618590 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-edd669e7-2c88-432b-8d80-b722bdc1c09c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:44.619974 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-edd669e7-2c88-432b-8d80-b722bdc1c09c service neutron] 10.222.0.46 "GET /v2.0/subnets?id=9df81c69-0712-4247-ad21-3b3a089ce4b5 HTTP/1.1" status: 200 len: 849 time: 0.0442452 Dec 24 05:09:44.662430 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-b0adf389-6b39-49de-a757-54e452a4c7a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'name': 'tempest-TestMinimumBasicScenario-953343402-router', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248'}], 'enable_snat': True}, 'gw_port_id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:01Z', 'updated_at': '2021-12-24T05:06:04Z', 'revision_number': 4, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'gw_port': {'id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:e8:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 488, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:02Z', 'updated_at': '2021-12-24T05:06:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '6dd40189-9984-4e72-8831-3e9d864c65b9', 'name': '', 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'mac_address': 'fa:16:3e:cf:37:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '11836946-2718-402d-9e36-6ad89714906f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:04Z', 'updated_at': '2021-12-24T05:06:09Z', 'revision_number': 5, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'subnets': [{'id': '11836946-2718-402d-9e36-6ad89714906f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:09:44.680073 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-0b8d2794-d6a2-4238-9a47-e23a6ac82280 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:44.681635 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-0b8d2794-d6a2-4238-9a47-e23a6ac82280 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=df2331c3-0dd0-460e-980f-1e2409baa35e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0411532 Dec 24 05:09:44.689922 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0adf389-6b39-49de-a757-54e452a4c7a1 None None] The sync data for ids ['a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'] in dv-cinder-816443-2-iscsi is: [{'id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'name': 'tempest-TestMinimumBasicScenario-953343402-router', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248'}], 'enable_snat': True}, 'gw_port_id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:01Z', 'updated_at': '2021-12-24T05:06:04Z', 'revision_number': 4, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'gw_port': {'id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:e8:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 488, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:02Z', 'updated_at': '2021-12-24T05:06:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '6dd40189-9984-4e72-8831-3e9d864c65b9', 'name': '', 'network_id': 'f6c8eead-66df-4cba-abce-78ee3b037ee2', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'mac_address': 'fa:16:3e:cf:37:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '11836946-2718-402d-9e36-6ad89714906f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:04Z', 'updated_at': '2021-12-24T05:06:09Z', 'revision_number': 5, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'subnets': [{'id': '11836946-2718-402d-9e36-6ad89714906f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:09:44.718225 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ae7a102d-4793-4384-bc31-07d28018c9df', 'tag': 'b8dc8fcb-f50d-49a3-9bd0-47110fdb068f'}] {{(pid=102477) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:09:44.721362 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d3e3d7a262849d185e72ba84ca6adca9bb1fee52649b04b101352e7e29a99ca8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ecb760f8-8c73-44a4-946d-7d9a39ca3bdc" -d '{"events": [{"name": "network-changed", "server_uuid": "ae7a102d-4793-4384-bc31-07d28018c9df", "tag": "b8dc8fcb-f50d-49a3-9bd0-47110fdb068f"}]}' {{(pid=102477) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:09:44.762838 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:09:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-322e8b96-c04a-4770-993d-06c50ca29f26 x-openstack-request-id: req-322e8b96-c04a-4770-993d-06c50ca29f26 {{(pid=102477) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:09:44.763128 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ae7a102d-4793-4384-bc31-07d28018c9df", "tag": "b8dc8fcb-f50d-49a3-9bd0-47110fdb068f", "status": "completed", "code": 200}]} {{(pid=102477) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:09:44.763376 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-322e8b96-c04a-4770-993d-06c50ca29f26 {{(pid=102477) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:09:44.763795 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ae7a102d-4793-4384-bc31-07d28018c9df', 'tag': 'b8dc8fcb-f50d-49a3-9bd0-47110fdb068f', 'status': 'completed', 'code': 200} Dec 24 05:09:44.784950 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-180d5924-06ac-4c80-9846-15dfa8e0d2c6 service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0951796 Dec 24 05:09:44.932029 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76e73229-8a62-4c93-b4ac-109d8aeec15d None None] New status for floating IP 17ceaa33-3c33-43ef-a6f5-a82143007f2e: DOWN {{(pid=102479) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 24 05:09:44.961479 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecb760f8-8c73-44a4-946d-7d9a39ca3bdc req-f9bf8836-da42-42e5-b4ae-2acd98ddb731 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:44.963015 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ecb760f8-8c73-44a4-946d-7d9a39ca3bdc req-f9bf8836-da42-42e5-b4ae-2acd98ddb731 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=f081e71a66b74c3bb12e1bec9d9a5cd1&device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 1098 time: 0.1412001 Dec 24 05:09:44.970396 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6f65114a-60ba-4f66-8254-488e97036ed9 req-8d2d3de3-4aff-4d00-a1cf-99594f8f27c5 service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1588030 Dec 24 05:09:44.985846 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61ed0491-a1ce-4218-a02b-2beca4f49931 req-0f5bbdcf-0678-4b52-a447-d0901eddcce5 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:44.987353 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-61ed0491-a1ce-4218-a02b-2beca4f49931 req-0f5bbdcf-0678-4b52-a447-d0901eddcce5 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 944 time: 0.1443481 Dec 24 05:09:45.119410 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-61ed0491-a1ce-4218-a02b-2beca4f49931 req-7c576ef0-125a-423a-96c6-dcac18a5417c tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1205695 Dec 24 05:09:45.127669 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecb760f8-8c73-44a4-946d-7d9a39ca3bdc req-ad1de84e-bdca-44ed-9ca8-abfcf05d48ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:45.129151 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ecb760f8-8c73-44a4-946d-7d9a39ca3bdc req-ad1de84e-bdca-44ed-9ca8-abfcf05d48ef service neutron] 10.222.0.46 "GET /v2.0/networks?id=f6c8eead-66df-4cba-abce-78ee3b037ee2 HTTP/1.1" status: 200 len: 915 time: 0.1572659 Dec 24 05:09:45.149054 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ebf67cc-2b02-4d0d-be21-5f5a9cbada4f req-7bc5b7ea-07d5-4974-9715-f1cd4720d4ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:45.150539 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3ebf67cc-2b02-4d0d-be21-5f5a9cbada4f req-7bc5b7ea-07d5-4974-9715-f1cd4720d4ae service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=8b1a80c6322a493ba10c69a77168b46f&device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 1097 time: 0.0714221 Dec 24 05:09:45.185108 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ecb760f8-8c73-44a4-946d-7d9a39ca3bdc req-fd4b1fad-2a1a-4f25-b64e-6129d88d05e8 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b8dc8fcb-f50d-49a3-9bd0-47110fdb068f HTTP/1.1" status: 200 len: 217 time: 0.0469108 Dec 24 05:09:45.284360 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecb760f8-8c73-44a4-946d-7d9a39ca3bdc req-d7a209e5-7d2e-482f-9295-40af0174fdb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:45.285906 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ecb760f8-8c73-44a4-946d-7d9a39ca3bdc req-d7a209e5-7d2e-482f-9295-40af0174fdb6 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=11836946-2718-402d-9e36-6ad89714906f HTTP/1.1" status: 200 len: 853 time: 0.0898623 Dec 24 05:09:45.326395 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ebf67cc-2b02-4d0d-be21-5f5a9cbada4f req-1ae0658f-273a-4612-94e2-58442f1e1a19 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:45.327919 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3ebf67cc-2b02-4d0d-be21-5f5a9cbada4f req-1ae0658f-273a-4612-94e2-58442f1e1a19 service neutron] 10.222.0.46 "GET /v2.0/networks?id=df2331c3-0dd0-460e-980f-1e2409baa35e HTTP/1.1" status: 200 len: 911 time: 0.1510165 Dec 24 05:09:45.650969 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3ebf67cc-2b02-4d0d-be21-5f5a9cbada4f req-e4be500f-0f18-4d9d-8a9d-39b04dad1fac service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4f943d44-a70c-4b88-9cac-b16783cab1e5 HTTP/1.1" status: 200 len: 217 time: 0.3128588 Dec 24 05:09:45.652774 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecb760f8-8c73-44a4-946d-7d9a39ca3bdc req-6245b25a-1b0d-40d6-a8c4-d8a53d2c1fef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:45.654162 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ecb760f8-8c73-44a4-946d-7d9a39ca3bdc req-6245b25a-1b0d-40d6-a8c4-d8a53d2c1fef service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=f6c8eead-66df-4cba-abce-78ee3b037ee2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.3589022 Dec 24 05:09:45.757089 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ebf67cc-2b02-4d0d-be21-5f5a9cbada4f req-d4c85bdb-3b48-4223-a33f-b84a8fd9167f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:45.758597 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3ebf67cc-2b02-4d0d-be21-5f5a9cbada4f req-d4c85bdb-3b48-4223-a33f-b84a8fd9167f service neutron] 10.222.0.46 "GET /v2.0/subnets?id=9df81c69-0712-4247-ad21-3b3a089ce4b5 HTTP/1.1" status: 200 len: 849 time: 0.0935700 Dec 24 05:09:45.808462 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ecb760f8-8c73-44a4-946d-7d9a39ca3bdc req-113fe28f-5077-4b98-b3e2-33796066727e service neutron] 10.222.0.46 "GET /v2.0/networks/f6c8eead-66df-4cba-abce-78ee3b037ee2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1422720 Dec 24 05:09:45.820277 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ebf67cc-2b02-4d0d-be21-5f5a9cbada4f req-41354a1c-c3f4-4cb1-a648-d9f686dcfb8b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:45.821896 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3ebf67cc-2b02-4d0d-be21-5f5a9cbada4f req-41354a1c-c3f4-4cb1-a648-d9f686dcfb8b service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=df2331c3-0dd0-460e-980f-1e2409baa35e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0553608 Dec 24 05:09:45.972809 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ecb760f8-8c73-44a4-946d-7d9a39ca3bdc req-c416f0e6-f983-4ff4-ba4d-cde7f1c5d178 service neutron] 10.222.0.46 "GET /v2.0/networks/f6c8eead-66df-4cba-abce-78ee3b037ee2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1497352 Dec 24 05:09:45.976176 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3ebf67cc-2b02-4d0d-be21-5f5a9cbada4f req-2709574b-4a37-48c6-bc75-e050c89f2c6e service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1449997 Dec 24 05:09:46.083094 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3ebf67cc-2b02-4d0d-be21-5f5a9cbada4f req-4241f42b-14bb-4cf1-a316-e3082d24eebc service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0856144 Dec 24 05:09:46.272982 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c82cd43-b78d-4766-ab88-fb0ac2351970 req-88df8ed9-89c7-454c-93ea-1bb1267b74aa tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:46.274374 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1c82cd43-b78d-4766-ab88-fb0ac2351970 req-88df8ed9-89c7-454c-93ea-1bb1267b74aa tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 944 time: 0.0555034 Dec 24 05:09:46.325774 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1c82cd43-b78d-4766-ab88-fb0ac2351970 req-90153666-cc58-42ce-900e-d013892aa118 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426710 Dec 24 05:09:46.773387 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37b37775-15eb-4c6f-b9f8-bfda20eb4fb7 req-180509ef-761b-44da-aa00-2bb8ddfc3b9c tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:46.774854 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-37b37775-15eb-4c6f-b9f8-bfda20eb4fb7 req-180509ef-761b-44da-aa00-2bb8ddfc3b9c tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 945 time: 0.0536666 Dec 24 05:09:46.822890 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-37b37775-15eb-4c6f-b9f8-bfda20eb4fb7 req-fb943485-03e7-4d8e-a744-953810cd8533 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419772 Dec 24 05:09:47.448571 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93163977-691e-4fbe-baf6-18217ec44b89 req-6ed78b79-1c9e-4a58-bdcd-cb4267ee5043 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:47.450091 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-93163977-691e-4fbe-baf6-18217ec44b89 req-6ed78b79-1c9e-4a58-bdcd-cb4267ee5043 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 944 time: 0.0537286 Dec 24 05:09:47.500883 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-93163977-691e-4fbe-baf6-18217ec44b89 req-33bb26f6-8263-4ad2-81b5-8d52913cfde9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445545 Dec 24 05:09:47.952873 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5a04c6f-52f0-41b6-b052-7e9b42168e70 req-732ab84c-cb60-4a67-8eaf-0c00b8645aac tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:47.954333 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c5a04c6f-52f0-41b6-b052-7e9b42168e70 req-732ab84c-cb60-4a67-8eaf-0c00b8645aac tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 945 time: 0.0505939 Dec 24 05:09:48.005207 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c5a04c6f-52f0-41b6-b052-7e9b42168e70 req-9373416d-f25c-476b-bf14-916bffb8584d tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446458 Dec 24 05:09:48.637542 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1889e037-9edc-4b60-8c86-7602551ad12b req-564a339c-6140-433c-9c96-32d2c733b0e3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:48.638935 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1889e037-9edc-4b60-8c86-7602551ad12b req-564a339c-6140-433c-9c96-32d2c733b0e3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 944 time: 0.0648625 Dec 24 05:09:48.691771 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1889e037-9edc-4b60-8c86-7602551ad12b req-796e218d-3088-4ce5-8d4d-a947767a15b2 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436015 Dec 24 05:09:48.801841 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e09df64-016c-46c0-afc6-a3a6940dd13d req-9508f628-75f0-432f-bfe4-da8c7e175728 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:48.803351 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9e09df64-016c-46c0-afc6-a3a6940dd13d req-9508f628-75f0-432f-bfe4-da8c7e175728 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.46 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 945 time: 0.0612032 Dec 24 05:09:48.895108 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-9e09df64-016c-46c0-afc6-a3a6940dd13d req-735f9c44-8353-4ab4-8360-e94d574fa147 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Deleting port b8dc8fcb-f50d-49a3-9bd0-47110fdb068f {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:09:48.895348 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-9e09df64-016c-46c0-afc6-a3a6940dd13d req-735f9c44-8353-4ab4-8360-e94d574fa147 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:49.003206 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-9e09df64-016c-46c0-afc6-a3a6940dd13d req-735f9c44-8353-4ab4-8360-e94d574fa147 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] For port b8dc8fcb-f50d-49a3-9bd0-47110fdb068f, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=b8dc8fcb-f50d-49a3-9bd0-47110fdb068f,segment=NetworkSegment(2d8c6ac9-499a-46a9-971d-99edaae74aeb),segment_id=2d8c6ac9-499a-46a9-971d-99edaae74aeb)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:09:49.003576 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-9e09df64-016c-46c0-afc6-a3a6940dd13d req-735f9c44-8353-4ab4-8360-e94d574fa147 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:49.016855 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-9e09df64-016c-46c0-afc6-a3a6940dd13d req-735f9c44-8353-4ab4-8360-e94d574fa147 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Calling delete_port for b8dc8fcb-f50d-49a3-9bd0-47110fdb068f owned by compute:nova {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:09:49.126071 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af5b4f2d-8fd0-4e1b-b0c1-3808786a8444 req-ac984265-ee4a-400c-adde-a5f43687117b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:49.127687 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-af5b4f2d-8fd0-4e1b-b0c1-3808786a8444 req-ac984265-ee4a-400c-adde-a5f43687117b tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/ports?device_id=ae7a102d-4793-4384-bc31-07d28018c9df HTTP/1.1" status: 200 len: 945 time: 0.0509543 Dec 24 05:09:49.154803 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-9e09df64-016c-46c0-afc6-a3a6940dd13d req-735f9c44-8353-4ab4-8360-e94d574fa147 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:49.177145 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-af5b4f2d-8fd0-4e1b-b0c1-3808786a8444 req-ad0a2b58-6e6d-447c-b691-ad03ef81f237 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.43 "GET /v2.0/security-groups?id=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430331 Dec 24 05:09:49.182573 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-735f9c44-8353-4ab4-8360-e94d574fa147 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Pushing event deleted for resources: {'Port': ['ID=b8dc8fcb-f50d-49a3-9bd0-47110fdb068f,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:49.194854 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['b8dc8fcb-f50d-49a3-9bd0-47110fdb068f'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:09:49.224223 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-9e09df64-016c-46c0-afc6-a3a6940dd13d req-735f9c44-8353-4ab4-8360-e94d574fa147 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] No DVR routers for this DVR port b8dc8fcb-f50d-49a3-9bd0-47110fdb068f on host hv-cinder-81644 {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:09:49.227688 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-9e09df64-016c-46c0-afc6-a3a6940dd13d req-735f9c44-8353-4ab4-8360-e94d574fa147 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:49.232517 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9e09df64-016c-46c0-afc6-a3a6940dd13d req-735f9c44-8353-4ab4-8360-e94d574fa147 tempest-TestMinimumBasicScenario-33562801 tempest-TestMinimumBasicScenario-33562801-project] 10.222.0.46 "DELETE /v2.0/ports/b8dc8fcb-f50d-49a3-9bd0-47110fdb068f HTTP/1.1" status: 204 len: 173 time: 0.4218791 Dec 24 05:09:49.233399 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ae7a102d-4793-4384-bc31-07d28018c9df', 'name': 'network-vif-deleted', 'tag': 'b8dc8fcb-f50d-49a3-9bd0-47110fdb068f'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:09:49.237292 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aec3c332-e6ad-4ec3-93fa-c0a8688cc8e8" -d '{"events": [{"server_uuid": "ae7a102d-4793-4384-bc31-07d28018c9df", "name": "network-vif-deleted", "tag": "b8dc8fcb-f50d-49a3-9bd0-47110fdb068f"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:09:49.275865 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:09:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2ebd6e57-d00b-4e18-8ae7-4ea2a9078184 x-openstack-request-id: req-2ebd6e57-d00b-4e18-8ae7-4ea2a9078184 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:09:49.276156 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ae7a102d-4793-4384-bc31-07d28018c9df", "name": "network-vif-deleted", "tag": "b8dc8fcb-f50d-49a3-9bd0-47110fdb068f", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:09:49.276405 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-2ebd6e57-d00b-4e18-8ae7-4ea2a9078184 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:09:49.276829 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ae7a102d-4793-4384-bc31-07d28018c9df', 'name': 'network-vif-deleted', 'tag': 'b8dc8fcb-f50d-49a3-9bd0-47110fdb068f', 'status': 'completed', 'code': 200} Dec 24 05:09:49.811995 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9080efc0-4f11-4ab9-bed6-3492e07654fc req-04dbfde1-b8cc-44bd-a027-4a41d1615658 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:49.813494 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-9080efc0-4f11-4ab9-bed6-3492e07654fc req-04dbfde1-b8cc-44bd-a027-4a41d1615658 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 944 time: 0.0478373 Dec 24 05:09:49.864865 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-9080efc0-4f11-4ab9-bed6-3492e07654fc req-ffce2ceb-e62b-47a6-ae58-3a8fd94f7f43 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439670 Dec 24 05:09:50.436868 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:50.762398 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34182) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:09:50.986025 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b06f60ce-916f-4448-a801-c40e6c2a6298 req-1399ef27-e8db-403a-96ea-325775864ed7 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:50.987723 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b06f60ce-916f-4448-a801-c40e6c2a6298 req-1399ef27-e8db-403a-96ea-325775864ed7 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 944 time: 0.0554457 Dec 24 05:09:51.038230 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b06f60ce-916f-4448-a801-c40e6c2a6298 req-461050ee-2924-49ff-ae05-7f1a5a9b4d42 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436671 Dec 24 05:09:51.171185 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f68a9eba-1f34-4819-916f-80a3b2f6a760 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-548364'] for router_interface, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:51.707676 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-f68a9eba-1f34-4819-916f-80a3b2f6a760 admin admin] Deleting port 6dd40189-9984-4e72-8831-3e9d864c65b9 {{(pid=102477) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:09:51.707915 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f68a9eba-1f34-4819-916f-80a3b2f6a760 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:51.790784 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.db [None req-f68a9eba-1f34-4819-916f-80a3b2f6a760 admin admin] For port 6dd40189-9984-4e72-8831-3e9d864c65b9, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=6dd40189-9984-4e72-8831-3e9d864c65b9,segment=NetworkSegment(2d8c6ac9-499a-46a9-971d-99edaae74aeb),segment_id=2d8c6ac9-499a-46a9-971d-99edaae74aeb)] {{(pid=102477) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:09:51.791509 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f68a9eba-1f34-4819-916f-80a3b2f6a760 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:51.807439 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-f68a9eba-1f34-4819-916f-80a3b2f6a760 admin admin] Calling delete_port for 6dd40189-9984-4e72-8831-3e9d864c65b9 owned by network:router_interface {{(pid=102477) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:09:51.990235 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f68a9eba-1f34-4819-916f-80a3b2f6a760 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:52.015831 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f68a9eba-1f34-4819-916f-80a3b2f6a760 admin admin] Pushing event deleted for resources: {'Port': ['ID=6dd40189-9984-4e72-8831-3e9d864c65b9,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:52.207163 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-370f1907-40fb-4541-9cf6-34556ef38780 req-0b6ab498-c8e5-45f8-b189-76a0ccfa1c8a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:52.208651 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-370f1907-40fb-4541-9cf6-34556ef38780 req-0b6ab498-c8e5-45f8-b189-76a0ccfa1c8a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 944 time: 0.0964930 Dec 24 05:09:52.213880 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f68a9eba-1f34-4819-916f-80a3b2f6a760 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-627465', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-548448'] for router_interface, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:52.302529 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-370f1907-40fb-4541-9cf6-34556ef38780 req-49414806-b973-4ed8-aef8-f54abadf16e0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0864856 Dec 24 05:09:52.465319 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f68a9eba-1f34-4819-916f-80a3b2f6a760 admin admin] Router a17d8253-42dc-43b3-b8fe-d8352c4bfc8f has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102477) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:09:52.567040 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f68a9eba-1f34-4819-916f-80a3b2f6a760 admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102477) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:09:52.573152 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-f68a9eba-1f34-4819-916f-80a3b2f6a760 admin admin] 10.222.0.43 "PUT /v2.0/routers/a17d8253-42dc-43b3-b8fe-d8352c4bfc8f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8096018 Dec 24 05:09:52.575250 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34188) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:09:52.577559 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19b025f9-fc06-4e84-ae5c-c783b382eb91 None None] Sync routers for ids ['a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'] in dv-cinder-816443-2-iscsi {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:09:52.587902 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19b025f9-fc06-4e84-ae5c-c783b382eb91 None None] Routers {'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:09:52.588497 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-19b025f9-fc06-4e84-ae5c-c783b382eb91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:09:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:09:52.683749 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-34b6a2e2-66d2-4c3d-8890-e7d90a0fc857 admin admin] Publish callbacks [] for router, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:52.792684 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-34b6a2e2-66d2-4c3d-8890-e7d90a0fc857 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:52.827054 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-19b025f9-fc06-4e84-ae5c-c783b382eb91 None None] Set router a17d8253-42dc-43b3-b8fe-d8352c4bfc8f gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:09:52.847259 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-34b6a2e2-66d2-4c3d-8890-e7d90a0fc857 admin admin] Deleting port 4f7b3b5c-bf57-4538-9238-3f613a19c560 {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:09:52.847604 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-34b6a2e2-66d2-4c3d-8890-e7d90a0fc857 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:52.925173 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [None req-34b6a2e2-66d2-4c3d-8890-e7d90a0fc857 admin admin] For port 4f7b3b5c-bf57-4538-9238-3f613a19c560, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=4f7b3b5c-bf57-4538-9238-3f613a19c560,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:09:52.925681 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-34b6a2e2-66d2-4c3d-8890-e7d90a0fc857 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:52.931551 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 4f943d44-a70c-4b88-9cac-b16783cab1e5 details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 05:09:52.933471 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device b8dc8fcb-f50d-49a3-9bd0-47110fdb068f no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:09:52.937585 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-34b6a2e2-66d2-4c3d-8890-e7d90a0fc857 admin admin] Calling delete_port for 4f7b3b5c-bf57-4538-9238-3f613a19c560 owned by network:router_gateway {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:09:52.969259 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] No Port match for: b8dc8fcb-f50d-49a3-9bd0-47110fdb068f {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:09:52.969608 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device b8dc8fcb-f50d-49a3-9bd0-47110fdb068f not bound to the agent host hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:09:53.096629 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 4f943d44-a70c-4b88-9cac-b16783cab1e5, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=4f943d44-a70c-4b88-9cac-b16783cab1e5,segment=NetworkSegment(cb920e21-208e-474e-84a0-615ea3280b8a),segment_id=cb920e21-208e-474e-84a0-615ea3280b8a)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:09:53.108560 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-34b6a2e2-66d2-4c3d-8890-e7d90a0fc857 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:53.112812 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': '4f943d44-a70c-4b88-9cac-b16783cab1e5', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'port_id': '4f943d44-a70c-4b88-9cac-b16783cab1e5', 'mac_address': 'fa:16:3e:5a:15:88', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 122, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 05:09:53.118436 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-19b025f9-fc06-4e84-ae5c-c783b382eb91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'name': 'tempest-TestMinimumBasicScenario-953343402-router', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248'}], 'enable_snat': True}, 'gw_port_id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:01Z', 'updated_at': '2021-12-24T05:09:51Z', 'revision_number': 5, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'gw_port': {'id': '4f7b3b5c-bf57-4538-9238-3f613a19c560', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:ea:e8:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 488, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.248', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:02Z', 'updated_at': '2021-12-24T05:06:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:09:53.142141 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34b6a2e2-66d2-4c3d-8890-e7d90a0fc857 admin admin] Pushing event deleted for resources: {'Port': ['ID=4f7b3b5c-bf57-4538-9238-3f613a19c560,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:53.166104 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19b025f9-fc06-4e84-ae5c-c783b382eb91 None None] Checking router: a17d8253-42dc-43b3-b8fe-d8352c4bfc8f for host: dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:09:53.186301 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19b025f9-fc06-4e84-ae5c-c783b382eb91 None None] Routers {'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:09:53.186931 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-19b025f9-fc06-4e84-ae5c-c783b382eb91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:09:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:09:53.193404 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:53.198605 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-34b6a2e2-66d2-4c3d-8890-e7d90a0fc857 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-545986'] for router_gateway, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:53.275057 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-bb1e8086-f008-43e6-adef-d4171c507a7c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:53.279714 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4f943d44-a70c-4b88-9cac-b16783cab1e5 {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:09:53.284655 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-19b025f9-fc06-4e84-ae5c-c783b382eb91 None None] Set router a17d8253-42dc-43b3-b8fe-d8352c4bfc8f gateway port host: None {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:09:53.302441 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-34b6a2e2-66d2-4c3d-8890-e7d90a0fc857 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-546088', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2070312'] for router, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:53.304680 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-34b6a2e2-66d2-4c3d-8890-e7d90a0fc857 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:53.354573 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 4f943d44-a70c-4b88-9cac-b16783cab1e5, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=4f943d44-a70c-4b88-9cac-b16783cab1e5,segment=NetworkSegment(cb920e21-208e-474e-84a0-615ea3280b8a),segment_id=cb920e21-208e-474e-84a0-615ea3280b8a)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:09:53.355993 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-19b025f9-fc06-4e84-ae5c-c783b382eb91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'name': 'tempest-TestMinimumBasicScenario-953343402-router', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:01Z', 'updated_at': '2021-12-24T05:09:53Z', 'revision_number': 7, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'gw_port_host': None}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:09:53.360234 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:53.385798 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-34b6a2e2-66d2-4c3d-8890-e7d90a0fc857 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-546081'] for router, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:53.386171 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-34b6a2e2-66d2-4c3d-8890-e7d90a0fc857 admin admin] Fanout notify agent at l3_agent the message router_deleted on router a17d8253-42dc-43b3-b8fe-d8352c4bfc8f {{(pid=102476) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 24 05:09:53.390059 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19b025f9-fc06-4e84-ae5c-c783b382eb91 None None] The sync data for ids ['a17d8253-42dc-43b3-b8fe-d8352c4bfc8f'] in dv-cinder-816443-2-iscsi is: [{'id': 'a17d8253-42dc-43b3-b8fe-d8352c4bfc8f', 'name': 'tempest-TestMinimumBasicScenario-953343402-router', 'tenant_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:01Z', 'updated_at': '2021-12-24T05:09:53Z', 'revision_number': 7, 'project_id': 'f081e71a66b74c3bb12e1bec9d9a5cd1', 'gw_port_host': None}] {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:09:53.391783 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-34b6a2e2-66d2-4c3d-8890-e7d90a0fc857 admin admin] Publish callbacks [] for router, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:53.395818 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-34b6a2e2-66d2-4c3d-8890-e7d90a0fc857 admin admin] 10.222.0.43 "DELETE /v2.0/routers/a17d8253-42dc-43b3-b8fe-d8352c4bfc8f HTTP/1.1" status: 204 len: 168 time: 0.8167844 Dec 24 05:09:53.396562 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34192) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:09:53.432006 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28b721b9-87a7-4585-9bba-768f1a9a3654 req-4409ab4b-fa10-496a-9b8b-3a2c6391fd90 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:53.433813 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-28b721b9-87a7-4585-9bba-768f1a9a3654 req-4409ab4b-fa10-496a-9b8b-3a2c6391fd90 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 945 time: 0.0584047 Dec 24 05:09:53.441121 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=4f943d44-a70c-4b88-9cac-b16783cab1e5,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:53.461471 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.db_base_plugin_v2 [None req-f6f55a63-a5cf-446a-bb21-87530478c6aa admin admin] Deleting subnet 11836946-2718-402d-9e36-6ad89714906f {{(pid=102477) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Dec 24 05:09:53.464599 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f6f55a63-a5cf-446a-bb21-87530478c6aa admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:53.485033 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-28b721b9-87a7-4585-9bba-768f1a9a3654 req-3f19c8cd-e084-406e-92b9-9117676caa2c tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450928 Dec 24 05:09:53.498380 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f6f55a63-a5cf-446a-bb21-87530478c6aa admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-29535554'] for subnet, precommit_delete_associations {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:53.610565 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f6f55a63-a5cf-446a-bb21-87530478c6aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3590439'] for subnet, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:53.672989 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f6f55a63-a5cf-446a-bb21-87530478c6aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3590440', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-29535541', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-29853072'] for subnet, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:53.703818 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6f55a63-a5cf-446a-bb21-87530478c6aa admin admin] Pushing event deleted for resources: {'Subnet': ['ID=11836946-2718-402d-9e36-6ad89714906f,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:53.707439 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f6f55a63-a5cf-446a-bb21-87530478c6aa admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:53.711471 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-f6f55a63-a5cf-446a-bb21-87530478c6aa admin admin] 10.222.0.43 "DELETE /v2.0/subnets/11836946-2718-402d-9e36-6ad89714906f HTTP/1.1" status: 204 len: 168 time: 0.3128102 Dec 24 05:09:53.713425 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-daa271d8-b353-410e-a298-7603ee99edac None None] Network f6c8eead-66df-4cba-abce-78ee3b037ee2 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:09:53.714717 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34194) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:09:53.787326 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1d9abd45-87b3-4f42-a7b6-94f7a1fcb297 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3741433'] for network, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:53.801115 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['4f943d44-a70c-4b88-9cac-b16783cab1e5'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:09:53.848104 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-1d9abd45-87b3-4f42-a7b6-94f7a1fcb297 admin admin] Deleting port b11ddfbb-e4cc-4cb8-95c9-92c0260890d3 {{(pid=102477) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:09:53.848420 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1d9abd45-87b3-4f42-a7b6-94f7a1fcb297 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:53.910014 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.db [None req-1d9abd45-87b3-4f42-a7b6-94f7a1fcb297 admin admin] For port b11ddfbb-e4cc-4cb8-95c9-92c0260890d3, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=b11ddfbb-e4cc-4cb8-95c9-92c0260890d3,segment=NetworkSegment(2d8c6ac9-499a-46a9-971d-99edaae74aeb),segment_id=2d8c6ac9-499a-46a9-971d-99edaae74aeb)] {{(pid=102477) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:09:53.910394 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1d9abd45-87b3-4f42-a7b6-94f7a1fcb297 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:53.922347 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-1d9abd45-87b3-4f42-a7b6-94f7a1fcb297 admin admin] Calling delete_port for b11ddfbb-e4cc-4cb8-95c9-92c0260890d3 owned by network:dhcp {{(pid=102477) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:09:54.005061 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1d9abd45-87b3-4f42-a7b6-94f7a1fcb297 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:54.032333 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d9abd45-87b3-4f42-a7b6-94f7a1fcb297 admin admin] Pushing event deleted for resources: {'Port': ['ID=b11ddfbb-e4cc-4cb8-95c9-92c0260890d3,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:54.034169 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d9abd45-87b3-4f42-a7b6-94f7a1fcb297 admin admin] No DVR routers for this DVR port b11ddfbb-e4cc-4cb8-95c9-92c0260890d3 on host dv-cinder-816443-2-iscsi {{(pid=102477) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:09:54.102704 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1d9abd45-87b3-4f42-a7b6-94f7a1fcb297 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3595960', 'neutron.services.segments.db._delete_segments_for_network-8750577966942'] for network, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:54.127955 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.services.segments.db [None req-1d9abd45-87b3-4f42-a7b6-94f7a1fcb297 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f6c8eead-66df-4cba-abce-78ee3b037ee2']}} {{(pid=102477) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:09:54.139745 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.services.segments.db [None req-1d9abd45-87b3-4f42-a7b6-94f7a1fcb297 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2d8c6ac9-499a-46a9-971d-99edaae74aeb') {'for_net_delete': True} {{(pid=102477) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:09:54.140049 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.services.segments.db [None req-1d9abd45-87b3-4f42-a7b6-94f7a1fcb297 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2d8c6ac9-499a-46a9-971d-99edaae74aeb') {} {{(pid=102477) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:09:54.143005 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d28eb53-24a2-46c7-aa68-4679d4464e66 None None] DHCP port deletion for f6c8eead-66df-4cba-abce-78ee3b037ee2 request from dv-cinder-816443-2-iscsi {{(pid=102478) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 24 05:09:54.151318 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1d9abd45-87b3-4f42-a7b6-94f7a1fcb297 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750577970535', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-29535605'] for segment, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:54.178090 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1d9abd45-87b3-4f42-a7b6-94f7a1fcb297 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:54.184812 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1d9abd45-87b3-4f42-a7b6-94f7a1fcb297 admin admin] Releasing vlan 123 on physical network physnet1 to pool {{(pid=102477) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 24 05:09:54.185203 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1d9abd45-87b3-4f42-a7b6-94f7a1fcb297 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29532823'] for segment, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: Traceback (most recent call last): Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: timer() Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: cb(*args, **kw) Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: return func(*args, **kwargs) Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: self._notify() Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: self.callback(batched_events) Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: event.method(event) Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: aggregate_uuid = self.p_client.list_aggregates( Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: return f(self, *a, **k) Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: return self._get(url).json() Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: return self.request(url, 'GET', **kwargs) Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: base_url = self.get_endpoint(auth, allow=allow, Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 24 05:09:54.186944 dv-cinder-816443-2-iscsi neutron-server[102477]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 24 05:09:54.208182 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 4f7b3b5c-bf57-4538-9238-3f613a19c560 no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:09:54.229817 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: 4f7b3b5c-bf57-4538-9238-3f613a19c560 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:09:54.230167 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 4f7b3b5c-bf57-4538-9238-3f613a19c560 not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:09:54.231273 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 6dd40189-9984-4e72-8831-3e9d864c65b9 no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:09:54.250819 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1d9abd45-87b3-4f42-a7b6-94f7a1fcb297 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3595937', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-546046'] for network, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:54.262246 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: 6dd40189-9984-4e72-8831-3e9d864c65b9 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:09:54.262592 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 6dd40189-9984-4e72-8831-3e9d864c65b9 not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:09:54.263028 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device b11ddfbb-e4cc-4cb8-95c9-92c0260890d3 no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:09:54.265564 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1d9abd45-87b3-4f42-a7b6-94f7a1fcb297 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:54.272792 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-1d9abd45-87b3-4f42-a7b6-94f7a1fcb297 admin admin] 10.222.0.43 "DELETE /v2.0/networks/f6c8eead-66df-4cba-abce-78ee3b037ee2 HTTP/1.1" status: 204 len: 168 time: 0.5534046 Dec 24 05:09:54.273299 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34196) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:09:54.283952 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d9abd45-87b3-4f42-a7b6-94f7a1fcb297 admin admin] Pushing event deleted for resources: {'Network': ['ID=f6c8eead-66df-4cba-abce-78ee3b037ee2,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:54.285646 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: b11ddfbb-e4cc-4cb8-95c9-92c0260890d3 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:09:54.286714 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device b11ddfbb-e4cc-4cb8-95c9-92c0260890d3 not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:09:54.615386 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc797bfe-8850-45cd-8260-db6d044de98a req-75202ca1-5fc9-4fac-9870-d70a97715b47 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:54.617434 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-bc797bfe-8850-45cd-8260-db6d044de98a req-75202ca1-5fc9-4fac-9870-d70a97715b47 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 945 time: 0.0600023 Dec 24 05:09:54.652156 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-f047d4b6-af51-444a-a27f-c6511c8a9f9c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-548364'] for router_interface, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:54.682925 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-bc797bfe-8850-45cd-8260-db6d044de98a req-a5044165-496b-4fba-a756-9e2f88b7a8cf tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0570481 Dec 24 05:09:54.933247 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 4f943d44-a70c-4b88-9cac-b16783cab1e5 up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:09:54.933969 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-f047d4b6-af51-444a-a27f-c6511c8a9f9c admin admin] Deleting port 8d561bb5-7197-4f2a-b9db-527de397040e {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:09:54.934124 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-f047d4b6-af51-444a-a27f-c6511c8a9f9c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:54.987695 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning for port 4f943d44-a70c-4b88-9cac-b16783cab1e5 completed by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 24 05:09:54.991866 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port 4f943d44-a70c-4b88-9cac-b16783cab1e5 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:09:54.992240 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:55.024671 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [None req-f047d4b6-af51-444a-a27f-c6511c8a9f9c admin admin] For port 8d561bb5-7197-4f2a-b9db-527de397040e, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=8d561bb5-7197-4f2a-b9db-527de397040e,segment=NetworkSegment(63a704c8-cd79-481c-a952-c0af6930f29a),segment_id=63a704c8-cd79-481c-a952-c0af6930f29a)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:09:55.025074 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-f047d4b6-af51-444a-a27f-c6511c8a9f9c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:55.040297 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-f047d4b6-af51-444a-a27f-c6511c8a9f9c admin admin] Calling delete_port for 8d561bb5-7197-4f2a-b9db-527de397040e owned by network:router_interface {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:09:55.086154 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:55.110686 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '067b7d98-4174-409c-85af-47a2dbf63a71', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4f943d44-a70c-4b88-9cac-b16783cab1e5'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:09:55.113040 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a701fd7e-dad0-4fb9-ad64-2aaf3b1e8120" -d '{"events": [{"server_uuid": "067b7d98-4174-409c-85af-47a2dbf63a71", "name": "network-vif-plugged", "status": "completed", "tag": "4f943d44-a70c-4b88-9cac-b16783cab1e5"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:09:55.128446 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 4f943d44-a70c-4b88-9cac-b16783cab1e5, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=4f943d44-a70c-4b88-9cac-b16783cab1e5,segment=NetworkSegment(cb920e21-208e-474e-84a0-615ea3280b8a),segment_id=cb920e21-208e-474e-84a0-615ea3280b8a)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:09:55.133939 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:55.164066 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:09:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c24e1241-9051-435a-9673-c4d27c49978b x-openstack-request-id: req-c24e1241-9051-435a-9673-c4d27c49978b {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:09:55.164361 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "067b7d98-4174-409c-85af-47a2dbf63a71", "name": "network-vif-plugged", "status": "completed", "tag": "4f943d44-a70c-4b88-9cac-b16783cab1e5", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:09:55.164673 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-c24e1241-9051-435a-9673-c4d27c49978b {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:09:55.165136 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '067b7d98-4174-409c-85af-47a2dbf63a71', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4f943d44-a70c-4b88-9cac-b16783cab1e5', 'code': 200} Dec 24 05:09:55.190377 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=4f943d44-a70c-4b88-9cac-b16783cab1e5,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:55.199858 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:55.200350 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:55.200815 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:55.201257 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:55.201877 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:55.202336 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:55.204839 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:55.205303 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:55.205733 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:55.206415 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:55.206812 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:55.207237 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:55.207655 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:09:55.251822 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-f047d4b6-af51-444a-a27f-c6511c8a9f9c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:55.277754 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-0ea601a3-0c57-442c-abea-a6c37692302b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:55.280493 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f047d4b6-af51-444a-a27f-c6511c8a9f9c admin admin] Pushing event deleted for resources: {'Port': ['ID=8d561bb5-7197-4f2a-b9db-527de397040e,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:55.485127 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-f047d4b6-af51-444a-a27f-c6511c8a9f9c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-627465', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-548448'] for router_interface, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:55.489556 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90150cf6-f9eb-4347-9da4-c9aed8cda910 req-2e1e6240-f6c0-45dc-8410-1c9b3498e74a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:55.491210 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-90150cf6-f9eb-4347-9da4-c9aed8cda910 req-2e1e6240-f6c0-45dc-8410-1c9b3498e74a service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 1099 time: 0.0922294 Dec 24 05:09:55.617203 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-90150cf6-f9eb-4347-9da4-c9aed8cda910 req-9f98b921-2489-4cb8-9029-bd7e76bc03b7 service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1166015 Dec 24 05:09:55.739563 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f047d4b6-af51-444a-a27f-c6511c8a9f9c admin admin] Router ed895a5b-4255-42de-b9e2-38e931bf55d9 has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102476) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:09:55.815130 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8b5d7a7-38b9-4ac2-b078-e062be4f0e16 req-8f818abb-a80f-4614-b6fd-dd8a59e0ac6d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:55.816651 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c8b5d7a7-38b9-4ac2-b078-e062be4f0e16 req-8f818abb-a80f-4614-b6fd-dd8a59e0ac6d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 946 time: 0.0615849 Dec 24 05:09:55.850290 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f047d4b6-af51-444a-a27f-c6511c8a9f9c admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:09:55.855404 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-f047d4b6-af51-444a-a27f-c6511c8a9f9c admin admin] 10.222.0.43 "PUT /v2.0/routers/ed895a5b-4255-42de-b9e2-38e931bf55d9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5810418 Dec 24 05:09:55.860011 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34204) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:09:55.867987 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32a72ff6-1a31-4cdb-b3f4-eba3976edbb7 None None] Sync routers for ids ['ed895a5b-4255-42de-b9e2-38e931bf55d9'] in dv-cinder-816443-2-iscsi {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:09:55.877508 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c8b5d7a7-38b9-4ac2-b078-e062be4f0e16 req-ef39677e-4f8e-4751-a8e0-a2d68c74c2e3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0539081 Dec 24 05:09:55.882698 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32a72ff6-1a31-4cdb-b3f4-eba3976edbb7 None None] Routers {'ed895a5b-4255-42de-b9e2-38e931bf55d9'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:09:55.883326 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-32a72ff6-1a31-4cdb-b3f4-eba3976edbb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:09:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['ed895a5b-4255-42de-b9e2-38e931bf55d9'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:09:55.971861 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-faf18291-d5bb-41cf-89bd-f65a74d8da54 admin admin] Publish callbacks [] for router, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:55.989482 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-32a72ff6-1a31-4cdb-b3f4-eba3976edbb7 None None] Set router ed895a5b-4255-42de-b9e2-38e931bf55d9 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:09:56.166587 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-32a72ff6-1a31-4cdb-b3f4-eba3976edbb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed895a5b-4255-42de-b9e2-38e931bf55d9', 'name': 'tempest-TestMinimumBasicScenario-1787144168-router', 'tenant_id': '3f3829205cff4830ba6b76ce6b6a8469', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.27'}], 'enable_snat': True}, 'gw_port_id': 'b99d7dd8-746f-48d5-ae56-6378c12b152b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:06Z', 'updated_at': '2021-12-24T05:09:55Z', 'revision_number': 5, 'project_id': '3f3829205cff4830ba6b76ce6b6a8469', 'gw_port': {'id': 'b99d7dd8-746f-48d5-ae56-6378c12b152b', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:cb:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed895a5b-4255-42de-b9e2-38e931bf55d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.27', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:07Z', 'updated_at': '2021-12-24T05:06:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:09:56.196860 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32a72ff6-1a31-4cdb-b3f4-eba3976edbb7 None None] Checking router: ed895a5b-4255-42de-b9e2-38e931bf55d9 for host: dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:09:56.205929 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32a72ff6-1a31-4cdb-b3f4-eba3976edbb7 None None] Routers {'ed895a5b-4255-42de-b9e2-38e931bf55d9'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:09:56.206537 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-32a72ff6-1a31-4cdb-b3f4-eba3976edbb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:09:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['ed895a5b-4255-42de-b9e2-38e931bf55d9'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:09:56.315984 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-32a72ff6-1a31-4cdb-b3f4-eba3976edbb7 None None] Set router ed895a5b-4255-42de-b9e2-38e931bf55d9 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:09:56.358658 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-faf18291-d5bb-41cf-89bd-f65a74d8da54 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:56.411268 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-faf18291-d5bb-41cf-89bd-f65a74d8da54 admin admin] Deleting port b99d7dd8-746f-48d5-ae56-6378c12b152b {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:09:56.411616 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-faf18291-d5bb-41cf-89bd-f65a74d8da54 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:56.429255 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:09:56.495636 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [None req-faf18291-d5bb-41cf-89bd-f65a74d8da54 admin admin] For port b99d7dd8-746f-48d5-ae56-6378c12b152b, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=b99d7dd8-746f-48d5-ae56-6378c12b152b,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:09:56.495999 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-faf18291-d5bb-41cf-89bd-f65a74d8da54 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:56.500409 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-32a72ff6-1a31-4cdb-b3f4-eba3976edbb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ed895a5b-4255-42de-b9e2-38e931bf55d9', 'name': 'tempest-TestMinimumBasicScenario-1787144168-router', 'tenant_id': '3f3829205cff4830ba6b76ce6b6a8469', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.27'}], 'enable_snat': True}, 'gw_port_id': 'b99d7dd8-746f-48d5-ae56-6378c12b152b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:06Z', 'updated_at': '2021-12-24T05:09:55Z', 'revision_number': 5, 'project_id': '3f3829205cff4830ba6b76ce6b6a8469', 'gw_port': {'id': 'b99d7dd8-746f-48d5-ae56-6378c12b152b', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:cb:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed895a5b-4255-42de-b9e2-38e931bf55d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.27', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:07Z', 'updated_at': '2021-12-24T05:06:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:09:56.504358 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:56.510674 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-faf18291-d5bb-41cf-89bd-f65a74d8da54 admin admin] Calling delete_port for b99d7dd8-746f-48d5-ae56-6378c12b152b owned by network:router_gateway {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:09:56.529845 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32a72ff6-1a31-4cdb-b3f4-eba3976edbb7 None None] The sync data for ids ['ed895a5b-4255-42de-b9e2-38e931bf55d9'] in dv-cinder-816443-2-iscsi is: [{'id': 'ed895a5b-4255-42de-b9e2-38e931bf55d9', 'name': 'tempest-TestMinimumBasicScenario-1787144168-router', 'tenant_id': '3f3829205cff4830ba6b76ce6b6a8469', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.27'}], 'enable_snat': True}, 'gw_port_id': 'b99d7dd8-746f-48d5-ae56-6378c12b152b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:06Z', 'updated_at': '2021-12-24T05:09:55Z', 'revision_number': 5, 'project_id': '3f3829205cff4830ba6b76ce6b6a8469', 'gw_port': {'id': 'b99d7dd8-746f-48d5-ae56-6378c12b152b', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:cb:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ed895a5b-4255-42de-b9e2-38e931bf55d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.27', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:07Z', 'updated_at': '2021-12-24T05:06:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}] {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:09:56.682922 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-faf18291-d5bb-41cf-89bd-f65a74d8da54 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:56.707565 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faf18291-d5bb-41cf-89bd-f65a74d8da54 admin admin] Pushing event deleted for resources: {'Port': ['ID=b99d7dd8-746f-48d5-ae56-6378c12b152b,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:56.768460 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-faf18291-d5bb-41cf-89bd-f65a74d8da54 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-545986'] for router_gateway, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:56.860840 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-faf18291-d5bb-41cf-89bd-f65a74d8da54 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-546088', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2070312'] for router, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:56.862990 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-faf18291-d5bb-41cf-89bd-f65a74d8da54 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:56.915615 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-faf18291-d5bb-41cf-89bd-f65a74d8da54 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-546081'] for router, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:56.916292 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-faf18291-d5bb-41cf-89bd-f65a74d8da54 admin admin] Fanout notify agent at l3_agent the message router_deleted on router ed895a5b-4255-42de-b9e2-38e931bf55d9 {{(pid=102476) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 24 05:09:56.921968 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-faf18291-d5bb-41cf-89bd-f65a74d8da54 admin admin] Publish callbacks [] for router, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:56.927139 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-faf18291-d5bb-41cf-89bd-f65a74d8da54 admin admin] 10.222.0.43 "DELETE /v2.0/routers/ed895a5b-4255-42de-b9e2-38e931bf55d9 HTTP/1.1" status: 204 len: 168 time: 1.0664186 Dec 24 05:09:56.927445 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34208) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:09:56.985743 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.db_base_plugin_v2 [None req-d0550a88-4a9e-481c-aff2-d930fdfab96a admin admin] Deleting subnet 4606dd6c-9937-42c0-8f9a-596cea367298 {{(pid=102477) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Dec 24 05:09:56.990007 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d0550a88-4a9e-481c-aff2-d930fdfab96a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:57.019869 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a40955a6-7335-4fa2-9e8a-b60590977441 req-ed1256cf-e374-4ee0-8cb3-8fe1b76fe3d9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:57.021597 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a40955a6-7335-4fa2-9e8a-b60590977441 req-ed1256cf-e374-4ee0-8cb3-8fe1b76fe3d9 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 946 time: 0.0592093 Dec 24 05:09:57.034087 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d0550a88-4a9e-481c-aff2-d930fdfab96a admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-29535554'] for subnet, precommit_delete_associations {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:57.080058 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a40955a6-7335-4fa2-9e8a-b60590977441 req-558d26dd-95cb-4d7c-8c9a-353c4aae3c12 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0505919 Dec 24 05:09:57.112923 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d0550a88-4a9e-481c-aff2-d930fdfab96a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3590439'] for subnet, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:57.167055 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d0550a88-4a9e-481c-aff2-d930fdfab96a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3590440', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-29535541', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-29853072'] for subnet, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:57.195383 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0550a88-4a9e-481c-aff2-d930fdfab96a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4606dd6c-9937-42c0-8f9a-596cea367298,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:57.197391 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d0550a88-4a9e-481c-aff2-d930fdfab96a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:57.200582 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-d0550a88-4a9e-481c-aff2-d930fdfab96a admin admin] 10.222.0.43 "DELETE /v2.0/subnets/4606dd6c-9937-42c0-8f9a-596cea367298 HTTP/1.1" status: 204 len: 168 time: 0.2718377 Dec 24 05:09:57.203363 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34210) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:09:57.206003 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-864e2227-b978-43c4-a4d2-efa0d4918f71 None None] Network 99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:09:57.281975 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-83fa3b36-5c22-4cd5-9bd2-f17050bcd1cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3741433'] for network, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:57.337287 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-83fa3b36-5c22-4cd5-9bd2-f17050bcd1cf admin admin] Deleting port bf00b6e0-0969-4774-9fb3-82159f213fbc {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:09:57.337631 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-83fa3b36-5c22-4cd5-9bd2-f17050bcd1cf admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:57.399528 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [None req-83fa3b36-5c22-4cd5-9bd2-f17050bcd1cf admin admin] For port bf00b6e0-0969-4774-9fb3-82159f213fbc, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=bf00b6e0-0969-4774-9fb3-82159f213fbc,segment=NetworkSegment(63a704c8-cd79-481c-a952-c0af6930f29a),segment_id=63a704c8-cd79-481c-a952-c0af6930f29a)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:09:57.400227 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-83fa3b36-5c22-4cd5-9bd2-f17050bcd1cf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:57.415928 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-83fa3b36-5c22-4cd5-9bd2-f17050bcd1cf admin admin] Calling delete_port for bf00b6e0-0969-4774-9fb3-82159f213fbc owned by network:dhcp {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:09:57.502963 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-83fa3b36-5c22-4cd5-9bd2-f17050bcd1cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:57.527137 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83fa3b36-5c22-4cd5-9bd2-f17050bcd1cf admin admin] Pushing event deleted for resources: {'Port': ['ID=bf00b6e0-0969-4774-9fb3-82159f213fbc,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:57.530685 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83fa3b36-5c22-4cd5-9bd2-f17050bcd1cf admin admin] No DVR routers for this DVR port bf00b6e0-0969-4774-9fb3-82159f213fbc on host dv-cinder-816443-2-iscsi {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:09:57.605371 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-83fa3b36-5c22-4cd5-9bd2-f17050bcd1cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3595960', 'neutron.services.segments.db._delete_segments_for_network-8750577966942'] for network, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:57.629810 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-83fa3b36-5c22-4cd5-9bd2-f17050bcd1cf admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc']}} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:09:57.633224 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3df766f6-4ad4-4506-bd2e-1840ee7cb771 None None] DHCP port deletion for 99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc request from dv-cinder-816443-2-iscsi {{(pid=102478) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 24 05:09:57.646763 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-83fa3b36-5c22-4cd5-9bd2-f17050bcd1cf admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '63a704c8-cd79-481c-a952-c0af6930f29a') {'for_net_delete': True} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:09:57.646763 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-83fa3b36-5c22-4cd5-9bd2-f17050bcd1cf admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '63a704c8-cd79-481c-a952-c0af6930f29a') {} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:09:57.658475 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-83fa3b36-5c22-4cd5-9bd2-f17050bcd1cf admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750577970535', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-32509733'] for segment, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:57.673011 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-83fa3b36-5c22-4cd5-9bd2-f17050bcd1cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:57.679850 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-83fa3b36-5c22-4cd5-9bd2-f17050bcd1cf admin admin] Releasing vlan 128 on physical network physnet1 to pool {{(pid=102476) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 24 05:09:57.680238 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-83fa3b36-5c22-4cd5-9bd2-f17050bcd1cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-32528320'] for segment, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:57.682002 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: Traceback (most recent call last): Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: timer() Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: cb(*args, **kw) Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: return func(*args, **kwargs) Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: self._notify() Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: self.callback(batched_events) Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: event.method(event) Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: aggregate_uuid = self.p_client.list_aggregates( Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: return f(self, *a, **k) Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: return self._get(url).json() Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: return self.request(url, 'GET', **kwargs) Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: base_url = self.get_endpoint(auth, allow=allow, Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 24 05:09:57.684905 dv-cinder-816443-2-iscsi neutron-server[102476]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 24 05:09:57.740274 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-83fa3b36-5c22-4cd5-9bd2-f17050bcd1cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3595937', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-546046'] for network, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:57.745854 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-83fa3b36-5c22-4cd5-9bd2-f17050bcd1cf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:57.749036 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-83fa3b36-5c22-4cd5-9bd2-f17050bcd1cf admin admin] 10.222.0.43 "DELETE /v2.0/networks/99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc HTTP/1.1" status: 204 len: 168 time: 0.5445802 Dec 24 05:09:57.760959 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83fa3b36-5c22-4cd5-9bd2-f17050bcd1cf admin admin] Pushing event deleted for resources: {'Network': ['ID=99d26da0-bc90-4cb4-bb7d-64e5c5c81cdc,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:57.903730 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 8d561bb5-7197-4f2a-b9db-527de397040e no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:09:57.931377 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: 8d561bb5-7197-4f2a-b9db-527de397040e {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:09:57.931377 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 8d561bb5-7197-4f2a-b9db-527de397040e not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:09:57.931377 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device b99d7dd8-746f-48d5-ae56-6378c12b152b no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:09:57.942736 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34216) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:09:57.957584 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: b99d7dd8-746f-48d5-ae56-6378c12b152b {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:09:57.957929 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device b99d7dd8-746f-48d5-ae56-6378c12b152b not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:09:57.958352 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device bf00b6e0-0969-4774-9fb3-82159f213fbc no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:09:57.981175 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: bf00b6e0-0969-4774-9fb3-82159f213fbc {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:09:57.981523 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device bf00b6e0-0969-4774-9fb3-82159f213fbc not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:09:57.982895 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:57.984001 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-9218f8f8-1a8d-4bbe-a46f-95208f9a3d96 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=f081e71a66b74c3bb12e1bec9d9a5cd1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0400813 Dec 24 05:09:57.986641 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34218) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:09:58.039713 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-9a335338-d7fd-4984-838f-610551684bbd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:58.066050 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-9a335338-d7fd-4984-838f-610551684bbd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:58.119395 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-9a335338-d7fd-4984-838f-610551684bbd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:58.122177 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-9a335338-d7fd-4984-838f-610551684bbd admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:58.125681 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-9a335338-d7fd-4984-838f-610551684bbd admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52 HTTP/1.1" status: 204 len: 168 time: 0.1357374 Dec 24 05:09:58.132890 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a335338-d7fd-4984-838f-610551684bbd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0a46f213-fdb2-4378-ba6e-9a8bf1cfdf52,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:58.205017 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eff5208f-5d94-47a0-9eaa-54501c1b5de4 req-636a76de-85d1-44fb-9e24-c683ef5420d2 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:58.206533 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-eff5208f-5d94-47a0-9eaa-54501c1b5de4 req-636a76de-85d1-44fb-9e24-c683ef5420d2 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 946 time: 0.0505135 Dec 24 05:09:58.256004 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-eff5208f-5d94-47a0-9eaa-54501c1b5de4 req-1cfc47f2-1f02-4391-bc4f-c386ef886d04 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430071 Dec 24 05:09:58.371606 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cada9d88-3dc0-4c15-8a21-ac03923d74a3 req-7a05359a-cf48-46ac-b618-838132970f62 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:58.373145 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-cada9d88-3dc0-4c15-8a21-ac03923d74a3 req-7a05359a-cf48-46ac-b618-838132970f62 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 946 time: 0.0485172 Dec 24 05:09:58.422251 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-cada9d88-3dc0-4c15-8a21-ac03923d74a3 req-1b12f217-f0b9-4d19-9133-0fe171f885a5 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425837 Dec 24 05:09:58.444553 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34228) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:09:58.464987 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34230) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:09:58.486847 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bd2a16a3-5bb0-40f7-89eb-d590deb9413a tempest-TestVolumeBootPattern-1420950562 tempest-TestVolumeBootPattern-1420950562-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:09:58.488364 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-bd2a16a3-5bb0-40f7-89eb-d590deb9413a tempest-TestVolumeBootPattern-1420950562 tempest-TestVolumeBootPattern-1420950562-project-admin] 10.222.0.43 "GET /v2.0/ports?device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 1094 time: 0.0427563 Dec 24 05:09:58.491287 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34232) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:09:58.495752 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-c41481cc-b9b9-47e2-9d19-22ee7322c717 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Request body: {'floatingip': {'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'port_id': '4f943d44-a70c-4b88-9cac-b16783cab1e5', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'fixed_ip_address': '172.20.0.13'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:09:58.504557 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-2618b4a1-ddf3-435c-b6c5-f83d892eb6c9 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=3f3829205cff4830ba6b76ce6b6a8469&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0383747 Dec 24 05:09:58.507204 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34234) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:09:58.520729 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c41481cc-b9b9-47e2-9d19-22ee7322c717 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for floatingip, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:58.557485 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e4bb03ce-d0cd-4503-a3c0-6cd598b92a34 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:58.580661 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e4bb03ce-d0cd-4503-a3c0-6cd598b92a34 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:58.586825 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:58.616597 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c41481cc-b9b9-47e2-9d19-22ee7322c717 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:58.632960 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e4bb03ce-d0cd-4503-a3c0-6cd598b92a34 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:58.635541 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e4bb03ce-d0cd-4503-a3c0-6cd598b92a34 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:58.636766 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-e4bb03ce-d0cd-4503-a3c0-6cd598b92a34 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/6c4cb6b8-ed95-43af-8165-474468789016 HTTP/1.1" status: 204 len: 168 time: 0.1286745 Dec 24 05:09:58.648182 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4bb03ce-d0cd-4503-a3c0-6cd598b92a34 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6c4cb6b8-ed95-43af-8165-474468789016,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:58.726179 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.db_base_plugin_common [None req-c41481cc-b9b9-47e2-9d19-22ee7322c717 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Allocated IP 172.27.1.210 (9b4e4b31-551f-45a9-b26a-cb44ee20a17d/f277b899-8779-420e-8a8d-bfcd5eb7f012/d0c465d3-97ea-4b50-b6a9-56d33f3c4791) {{(pid=102477) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:09:58.833483 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c41481cc-b9b9-47e2-9d19-22ee7322c717 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for port, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:58.873955 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c41481cc-b9b9-47e2-9d19-22ee7322c717 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:58.922287 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c41481cc-b9b9-47e2-9d19-22ee7322c717 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d is already hosted by enough agents. {{(pid=102477) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:09:58.925524 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-c41481cc-b9b9-47e2-9d19-22ee7322c717 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Resources bound (agent type, host, resource id): {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:09:58.931616 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c41481cc-b9b9-47e2-9d19-22ee7322c717 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Received port after_create {{(pid=102477) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:09:58.935155 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c41481cc-b9b9-47e2-9d19-22ee7322c717 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Pushing event updated for resources: {'Port': ['ID=d0c465d3-97ea-4b50-b6a9-56d33f3c4791,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:59.290580 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c41481cc-b9b9-47e2-9d19-22ee7322c717 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:59.362738 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c41481cc-b9b9-47e2-9d19-22ee7322c717 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:59.762604 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c41481cc-b9b9-47e2-9d19-22ee7322c717 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for port, precommit_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:59.769942 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c41481cc-b9b9-47e2-9d19-22ee7322c717 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29535615'] for port, after_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:59.832243 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c41481cc-b9b9-47e2-9d19-22ee7322c717 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Pushing event updated for resources: {'Port': ['ID=d0c465d3-97ea-4b50-b6a9-56d33f3c4791,revision_number=2']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:09:59.844910 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c41481cc-b9b9-47e2-9d19-22ee7322c717 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-545804'] for floatingip, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:09:59.943114 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.db.l3_db [None req-c41481cc-b9b9-47e2-9d19-22ee7322c717 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Floating IP dce0027a-d049-4ae2-9714-ef593a9b7a8f associated. External IP: 172.27.1.210, port: 4f943d44-a70c-4b88-9cac-b16783cab1e5. Dec 24 05:10:00.160143 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c41481cc-b9b9-47e2-9d19-22ee7322c717 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Router 9df11fe3-ba73-4793-a582-0e00f27a374d has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102477) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:10:00.278155 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c41481cc-b9b9-47e2-9d19-22ee7322c717 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102477) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:10:00.288816 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42ab3adb-668a-4251-8ea2-cfae4ff1f010 None None] Sync routers for ids ['9df11fe3-ba73-4793-a582-0e00f27a374d'] in dv-cinder-816443-2-iscsi {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:10:00.296443 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c41481cc-b9b9-47e2-9d19-22ee7322c717 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for floatingip, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:00.300019 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-42ab3adb-668a-4251-8ea2-cfae4ff1f010 None None] Routers {'9df11fe3-ba73-4793-a582-0e00f27a374d'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:10:00.300739 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-42ab3adb-668a-4251-8ea2-cfae4ff1f010 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:09:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['9df11fe3-ba73-4793-a582-0e00f27a374d'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:10:00.340550 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-c41481cc-b9b9-47e2-9d19-22ee7322c717 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.8347588 Dec 24 05:10:00.340550 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '067b7d98-4174-409c-85af-47a2dbf63a71', 'tag': '4f943d44-a70c-4b88-9cac-b16783cab1e5'}] {{(pid=102477) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:10:00.340550 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d3e3d7a262849d185e72ba84ca6adca9bb1fee52649b04b101352e7e29a99ca8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-415fe6b0-c049-476a-a689-3f8ed2550402" -d '{"events": [{"name": "network-changed", "server_uuid": "067b7d98-4174-409c-85af-47a2dbf63a71", "tag": "4f943d44-a70c-4b88-9cac-b16783cab1e5"}]}' {{(pid=102477) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:10:00.366504 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:10:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-81ba5042-5e86-4b51-b90b-2cd8a802a708 x-openstack-request-id: req-81ba5042-5e86-4b51-b90b-2cd8a802a708 {{(pid=102477) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:10:00.366796 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "067b7d98-4174-409c-85af-47a2dbf63a71", "tag": "4f943d44-a70c-4b88-9cac-b16783cab1e5", "status": "completed", "code": 200}]} {{(pid=102477) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:10:00.367119 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-81ba5042-5e86-4b51-b90b-2cd8a802a708 {{(pid=102477) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:10:00.367542 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '067b7d98-4174-409c-85af-47a2dbf63a71', 'tag': '4f943d44-a70c-4b88-9cac-b16783cab1e5', 'status': 'completed', 'code': 200} Dec 24 05:10:00.415483 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-42ab3adb-668a-4251-8ea2-cfae4ff1f010 None None] Set router 9df11fe3-ba73-4793-a582-0e00f27a374d gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:10:00.453828 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-415fe6b0-c049-476a-a689-3f8ed2550402 req-1458e9aa-6c06-43ab-a62d-b1d99f382802 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:00.456062 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-415fe6b0-c049-476a-a689-3f8ed2550402 req-1458e9aa-6c06-43ab-a62d-b1d99f382802 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=8b1a80c6322a493ba10c69a77168b46f&device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 1099 time: 0.0450363 Dec 24 05:10:00.549926 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-415fe6b0-c049-476a-a689-3f8ed2550402 req-437cc03c-9f06-4352-b8ca-52080f53be32 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:00.551394 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-415fe6b0-c049-476a-a689-3f8ed2550402 req-437cc03c-9f06-4352-b8ca-52080f53be32 service neutron] 10.222.0.46 "GET /v2.0/networks?id=df2331c3-0dd0-460e-980f-1e2409baa35e HTTP/1.1" status: 200 len: 911 time: 0.0879116 Dec 24 05:10:00.616165 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-415fe6b0-c049-476a-a689-3f8ed2550402 req-6cd9cffa-45b9-4d55-999f-3dfc1ca1a157 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4f943d44-a70c-4b88-9cac-b16783cab1e5 HTTP/1.1" status: 200 len: 1000 time: 0.0578647 Dec 24 05:10:00.641971 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-42ab3adb-668a-4251-8ea2-cfae4ff1f010 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': 'dce0027a-d049-4ae2-9714-ef593a9b7a8f', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'floating_ip_address': '172.27.1.210', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'port_id': '4f943d44-a70c-4b88-9cac-b16783cab1e5', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 580, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'mac_address': 'fa:16:3e:5a:15:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '067b7d98-4174-409c-85af-47a2dbf63a71', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:09:59Z', 'updated_at': '2021-12-24T05:09:59Z', 'revision_number': 0, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '826094e8-3c74-4e96-9507-84128f7209f1', 'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'mac_address': 'fa:16:3e:b3:73:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:21Z', 'updated_at': '2021-12-24T05:06:27Z', 'revision_number': 5, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'subnets': [{'id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:10:00.667047 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-415fe6b0-c049-476a-a689-3f8ed2550402 req-019a27fc-bafb-4b67-9ee0-0ec088653f38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:00.667634 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42ab3adb-668a-4251-8ea2-cfae4ff1f010 None None] Checking router: 9df11fe3-ba73-4793-a582-0e00f27a374d for host: dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:10:00.668399 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-415fe6b0-c049-476a-a689-3f8ed2550402 req-019a27fc-bafb-4b67-9ee0-0ec088653f38 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=9df81c69-0712-4247-ad21-3b3a089ce4b5 HTTP/1.1" status: 200 len: 849 time: 0.0448434 Dec 24 05:10:00.676501 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-42ab3adb-668a-4251-8ea2-cfae4ff1f010 None None] Routers {'9df11fe3-ba73-4793-a582-0e00f27a374d'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:10:00.677147 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-42ab3adb-668a-4251-8ea2-cfae4ff1f010 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:09:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['9df11fe3-ba73-4793-a582-0e00f27a374d'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:10:00.717741 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-415fe6b0-c049-476a-a689-3f8ed2550402 req-022e35e7-b382-4a4c-973b-f9cc7c560462 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:00.719429 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-415fe6b0-c049-476a-a689-3f8ed2550402 req-022e35e7-b382-4a4c-973b-f9cc7c560462 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=df2331c3-0dd0-460e-980f-1e2409baa35e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0442235 Dec 24 05:10:00.812373 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-415fe6b0-c049-476a-a689-3f8ed2550402 req-feb52aff-c7be-450d-b843-5111e81a692d service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0858099 Dec 24 05:10:00.912352 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-415fe6b0-c049-476a-a689-3f8ed2550402 req-9a339175-3d64-4a70-a2b0-9f6afc7ffc72 service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0903084 Dec 24 05:10:00.914082 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-42ab3adb-668a-4251-8ea2-cfae4ff1f010 None None] Set router 9df11fe3-ba73-4793-a582-0e00f27a374d gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:10:01.147058 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-42ab3adb-668a-4251-8ea2-cfae4ff1f010 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': 'dce0027a-d049-4ae2-9714-ef593a9b7a8f', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'floating_ip_address': '172.27.1.210', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'port_id': '4f943d44-a70c-4b88-9cac-b16783cab1e5', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 580, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'mac_address': 'fa:16:3e:5a:15:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '067b7d98-4174-409c-85af-47a2dbf63a71', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:09:59Z', 'updated_at': '2021-12-24T05:09:59Z', 'revision_number': 0, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '826094e8-3c74-4e96-9507-84128f7209f1', 'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'mac_address': 'fa:16:3e:b3:73:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:21Z', 'updated_at': '2021-12-24T05:06:27Z', 'revision_number': 5, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'subnets': [{'id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:10:01.173271 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42ab3adb-668a-4251-8ea2-cfae4ff1f010 None None] The sync data for ids ['9df11fe3-ba73-4793-a582-0e00f27a374d'] in dv-cinder-816443-2-iscsi is: [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': 'dce0027a-d049-4ae2-9714-ef593a9b7a8f', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'floating_ip_address': '172.27.1.210', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'port_id': '4f943d44-a70c-4b88-9cac-b16783cab1e5', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 580, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'mac_address': 'fa:16:3e:5a:15:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '067b7d98-4174-409c-85af-47a2dbf63a71', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:09:59Z', 'updated_at': '2021-12-24T05:09:59Z', 'revision_number': 0, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '826094e8-3c74-4e96-9507-84128f7209f1', 'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'mac_address': 'fa:16:3e:b3:73:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:21Z', 'updated_at': '2021-12-24T05:06:27Z', 'revision_number': 5, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'subnets': [{'id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:10:01.367719 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aff2f060-2d78-4477-9237-c782559213dd None None] New status for floating IP dce0027a-d049-4ae2-9714-ef593a9b7a8f: ACTIVE {{(pid=102479) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 24 05:10:20.444936 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:23.213718 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-0a28abca-acd5-468e-b7bd-5b9a7b4f21e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:25.287524 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-a44bc888-0f1e-448d-9c45-737611a22400 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:26.512264 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:27.953920 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:28.598185 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:30.227371 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9818f2d6-dd60-469b-9685-7713423b6c31 req-96101cd0-9c0b-4fd5-a1f2-2298df470b9d service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0452850 Dec 24 05:10:30.329181 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9818f2d6-dd60-469b-9685-7713423b6c31 req-62a1ac17-43a6-44c4-9060-c1218f8e54ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:30.330691 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9818f2d6-dd60-469b-9685-7713423b6c31 req-62a1ac17-43a6-44c4-9060-c1218f8e54ed service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=6c9c47f70b8d4da5827a8ef4349559ab&device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 1099 time: 0.0436637 Dec 24 05:10:30.450189 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9818f2d6-dd60-469b-9685-7713423b6c31 req-c16bfc3e-ba3f-46ba-bc82-9c5949a2ea5e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:30.451666 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9818f2d6-dd60-469b-9685-7713423b6c31 req-c16bfc3e-ba3f-46ba-bc82-9c5949a2ea5e service neutron] 10.222.0.46 "GET /v2.0/networks?id=c908572e-3b6b-470c-8b88-35b51f1472c6 HTTP/1.1" status: 200 len: 917 time: 0.1002829 Dec 24 05:10:30.517806 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9818f2d6-dd60-469b-9685-7713423b6c31 req-59bb0246-2183-42bc-ad04-c680fd1fb88e service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8f0b0287-0281-4556-ae15-8fe2c2dbf50d HTTP/1.1" status: 200 len: 1001 time: 0.0586267 Dec 24 05:10:30.574575 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9818f2d6-dd60-469b-9685-7713423b6c31 req-8346fed7-64b7-4c91-9a8d-f0c3b3162ce7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:30.576063 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9818f2d6-dd60-469b-9685-7713423b6c31 req-8346fed7-64b7-4c91-9a8d-f0c3b3162ce7 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=699b398d-7f9d-4acb-bc18-ac32f35377c3 HTTP/1.1" status: 200 len: 855 time: 0.0513403 Dec 24 05:10:30.631503 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9818f2d6-dd60-469b-9685-7713423b6c31 req-0bc1f93e-b344-47e4-b822-322a766e1e63 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:30.633030 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9818f2d6-dd60-469b-9685-7713423b6c31 req-0bc1f93e-b344-47e4-b822-322a766e1e63 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=c908572e-3b6b-470c-8b88-35b51f1472c6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0492275 Dec 24 05:10:30.732358 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9818f2d6-dd60-469b-9685-7713423b6c31 req-49ee4325-87a6-468b-be42-ee40af8473c5 service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0917997 Dec 24 05:10:30.830809 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9818f2d6-dd60-469b-9685-7713423b6c31 req-83344841-45eb-4010-896a-ed38eb4c6ac9 service neutron] 10.222.0.46 "GET /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0904253 Dec 24 05:10:32.537169 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71ff9a9d-8d1f-4e83-a95e-3feb518be47d req-1767c6c3-dbb8-4374-8066-a1cbfde8f3f6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:32.538636 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-71ff9a9d-8d1f-4e83-a95e-3feb518be47d req-1767c6c3-dbb8-4374-8066-a1cbfde8f3f6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 946 time: 0.0494869 Dec 24 05:10:32.590105 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-71ff9a9d-8d1f-4e83-a95e-3feb518be47d req-c1b0f588-ca79-48f2-8702-f808556a83fe tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424097 Dec 24 05:10:33.434476 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:10:33.741318 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0044af07-9a38-41dc-8321-13bc812aef60 req-89be541f-1a8a-4211-bf15-1c8a9c5ba18f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:33.742788 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0044af07-9a38-41dc-8321-13bc812aef60 req-89be541f-1a8a-4211-bf15-1c8a9c5ba18f tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 946 time: 0.0622556 Dec 24 05:10:33.795498 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0044af07-9a38-41dc-8321-13bc812aef60 req-99bbde91-eca1-48d8-b4cb-6601f4ec0bc7 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups?id=51457a37-8626-4905-b242-c0b87df24845&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0466895 Dec 24 05:10:34.249883 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1fdd3d2-cc66-4a94-b472-f5ea04cdd912 req-8d13217c-7550-487c-83d3-687fffba7563 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:34.251925 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c1fdd3d2-cc66-4a94-b472-f5ea04cdd912 req-8d13217c-7550-487c-83d3-687fffba7563 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.46 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 946 time: 0.0649686 Dec 24 05:10:34.343647 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-c1fdd3d2-cc66-4a94-b472-f5ea04cdd912 req-0bfafe75-be99-448f-92f1-8bd379ddb4b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Deleting port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:10:34.343959 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-c1fdd3d2-cc66-4a94-b472-f5ea04cdd912 req-0bfafe75-be99-448f-92f1-8bd379ddb4b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:34.432438 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-c1fdd3d2-cc66-4a94-b472-f5ea04cdd912 req-0bfafe75-be99-448f-92f1-8bd379ddb4b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] For port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=8f0b0287-0281-4556-ae15-8fe2c2dbf50d,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:10:34.432836 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-c1fdd3d2-cc66-4a94-b472-f5ea04cdd912 req-0bfafe75-be99-448f-92f1-8bd379ddb4b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:34.602897 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-c1fdd3d2-cc66-4a94-b472-f5ea04cdd912 req-0bfafe75-be99-448f-92f1-8bd379ddb4b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:34.603248 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-c1fdd3d2-cc66-4a94-b472-f5ea04cdd912 req-0bfafe75-be99-448f-92f1-8bd379ddb4b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-545804'] for floatingip, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:34.603564 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.l3_db [req-c1fdd3d2-cc66-4a94-b472-f5ea04cdd912 req-0bfafe75-be99-448f-92f1-8bd379ddb4b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Floating IP c32cf6b1-238e-4d2d-a42b-bc2e6956d8d1 disassociated. External IP: 172.27.1.122, port: 8f0b0287-0281-4556-ae15-8fe2c2dbf50d. Dec 24 05:10:34.603899 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-c1fdd3d2-cc66-4a94-b472-f5ea04cdd912 req-0bfafe75-be99-448f-92f1-8bd379ddb4b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling delete_port for 8f0b0287-0281-4556-ae15-8fe2c2dbf50d owned by compute:nova {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:10:34.746801 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-c1fdd3d2-cc66-4a94-b472-f5ea04cdd912 req-0bfafe75-be99-448f-92f1-8bd379ddb4b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:34.773603 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bfafe75-be99-448f-92f1-8bd379ddb4b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Pushing event deleted for resources: {'Port': ['ID=8f0b0287-0281-4556-ae15-8fe2c2dbf50d,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:34.903910 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e8a62533-23b1-4b16-adbf-44b1ed9d705c req-be25d0ab-5f34-49a7-a570-d292852ba0f5 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/ports?device_id=cc21b91f-c07f-40f8-8cf1-a9c343386f03 HTTP/1.1" status: 200 len: 210 time: 0.0309086 Dec 24 05:10:34.912394 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [req-c1fdd3d2-cc66-4a94-b472-f5ea04cdd912 req-0bfafe75-be99-448f-92f1-8bd379ddb4b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Router d1392df8-0562-4659-9906-2d085b726626 has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102476) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:10:35.040939 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-c1fdd3d2-cc66-4a94-b472-f5ea04cdd912 req-0bfafe75-be99-448f-92f1-8bd379ddb4b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:10:35.050787 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03024fa4-8ddc-4d7c-a303-0c83d5ec774f None None] Sync routers for ids ['d1392df8-0562-4659-9906-2d085b726626'] in dv-cinder-816443-2-iscsi {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:10:35.061422 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03024fa4-8ddc-4d7c-a303-0c83d5ec774f None None] Routers {'d1392df8-0562-4659-9906-2d085b726626'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:10:35.062092 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-03024fa4-8ddc-4d7c-a303-0c83d5ec774f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:10:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['d1392df8-0562-4659-9906-2d085b726626'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:10:35.080407 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-c1fdd3d2-cc66-4a94-b472-f5ea04cdd912 req-0bfafe75-be99-448f-92f1-8bd379ddb4b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] No DVR routers for this DVR port 8f0b0287-0281-4556-ae15-8fe2c2dbf50d on host hv-cinder-81644 {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:10:35.083272 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-c1fdd3d2-cc66-4a94-b472-f5ea04cdd912 req-0bfafe75-be99-448f-92f1-8bd379ddb4b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:35.087250 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c1fdd3d2-cc66-4a94-b472-f5ea04cdd912 req-0bfafe75-be99-448f-92f1-8bd379ddb4b6 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.46 "DELETE /v2.0/ports/8f0b0287-0281-4556-ae15-8fe2c2dbf50d HTTP/1.1" status: 204 len: 173 time: 0.8289030 Dec 24 05:10:35.087741 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cc21b91f-c07f-40f8-8cf1-a9c343386f03', 'name': 'network-vif-deleted', 'tag': '8f0b0287-0281-4556-ae15-8fe2c2dbf50d'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:10:35.090028 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-56ec562b-f2bb-428e-8562-ab0a1dd6c371" -d '{"events": [{"server_uuid": "cc21b91f-c07f-40f8-8cf1-a9c343386f03", "name": "network-vif-deleted", "tag": "8f0b0287-0281-4556-ae15-8fe2c2dbf50d"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:10:35.174709 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-03024fa4-8ddc-4d7c-a303-0c83d5ec774f None None] Set router d1392df8-0562-4659-9906-2d085b726626 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:10:35.350830 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:10:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3331c0cb-3cd3-481e-9cb5-d88aef8e6ac4 x-openstack-request-id: req-3331c0cb-3cd3-481e-9cb5-d88aef8e6ac4 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:10:35.351341 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cc21b91f-c07f-40f8-8cf1-a9c343386f03", "name": "network-vif-deleted", "tag": "8f0b0287-0281-4556-ae15-8fe2c2dbf50d", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:10:35.351341 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-3331c0cb-3cd3-481e-9cb5-d88aef8e6ac4 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:10:35.351675 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cc21b91f-c07f-40f8-8cf1-a9c343386f03', 'name': 'network-vif-deleted', 'tag': '8f0b0287-0281-4556-ae15-8fe2c2dbf50d', 'status': 'completed', 'code': 200} Dec 24 05:10:35.388625 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-03024fa4-8ddc-4d7c-a303-0c83d5ec774f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1392df8-0562-4659-9906-2d085b726626', 'name': 'tempest-AttachVolumeShelveTestJSON-634320677-router', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148'}], 'enable_snat': True}, 'gw_port_id': 'd5be979e-f11f-424a-bd46-164029481a60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:06Z', 'updated_at': '2021-12-24T04:59:13Z', 'revision_number': 4, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'gw_port': {'id': 'd5be979e-f11f-424a-bd46-164029481a60', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:30:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:07Z', 'updated_at': '2021-12-24T04:59:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '3e72624e-ab22-45c6-b262-91a63ca05279', 'name': '', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'mac_address': 'fa:16:3e:38:ea:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:12Z', 'updated_at': '2021-12-24T04:59:19Z', 'revision_number': 5, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'subnets': [{'id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:10:35.417389 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03024fa4-8ddc-4d7c-a303-0c83d5ec774f None None] Checking router: d1392df8-0562-4659-9906-2d085b726626 for host: dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:10:35.426555 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03024fa4-8ddc-4d7c-a303-0c83d5ec774f None None] Routers {'d1392df8-0562-4659-9906-2d085b726626'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:10:35.427157 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-03024fa4-8ddc-4d7c-a303-0c83d5ec774f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:10:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['d1392df8-0562-4659-9906-2d085b726626'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:10:35.541262 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-03024fa4-8ddc-4d7c-a303-0c83d5ec774f None None] Set router d1392df8-0562-4659-9906-2d085b726626 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:10:35.743479 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-03024fa4-8ddc-4d7c-a303-0c83d5ec774f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1392df8-0562-4659-9906-2d085b726626', 'name': 'tempest-AttachVolumeShelveTestJSON-634320677-router', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148'}], 'enable_snat': True}, 'gw_port_id': 'd5be979e-f11f-424a-bd46-164029481a60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:06Z', 'updated_at': '2021-12-24T04:59:13Z', 'revision_number': 4, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'gw_port': {'id': 'd5be979e-f11f-424a-bd46-164029481a60', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:30:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:07Z', 'updated_at': '2021-12-24T04:59:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '3e72624e-ab22-45c6-b262-91a63ca05279', 'name': '', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'mac_address': 'fa:16:3e:38:ea:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:12Z', 'updated_at': '2021-12-24T04:59:19Z', 'revision_number': 5, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'subnets': [{'id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:10:35.768487 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03024fa4-8ddc-4d7c-a303-0c83d5ec774f None None] The sync data for ids ['d1392df8-0562-4659-9906-2d085b726626'] in dv-cinder-816443-2-iscsi is: [{'id': 'd1392df8-0562-4659-9906-2d085b726626', 'name': 'tempest-AttachVolumeShelveTestJSON-634320677-router', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148'}], 'enable_snat': True}, 'gw_port_id': 'd5be979e-f11f-424a-bd46-164029481a60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:06Z', 'updated_at': '2021-12-24T04:59:13Z', 'revision_number': 4, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'gw_port': {'id': 'd5be979e-f11f-424a-bd46-164029481a60', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:30:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:07Z', 'updated_at': '2021-12-24T04:59:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '3e72624e-ab22-45c6-b262-91a63ca05279', 'name': '', 'network_id': 'c908572e-3b6b-470c-8b88-35b51f1472c6', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'mac_address': 'fa:16:3e:38:ea:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:12Z', 'updated_at': '2021-12-24T04:59:19Z', 'revision_number': 5, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'subnets': [{'id': '699b398d-7f9d-4acb-bc18-ac32f35377c3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:10:35.998533 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2043f62b-8426-45b7-b2f4-06d5dd80a011 None None] New status for floating IP c32cf6b1-238e-4d2d-a42b-bc2e6956d8d1: DOWN {{(pid=102479) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 24 05:10:36.001884 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34282) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:10:36.057302 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-cc431763-0d5d-433f-9e73-af072ea43579 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:36.081081 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-cc431763-0d5d-433f-9e73-af072ea43579 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:36.135168 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-cc431763-0d5d-433f-9e73-af072ea43579 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:36.137911 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-cc431763-0d5d-433f-9e73-af072ea43579 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:36.141959 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-cc431763-0d5d-433f-9e73-af072ea43579 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "DELETE /v2.0/security-groups/51457a37-8626-4905-b242-c0b87df24845 HTTP/1.1" status: 204 len: 168 time: 0.1388929 Dec 24 05:10:36.142242 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34284) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:10:36.151312 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc431763-0d5d-433f-9e73-af072ea43579 tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=51457a37-8626-4905-b242-c0b87df24845,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:36.155331 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.api.v2.resource [None req-badbc4d8-dd28-4ae3-9da1-d824a02defeb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] show failed (client error): The resource could not be found. Dec 24 05:10:36.156324 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-badbc4d8-dd28-4ae3-9da1-d824a02defeb tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "GET /v2.0/security-groups/51457a37-8626-4905-b242-c0b87df24845 HTTP/1.1" status: 404 len: 347 time: 0.0133843 Dec 24 05:10:36.159458 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34286) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:10:36.287714 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-db440d2d-001f-4536-86f1-974fb1bea44e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Deleting port 77090082-9ef3-4800-9a4d-5da23b7e1931 {{(pid=102477) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:10:36.288019 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-db440d2d-001f-4536-86f1-974fb1bea44e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:36.364707 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-db440d2d-001f-4536-86f1-974fb1bea44e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:36.365021 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-db440d2d-001f-4536-86f1-974fb1bea44e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:36.379895 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-db440d2d-001f-4536-86f1-974fb1bea44e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Calling delete_port for 77090082-9ef3-4800-9a4d-5da23b7e1931 owned by network:floatingip {{(pid=102477) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:10:36.519753 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-db440d2d-001f-4536-86f1-974fb1bea44e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:36.545763 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db440d2d-001f-4536-86f1-974fb1bea44e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Pushing event deleted for resources: {'Port': ['ID=77090082-9ef3-4800-9a4d-5da23b7e1931,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:36.605955 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-db440d2d-001f-4536-86f1-974fb1bea44e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks [] for floatingip, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:36.608585 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-db440d2d-001f-4536-86f1-974fb1bea44e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for floatingip, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:36.609777 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-db440d2d-001f-4536-86f1-974fb1bea44e tempest-AttachVolumeShelveTestJSON-1224628779 tempest-AttachVolumeShelveTestJSON-1224628779-project] 10.222.0.43 "DELETE /v2.0/floatingips/c32cf6b1-238e-4d2d-a42b-bc2e6956d8d1 HTTP/1.1" status: 204 len: 168 time: 0.4494157 Dec 24 05:10:37.062723 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 8f0b0287-0281-4556-ae15-8fe2c2dbf50d no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:10:37.088567 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] No Port match for: 8f0b0287-0281-4556-ae15-8fe2c2dbf50d {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:10:37.088924 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 8f0b0287-0281-4556-ae15-8fe2c2dbf50d not bound to the agent host hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:10:39.057205 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34308) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:10:39.547234 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2af67343-9c36-43c4-9b54-705b3286f38f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-548364'] for router_interface, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:39.811572 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-2af67343-9c36-43c4-9b54-705b3286f38f admin admin] Deleting port 3e72624e-ab22-45c6-b262-91a63ca05279 {{(pid=102477) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:10:39.811907 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2af67343-9c36-43c4-9b54-705b3286f38f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:39.888102 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.db [None req-2af67343-9c36-43c4-9b54-705b3286f38f admin admin] For port 3e72624e-ab22-45c6-b262-91a63ca05279, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=3e72624e-ab22-45c6-b262-91a63ca05279,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102477) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:10:39.888474 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2af67343-9c36-43c4-9b54-705b3286f38f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:39.905249 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-2af67343-9c36-43c4-9b54-705b3286f38f admin admin] Calling delete_port for 3e72624e-ab22-45c6-b262-91a63ca05279 owned by network:router_interface {{(pid=102477) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:10:40.097884 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2af67343-9c36-43c4-9b54-705b3286f38f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:40.122490 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2af67343-9c36-43c4-9b54-705b3286f38f admin admin] Pushing event deleted for resources: {'Port': ['ID=3e72624e-ab22-45c6-b262-91a63ca05279,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:40.286899 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2af67343-9c36-43c4-9b54-705b3286f38f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-627465', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-548448'] for router_interface, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:40.503614 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2af67343-9c36-43c4-9b54-705b3286f38f admin admin] Router d1392df8-0562-4659-9906-2d085b726626 has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102477) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:10:40.621990 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2af67343-9c36-43c4-9b54-705b3286f38f admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102477) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:10:40.627353 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-2af67343-9c36-43c4-9b54-705b3286f38f admin admin] 10.222.0.43 "PUT /v2.0/routers/d1392df8-0562-4659-9906-2d085b726626/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5691226 Dec 24 05:10:40.630246 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34314) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:10:40.631357 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f99aa743-d4df-49fd-9558-de3360f9cf45 None None] Sync routers for ids ['d1392df8-0562-4659-9906-2d085b726626'] in dv-cinder-816443-2-iscsi {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:10:40.642777 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f99aa743-d4df-49fd-9558-de3360f9cf45 None None] Routers {'d1392df8-0562-4659-9906-2d085b726626'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:10:40.643459 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-f99aa743-d4df-49fd-9558-de3360f9cf45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:10:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['d1392df8-0562-4659-9906-2d085b726626'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:10:40.738816 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Publish callbacks [] for router, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:40.749314 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-f99aa743-d4df-49fd-9558-de3360f9cf45 None None] Set router d1392df8-0562-4659-9906-2d085b726626 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:10:40.841286 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:40.894602 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Deleting port d5be979e-f11f-424a-bd46-164029481a60 {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:10:40.894952 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:40.924551 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-f99aa743-d4df-49fd-9558-de3360f9cf45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1392df8-0562-4659-9906-2d085b726626', 'name': 'tempest-AttachVolumeShelveTestJSON-634320677-router', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148'}], 'enable_snat': True}, 'gw_port_id': 'd5be979e-f11f-424a-bd46-164029481a60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:06Z', 'updated_at': '2021-12-24T05:10:40Z', 'revision_number': 5, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'gw_port': {'id': 'd5be979e-f11f-424a-bd46-164029481a60', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:30:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1392df8-0562-4659-9906-2d085b726626', 'device_owner': 'network:router_gateway', 'standard_attr_id': 52, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.148', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T04:59:07Z', 'updated_at': '2021-12-24T04:59:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:10:40.979402 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] For port d5be979e-f11f-424a-bd46-164029481a60, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=d5be979e-f11f-424a-bd46-164029481a60,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:10:40.979799 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:40.993585 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Calling delete_port for d5be979e-f11f-424a-bd46-164029481a60 owned by network:router_gateway {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:10:41.083302 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f99aa743-d4df-49fd-9558-de3360f9cf45 None None] Checking router: d1392df8-0562-4659-9906-2d085b726626 for host: dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:10:41.092137 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f99aa743-d4df-49fd-9558-de3360f9cf45 None None] Routers {'d1392df8-0562-4659-9906-2d085b726626'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:10:41.092707 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-f99aa743-d4df-49fd-9558-de3360f9cf45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:10:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['d1392df8-0562-4659-9906-2d085b726626'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:10:41.161655 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:41.180138 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-f99aa743-d4df-49fd-9558-de3360f9cf45 None None] Set router d1392df8-0562-4659-9906-2d085b726626 gateway port host: None {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:10:41.190019 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Pushing event deleted for resources: {'Port': ['ID=d5be979e-f11f-424a-bd46-164029481a60,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:41.201799 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:41.202147 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:41.202528 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:41.202868 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:41.203189 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:41.203516 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:41.203836 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:41.204159 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:41.204464 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:41.204827 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:41.205145 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:41.205458 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:41.205773 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:41.233030 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-f99aa743-d4df-49fd-9558-de3360f9cf45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1392df8-0562-4659-9906-2d085b726626', 'name': 'tempest-AttachVolumeShelveTestJSON-634320677-router', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:06Z', 'updated_at': '2021-12-24T05:10:40Z', 'revision_number': 6, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'gw_port_host': None}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:10:41.257526 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-545986'] for router_gateway, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:41.262546 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f99aa743-d4df-49fd-9558-de3360f9cf45 None None] The sync data for ids ['d1392df8-0562-4659-9906-2d085b726626'] in dv-cinder-816443-2-iscsi is: [{'id': 'd1392df8-0562-4659-9906-2d085b726626', 'name': 'tempest-AttachVolumeShelveTestJSON-634320677-router', 'tenant_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T04:59:06Z', 'updated_at': '2021-12-24T05:10:40Z', 'revision_number': 6, 'project_id': '6c9c47f70b8d4da5827a8ef4349559ab', 'gw_port_host': None}] {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:10:41.349685 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-546088', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2070312'] for router, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:41.351828 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:41.395884 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-546081'] for router, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:41.396757 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Fanout notify agent at l3_agent the message router_deleted on router d1392df8-0562-4659-9906-2d085b726626 {{(pid=102476) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 24 05:10:41.402704 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] Publish callbacks [] for router, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:41.404890 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-c33b1ad7-c08c-4162-9029-c488af13c9ea admin admin] 10.222.0.43 "DELETE /v2.0/routers/d1392df8-0562-4659-9906-2d085b726626 HTTP/1.1" status: 204 len: 168 time: 0.7734489 Dec 24 05:10:41.407412 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34316) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:10:41.459525 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.db_base_plugin_v2 [None req-c788970a-7b8c-4506-91e4-dcdcd224df0f admin admin] Deleting subnet 699b398d-7f9d-4acb-bc18-ac32f35377c3 {{(pid=102477) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Dec 24 05:10:41.463705 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c788970a-7b8c-4506-91e4-dcdcd224df0f admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:41.499997 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c788970a-7b8c-4506-91e4-dcdcd224df0f admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-29535554'] for subnet, precommit_delete_associations {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:41.583451 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c788970a-7b8c-4506-91e4-dcdcd224df0f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3590439'] for subnet, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:41.644366 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c788970a-7b8c-4506-91e4-dcdcd224df0f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3590440', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-29535541', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-29853072'] for subnet, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:41.670793 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c788970a-7b8c-4506-91e4-dcdcd224df0f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=699b398d-7f9d-4acb-bc18-ac32f35377c3,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:41.675343 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c788970a-7b8c-4506-91e4-dcdcd224df0f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:41.681096 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-c788970a-7b8c-4506-91e4-dcdcd224df0f admin admin] 10.222.0.43 "DELETE /v2.0/subnets/699b398d-7f9d-4acb-bc18-ac32f35377c3 HTTP/1.1" status: 204 len: 168 time: 0.2703407 Dec 24 05:10:41.681255 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ac9dd7c1-c37c-42c6-9d4b-9fcfa0d2e233 None None] Network c908572e-3b6b-470c-8b88-35b51f1472c6 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:10:41.681707 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34318) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:10:41.751292 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eb9c668c-c3cb-440a-b1e6-0eaf0bf817d7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3741433'] for network, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:41.804663 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-eb9c668c-c3cb-440a-b1e6-0eaf0bf817d7 admin admin] Deleting port 94023408-d2c9-43c8-9add-6e9c458c33e2 {{(pid=102477) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:10:41.805007 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eb9c668c-c3cb-440a-b1e6-0eaf0bf817d7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:41.867122 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.db [None req-eb9c668c-c3cb-440a-b1e6-0eaf0bf817d7 admin admin] For port 94023408-d2c9-43c8-9add-6e9c458c33e2, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=94023408-d2c9-43c8-9add-6e9c458c33e2,segment=NetworkSegment(db374990-dadf-47a9-9824-44188ba20dd8),segment_id=db374990-dadf-47a9-9824-44188ba20dd8)] {{(pid=102477) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:10:41.867495 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eb9c668c-c3cb-440a-b1e6-0eaf0bf817d7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:41.879559 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-eb9c668c-c3cb-440a-b1e6-0eaf0bf817d7 admin admin] Calling delete_port for 94023408-d2c9-43c8-9add-6e9c458c33e2 owned by network:dhcp {{(pid=102477) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:10:41.968169 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eb9c668c-c3cb-440a-b1e6-0eaf0bf817d7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:41.998544 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb9c668c-c3cb-440a-b1e6-0eaf0bf817d7 admin admin] Pushing event deleted for resources: {'Port': ['ID=94023408-d2c9-43c8-9add-6e9c458c33e2,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:42.004051 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb9c668c-c3cb-440a-b1e6-0eaf0bf817d7 admin admin] No DVR routers for this DVR port 94023408-d2c9-43c8-9add-6e9c458c33e2 on host dv-cinder-816443-2-iscsi {{(pid=102477) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:10:42.058702 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c68a15b5-f52a-4300-9832-01bbcb96ab72 None None] DHCP port deletion for c908572e-3b6b-470c-8b88-35b51f1472c6 request from dv-cinder-816443-2-iscsi {{(pid=102478) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 24 05:10:42.126946 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device d5be979e-f11f-424a-bd46-164029481a60 no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:10:42.153352 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: d5be979e-f11f-424a-bd46-164029481a60 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:10:42.153693 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device d5be979e-f11f-424a-bd46-164029481a60 not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:10:42.154298 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 3e72624e-ab22-45c6-b262-91a63ca05279 no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:10:42.175710 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: 3e72624e-ab22-45c6-b262-91a63ca05279 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:10:42.176033 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 3e72624e-ab22-45c6-b262-91a63ca05279 not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:10:42.176489 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 94023408-d2c9-43c8-9add-6e9c458c33e2 no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:10:42.196513 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: 94023408-d2c9-43c8-9add-6e9c458c33e2 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:10:42.196890 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 94023408-d2c9-43c8-9add-6e9c458c33e2 not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:10:42.315229 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eb9c668c-c3cb-440a-b1e6-0eaf0bf817d7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3595960', 'neutron.services.segments.db._delete_segments_for_network-8750577966942'] for network, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:42.335969 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.services.segments.db [None req-eb9c668c-c3cb-440a-b1e6-0eaf0bf817d7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c908572e-3b6b-470c-8b88-35b51f1472c6']}} {{(pid=102477) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:10:42.345219 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.services.segments.db [None req-eb9c668c-c3cb-440a-b1e6-0eaf0bf817d7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'db374990-dadf-47a9-9824-44188ba20dd8') {'for_net_delete': True} {{(pid=102477) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:10:42.345516 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.services.segments.db [None req-eb9c668c-c3cb-440a-b1e6-0eaf0bf817d7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'db374990-dadf-47a9-9824-44188ba20dd8') {} {{(pid=102477) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:10:42.354948 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eb9c668c-c3cb-440a-b1e6-0eaf0bf817d7 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750577970535', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-29535605'] for segment, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:42.368254 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eb9c668c-c3cb-440a-b1e6-0eaf0bf817d7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:42.374542 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-eb9c668c-c3cb-440a-b1e6-0eaf0bf817d7 admin admin] Releasing vlan 149 on physical network physnet1 to pool {{(pid=102477) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 24 05:10:42.374924 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eb9c668c-c3cb-440a-b1e6-0eaf0bf817d7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29532823'] for segment, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: Traceback (most recent call last): Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: timer() Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: cb(*args, **kw) Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: return func(*args, **kwargs) Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: self._notify() Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: self.callback(batched_events) Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: event.method(event) Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: aggregate_uuid = self.p_client.list_aggregates( Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: return f(self, *a, **k) Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: return self._get(url).json() Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: return self.request(url, 'GET', **kwargs) Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: base_url = self.get_endpoint(auth, allow=allow, Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 24 05:10:42.376637 dv-cinder-816443-2-iscsi neutron-server[102477]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 24 05:10:42.430815 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eb9c668c-c3cb-440a-b1e6-0eaf0bf817d7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3595937', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-546046'] for network, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:42.436296 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eb9c668c-c3cb-440a-b1e6-0eaf0bf817d7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:42.439470 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-eb9c668c-c3cb-440a-b1e6-0eaf0bf817d7 admin admin] 10.222.0.43 "DELETE /v2.0/networks/c908572e-3b6b-470c-8b88-35b51f1472c6 HTTP/1.1" status: 204 len: 168 time: 0.7572100 Dec 24 05:10:42.450210 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb9c668c-c3cb-440a-b1e6-0eaf0bf817d7 admin admin] Pushing event deleted for resources: {'Network': ['ID=c908572e-3b6b-470c-8b88-35b51f1472c6,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:42.556013 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34322) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:10:42.600563 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-d0f1bc20-c000-4812-a19d-04f1bc76fa96 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=6c9c47f70b8d4da5827a8ef4349559ab&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0432377 Dec 24 05:10:42.603485 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34324) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:10:42.651604 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7a63edbb-f469-44f6-b73b-5be511c856ac admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:42.680873 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7a63edbb-f469-44f6-b73b-5be511c856ac admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:42.736911 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7a63edbb-f469-44f6-b73b-5be511c856ac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:42.739444 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7a63edbb-f469-44f6-b73b-5be511c856ac admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:42.740637 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-7a63edbb-f469-44f6-b73b-5be511c856ac admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/71f3a879-ea97-4cf6-9076-0540192042b1 HTTP/1.1" status: 204 len: 168 time: 0.1360457 Dec 24 05:10:42.748319 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a63edbb-f469-44f6-b73b-5be511c856ac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=71f3a879-ea97-4cf6-9076-0540192042b1,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:43.439836 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34346) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:10:43.545010 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-a6768c00-700c-4b64-af5e-eee34359bafe admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-1934153865-network', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:10:43.570350 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a6768c00-700c-4b64-af5e-eee34359bafe admin admin] Made reservation on behalf of fc4cefad8fef403e90ad695e2098ee7b for: {'network': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:10:43.572933 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a6768c00-700c-4b64-af5e-eee34359bafe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for network, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:43.581504 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a6768c00-700c-4b64-af5e-eee34359bafe admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:43.656146 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a6768c00-700c-4b64-af5e-eee34359bafe admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:43.661708 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a6768c00-700c-4b64-af5e-eee34359bafe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:43.685767 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a6768c00-700c-4b64-af5e-eee34359bafe admin admin] vlan segment allocate from pool success with {'vlan_id': 128, 'physical_network': 'physnet1'} {{(pid=102476) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 24 05:10:43.695419 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6768c00-700c-4b64-af5e-eee34359bafe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=705cd6f0-1c41-443a-b2ba-d2a461b9b791,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:43.700205 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a6768c00-700c-4b64-af5e-eee34359bafe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:43.700456 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.segments_db [None req-a6768c00-700c-4b64-af5e-eee34359bafe admin admin] Added segment 58060104-31c9-4b9f-ad66-9f4a4de56096 of type vlan for network 075b69cb-c546-4fa5-aa29-49a5b85c94b1 Dec 24 05:10:43.744495 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a6768c00-700c-4b64-af5e-eee34359bafe admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750577486812'] for network, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:43.771371 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a6768c00-700c-4b64-af5e-eee34359bafe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for network, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:43.772313 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a6768c00-700c-4b64-af5e-eee34359bafe admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:43.772897 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a6768c00-700c-4b64-af5e-eee34359bafe admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:43.806354 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-a6768c00-700c-4b64-af5e-eee34359bafe admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.3647532 Dec 24 05:10:43.808709 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34350) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:10:43.813759 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] Request body: {'subnet': {'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-1934153865-subnet', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:10:43.831980 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6768c00-700c-4b64-af5e-eee34359bafe admin admin] Pushing event updated for resources: {'Network': ['ID=075b69cb-c546-4fa5-aa29-49a5b85c94b1,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:43.839162 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] Made reservation on behalf of fc4cefad8fef403e90ad695e2098ee7b for: {'subnet': 1} {{(pid=102477) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:10:43.841481 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-29853115'] for subnet, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:43.843493 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Network 075b69cb-c546-4fa5-aa29-49a5b85c94b1 details requested by agent ovs-agent-dv-cinder-816443-2-iscsi with host dv-cinder-816443-2-iscsi {{(pid=102478) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 24 05:10:44.019340 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-29535722', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-29853097'] for subnet, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:44.082859 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] Pushing event updated for resources: {'Subnet': ['ID=314909f7-3ba5-49d4-a94f-2ebca4c9a707,revision_number=0']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:44.095140 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:44.095495 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:44.095819 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:44.096150 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:44.096473 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:44.096823 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:44.097147 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:44.097511 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:44.097785 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:44.098122 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:44.098448 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:44.098712 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:44.099017 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:44.102388 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] Checking segment: {'id': '58060104-31c9-4b9f-ad66-9f4a4de56096', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102477) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:10:44.102886 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] Network hostable DHCP agents. Network: 075b69cb-c546-4fa5-aa29-49a5b85c94b1, hostable agents: ['01bc2530-0600-4d1b-b486-2fd9d63a2d51'], hosted agents: [] {{(pid=102477) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 24 05:10:44.121242 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] Network 075b69cb-c546-4fa5-aa29-49a5b85c94b1 is scheduled to be hosted by DHCP agent 01bc2530-0600-4d1b-b486-2fd9d63a2d51 with binding_index 1 {{(pid=102477) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 24 05:10:44.131662 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816443-2-iscsi, 075b69cb-c546-4fa5-aa29-49a5b85c94b1) {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:10:44.135718 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:44.136419 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:44.140557 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4baeac10-ffc9-4daa-9540-9996a8d1a22f None None] Network 075b69cb-c546-4fa5-aa29-49a5b85c94b1 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:10:44.152251 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-5dfdf667-d3b5-42e7-8cb1-f99c78acf34c admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.3423953 Dec 24 05:10:44.155168 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34352) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:10:44.159478 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-f441ba1b-ec66-4ce2-9d34-c7279c37b52c admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-1934153865-router', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:10:44.183042 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f441ba1b-ec66-4ce2-9d34-c7279c37b52c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-546186', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2070334'] for router, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:44.184111 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f441ba1b-ec66-4ce2-9d34-c7279c37b52c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-546302', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-549497', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-553463', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2070311'] for router, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:44.234023 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f441ba1b-ec66-4ce2-9d34-c7279c37b52c admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:44.241998 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-efabf111-d071-4989-9770-c22d1b854082 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpd2866d45-53d6-5577-9724-7d7a303c375f-075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'fixed_ips': [{'subnet_id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707'}]}} from dv-cinder-816443-2-iscsi. {{(pid=102478) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 24 05:10:44.243067 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-efabf111-d071-4989-9770-c22d1b854082 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:44.367960 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f441ba1b-ec66-4ce2-9d34-c7279c37b52c admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:44.381757 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.db_base_plugin_common [None req-efabf111-d071-4989-9770-c22d1b854082 None None] Allocated IP 172.20.0.2 (075b69cb-c546-4fa5-aa29-49a5b85c94b1/314909f7-3ba5-49d4-a94f-2ebca4c9a707/10ca479f-d446-4321-95f5-b3659a965554) {{(pid=102478) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:10:44.524845 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-efabf111-d071-4989-9770-c22d1b854082 None None] Publish callbacks [] for port, precommit_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:44.531633 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-efabf111-d071-4989-9770-c22d1b854082 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001'] for port, after_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:44.568149 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f441ba1b-ec66-4ce2-9d34-c7279c37b52c admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:44.570282 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-efabf111-d071-4989-9770-c22d1b854082 None None] Network 075b69cb-c546-4fa5-aa29-49a5b85c94b1 is already hosted by enough agents. {{(pid=102478) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:10:44.573343 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.scheduler.base_scheduler [None req-efabf111-d071-4989-9770-c22d1b854082 None None] Resources bound (agent type, host, resource id): {{(pid=102478) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:10:44.575932 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-efabf111-d071-4989-9770-c22d1b854082 None None] Received port after_create {{(pid=102478) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:10:44.589404 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efabf111-d071-4989-9770-c22d1b854082 None None] Pushing event updated for resources: {'Port': ['ID=10ca479f-d446-4321-95f5-b3659a965554,revision_number=1']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:44.591047 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f441ba1b-ec66-4ce2-9d34-c7279c37b52c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:44.641263 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-efabf111-d071-4989-9770-c22d1b854082 None None] Attempting to bind port 10ca479f-d446-4321-95f5-b3659a965554 on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:10:44.641801 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-efabf111-d071-4989-9770-c22d1b854082 None None] Attempting to bind port 10ca479f-d446-4321-95f5-b3659a965554 by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': '58060104-31c9-4b9f-ad66-9f4a4de56096', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1'}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:10:44.642166 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-efabf111-d071-4989-9770-c22d1b854082 None None] Attempting to bind port 10ca479f-d446-4321-95f5-b3659a965554 on network 075b69cb-c546-4fa5-aa29-49a5b85c94b1 {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:10:44.647355 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-efabf111-d071-4989-9770-c22d1b854082 None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 10, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:10:44.647731 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-efabf111-d071-4989-9770-c22d1b854082 None None] Checking segment: {'id': '58060104-31c9-4b9f-ad66-9f4a4de56096', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102478) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:10:44.648199 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-efabf111-d071-4989-9770-c22d1b854082 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:44.648635 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-efabf111-d071-4989-9770-c22d1b854082 None None] Bound using segment: {'id': '58060104-31c9-4b9f-ad66-9f4a4de56096', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1'} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:10:44.649113 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-efabf111-d071-4989-9770-c22d1b854082 None None] Bound port: 10ca479f-d446-4321-95f5-b3659a965554, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '58060104-31c9-4b9f-ad66-9f4a4de56096', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1'}}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:10:44.649497 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-efabf111-d071-4989-9770-c22d1b854082 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:44.696583 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.db_base_plugin_common [None req-f441ba1b-ec66-4ce2-9d34-c7279c37b52c admin admin] Allocated IP 172.27.1.183 (9b4e4b31-551f-45a9-b26a-cb44ee20a17d/f277b899-8779-420e-8a8d-bfcd5eb7f012/69bfb4cb-d5e2-40de-abc0-2609f75b29ca) {{(pid=102477) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:10:44.711246 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-efabf111-d071-4989-9770-c22d1b854082 None None] For port 10ca479f-d446-4321-95f5-b3659a965554, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102478) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:10:44.714527 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-efabf111-d071-4989-9770-c22d1b854082 None None] For port 10ca479f-d446-4321-95f5-b3659a965554, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=10ca479f-d446-4321-95f5-b3659a965554,segment=NetworkSegment(58060104-31c9-4b9f-ad66-9f4a4de56096),segment_id=58060104-31c9-4b9f-ad66-9f4a4de56096)] {{(pid=102478) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:10:44.718763 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-efabf111-d071-4989-9770-c22d1b854082 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:44.777523 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efabf111-d071-4989-9770-c22d1b854082 None None] Pushing event updated for resources: {'Port': ['ID=10ca479f-d446-4321-95f5-b3659a965554,revision_number=2']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:44.805820 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f441ba1b-ec66-4ce2-9d34-c7279c37b52c admin admin] Publish callbacks [] for port, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:44.842466 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f441ba1b-ec66-4ce2-9d34-c7279c37b52c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:44.882709 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f441ba1b-ec66-4ce2-9d34-c7279c37b52c admin admin] Network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d is already hosted by enough agents. {{(pid=102477) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:10:44.885833 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-f441ba1b-ec66-4ce2-9d34-c7279c37b52c admin admin] Resources bound (agent type, host, resource id): {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:10:44.889574 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f441ba1b-ec66-4ce2-9d34-c7279c37b52c admin admin] Received port after_create {{(pid=102477) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:10:44.895292 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f441ba1b-ec66-4ce2-9d34-c7279c37b52c admin admin] Pushing event updated for resources: {'Port': ['ID=69bfb4cb-d5e2-40de-abc0-2609f75b29ca,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:45.165632 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f441ba1b-ec66-4ce2-9d34-c7279c37b52c admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:45.367047 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f441ba1b-ec66-4ce2-9d34-c7279c37b52c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-546295', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-545958'] for router, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:45.501077 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f441ba1b-ec66-4ce2-9d34-c7279c37b52c admin admin] Router 3e033806-af20-4ee4-8d0e-05f57044dfa3 is scheduled to L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 with binding_index 1 {{(pid=102477) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 24 05:10:45.610124 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f441ba1b-ec66-4ce2-9d34-c7279c37b52c admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102477) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:10:45.619634 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] Sync routers for ids ['3e033806-af20-4ee4-8d0e-05f57044dfa3'] in dv-cinder-816443-2-iscsi {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:10:45.629765 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] Routers {'3e033806-af20-4ee4-8d0e-05f57044dfa3'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:10:45.630076 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f441ba1b-ec66-4ce2-9d34-c7279c37b52c admin admin] Publish callbacks [] for router, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:45.630383 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:10:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['3e033806-af20-4ee4-8d0e-05f57044dfa3'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:10:45.631490 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-f441ba1b-ec66-4ce2-9d34-c7279c37b52c admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 1.4753611 Dec 24 05:10:45.634866 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34354) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:10:45.641774 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48280c37-d27f-461f-8522-82c6561ec8e8 None None] Network 075b69cb-c546-4fa5-aa29-49a5b85c94b1 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:10:45.742269 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] Set router 3e033806-af20-4ee4-8d0e-05f57044dfa3 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:10:45.752197 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-a4e8d40b-c3ad-4a05-9cc9-d7c5615e24a6 None None] Provisioning complete for port 10ca479f-d446-4321-95f5-b3659a965554 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:10:45.753700 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-a4e8d40b-c3ad-4a05-9cc9-d7c5615e24a6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:45.843061 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-a4e8d40b-c3ad-4a05-9cc9-d7c5615e24a6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:45.912624 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-a4e8d40b-c3ad-4a05-9cc9-d7c5615e24a6 None None] For port 10ca479f-d446-4321-95f5-b3659a965554, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=10ca479f-d446-4321-95f5-b3659a965554,segment=NetworkSegment(58060104-31c9-4b9f-ad66-9f4a4de56096),segment_id=58060104-31c9-4b9f-ad66-9f4a4de56096)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:10:45.921409 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-a4e8d40b-c3ad-4a05-9cc9-d7c5615e24a6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:45.962776 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'name': 'tempest-AttachVolumeTestJSON-1934153865-router', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:45Z', 'revision_number': 3, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'gw_port': {'id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:28:6b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 591, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:44Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:10:46.003062 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] Checking router: 3e033806-af20-4ee4-8d0e-05f57044dfa3 for host: dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:10:46.003871 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] Updating router 3e033806-af20-4ee4-8d0e-05f57044dfa3 port 69bfb4cb-d5e2-40de-abc0-2609f75b29ca binding host dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 24 05:10:46.011967 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4e8d40b-c3ad-4a05-9cc9-d7c5615e24a6 None None] Pushing event updated for resources: {'Port': ['ID=10ca479f-d446-4321-95f5-b3659a965554,revision_number=3']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:46.046848 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:46.054586 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 10ca479f-d446-4321-95f5-b3659a965554 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:10:46.074972 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-a6d95e47-9619-43f8-884c-78a985bcc16b None None] Provisioning complete for port 10ca479f-d446-4321-95f5-b3659a965554 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:10:46.075342 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-a6d95e47-9619-43f8-884c-78a985bcc16b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:46.141515 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 10ca479f-d446-4321-95f5-b3659a965554 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:10:46.142017 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:46.310319 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] Publish callbacks [] for port, precommit_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:46.317375 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:46.368620 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] Attempting to bind port 69bfb4cb-d5e2-40de-abc0-2609f75b29ca on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:10:46.368983 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] Attempting to bind port 69bfb4cb-d5e2-40de-abc0-2609f75b29ca by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}] {{(pid=102479) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:10:46.369356 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] Attempting to bind port 69bfb4cb-d5e2-40de-abc0-2609f75b29ca on network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:10:46.372158 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-388468eb-4bc9-4b7a-8b67-8508a6050cd7 None None] Pushing event updated for resources: {'Port': ['ID=69bfb4cb-d5e2-40de-abc0-2609f75b29ca,revision_number=2']} {{(pid=102479) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:46.379499 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 10, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:10:46.379891 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] Checking segment: {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102479) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:10:46.380290 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:46.380725 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] Bound using segment: {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'} {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:10:46.381175 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] Bound port: 69bfb4cb-d5e2-40de-abc0-2609f75b29ca, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}}] {{(pid=102479) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:10:46.381561 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:46.384790 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-388468eb-4bc9-4b7a-8b67-8508a6050cd7 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:46.385153 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-388468eb-4bc9-4b7a-8b67-8508a6050cd7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:46.385508 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-388468eb-4bc9-4b7a-8b67-8508a6050cd7 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:46.385852 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-388468eb-4bc9-4b7a-8b67-8508a6050cd7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:46.386178 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-388468eb-4bc9-4b7a-8b67-8508a6050cd7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:46.386507 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-388468eb-4bc9-4b7a-8b67-8508a6050cd7 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:46.386828 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-388468eb-4bc9-4b7a-8b67-8508a6050cd7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:46.387154 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-388468eb-4bc9-4b7a-8b67-8508a6050cd7 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:46.387263 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a74130bf-c861-47a9-bbe6-3cc1d21b74f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:46.387477 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-388468eb-4bc9-4b7a-8b67-8508a6050cd7 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:46.387817 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-388468eb-4bc9-4b7a-8b67-8508a6050cd7 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:46.388139 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-388468eb-4bc9-4b7a-8b67-8508a6050cd7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:46.388490 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-388468eb-4bc9-4b7a-8b67-8508a6050cd7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:46.388837 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-388468eb-4bc9-4b7a-8b67-8508a6050cd7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:46.440323 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.db [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] For port 69bfb4cb-d5e2-40de-abc0-2609f75b29ca, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102479) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:10:46.443569 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.db [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] For port 69bfb4cb-d5e2-40de-abc0-2609f75b29ca, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=69bfb4cb-d5e2-40de-abc0-2609f75b29ca,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102479) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:10:46.449900 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:46.505396 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] Routers {'3e033806-af20-4ee4-8d0e-05f57044dfa3'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:10:46.505995 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:10:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['3e033806-af20-4ee4-8d0e-05f57044dfa3'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:10:46.540237 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [None req-a74130bf-c861-47a9-bbe6-3cc1d21b74f6 admin admin] Allocated IP 172.20.0.1 (075b69cb-c546-4fa5-aa29-49a5b85c94b1/314909f7-3ba5-49d4-a94f-2ebca4c9a707/f59ad02b-7d9d-4dc6-8574-27886cacfc47) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:10:46.542929 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-388468eb-4bc9-4b7a-8b67-8508a6050cd7 None None] Pushing event updated for resources: {'Port': ['ID=69bfb4cb-d5e2-40de-abc0-2609f75b29ca,revision_number=3']} {{(pid=102479) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:46.611742 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] Set router 3e033806-af20-4ee4-8d0e-05f57044dfa3 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:10:46.651654 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a74130bf-c861-47a9-bbe6-3cc1d21b74f6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:46.687010 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a74130bf-c861-47a9-bbe6-3cc1d21b74f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:46.723896 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a74130bf-c861-47a9-bbe6-3cc1d21b74f6 admin admin] Network 075b69cb-c546-4fa5-aa29-49a5b85c94b1 is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:10:46.726844 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-a74130bf-c861-47a9-bbe6-3cc1d21b74f6 admin admin] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:10:46.730409 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a74130bf-c861-47a9-bbe6-3cc1d21b74f6 admin admin] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:10:46.761002 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a74130bf-c861-47a9-bbe6-3cc1d21b74f6 admin admin] Pushing event updated for resources: {'Port': ['ID=f59ad02b-7d9d-4dc6-8574-27886cacfc47,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:46.782054 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a74130bf-c861-47a9-bbe6-3cc1d21b74f6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-545913'] for router_interface, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:46.795818 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'name': 'tempest-AttachVolumeTestJSON-1934153865-router', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:45Z', 'revision_number': 3, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'gw_port': {'id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:28:6b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 591, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:10:46.827042 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09bc2198-a1e3-4c2a-adc9-3da7c71d37a4 None None] The sync data for ids ['3e033806-af20-4ee4-8d0e-05f57044dfa3'] in dv-cinder-816443-2-iscsi is: [{'id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'name': 'tempest-AttachVolumeTestJSON-1934153865-router', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:45Z', 'revision_number': 3, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'gw_port': {'id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:28:6b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 591, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}] {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:10:46.916090 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a74130bf-c861-47a9-bbe6-3cc1d21b74f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:47.052720 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-c89a58c3-b56f-4a47-b271-801cd5add0ee None None] Provisioning complete for port f59ad02b-7d9d-4dc6-8574-27886cacfc47 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:10:47.053252 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-c89a58c3-b56f-4a47-b271-801cd5add0ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:47.100166 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-c89a58c3-b56f-4a47-b271-801cd5add0ee None None] Port f59ad02b-7d9d-4dc6-8574-27886cacfc47 cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 05:10:47.117651 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a74130bf-c861-47a9-bbe6-3cc1d21b74f6 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:47.123555 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a74130bf-c861-47a9-bbe6-3cc1d21b74f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:47.195366 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a74130bf-c861-47a9-bbe6-3cc1d21b74f6 admin admin] Pushing event updated for resources: {'Port': ['ID=f59ad02b-7d9d-4dc6-8574-27886cacfc47,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:47.198475 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a74130bf-c861-47a9-bbe6-3cc1d21b74f6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-627486', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-548585'] for router_interface, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:47.293405 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a74130bf-c861-47a9-bbe6-3cc1d21b74f6 admin admin] Network 075b69cb-c546-4fa5-aa29-49a5b85c94b1 is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:10:47.294854 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-a74130bf-c861-47a9-bbe6-3cc1d21b74f6 admin admin] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:10:47.417713 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a74130bf-c861-47a9-bbe6-3cc1d21b74f6 admin admin] Router 3e033806-af20-4ee4-8d0e-05f57044dfa3 has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102476) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:10:47.533438 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8424f78f-8b18-472d-b879-e000cff8d9a1 None None] Provisioning complete for port f59ad02b-7d9d-4dc6-8574-27886cacfc47 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:10:47.533817 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8424f78f-8b18-472d-b879-e000cff8d9a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:47.534144 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a74130bf-c861-47a9-bbe6-3cc1d21b74f6 admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:10:47.539792 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-a74130bf-c861-47a9-bbe6-3cc1d21b74f6 admin admin] 10.222.0.43 "PUT /v2.0/routers/3e033806-af20-4ee4-8d0e-05f57044dfa3/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9037285 Dec 24 05:10:47.575145 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8424f78f-8b18-472d-b879-e000cff8d9a1 None None] Port f59ad02b-7d9d-4dc6-8574-27886cacfc47 cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 05:10:47.996184 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 10ca479f-d446-4321-95f5-b3659a965554 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:10:48.043972 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 10ca479f-d446-4321-95f5-b3659a965554 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:10:48.044475 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:48.130796 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 69bfb4cb-d5e2-40de-abc0-2609f75b29ca up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:10:48.138794 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34362) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:10:48.143520 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-6a8f6b29-0a2f-4d8c-b0df-90b4a43c18d1 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Request body: {'security_group': {'name': 'tempest-securitygroup--457847245', 'description': 'tempest-description--1263450783'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:10:48.170549 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6a8f6b29-0a2f-4d8c-b0df-90b4a43c18d1 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:48.179216 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 69bfb4cb-d5e2-40de-abc0-2609f75b29ca triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:10:48.179659 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:48.253465 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6a8f6b29-0a2f-4d8c-b0df-90b4a43c18d1 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:48.259022 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6a8f6b29-0a2f-4d8c-b0df-90b4a43c18d1 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:48.268837 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:48.289330 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6a8f6b29-0a2f-4d8c-b0df-90b4a43c18d1 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:48.290696 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] For port 69bfb4cb-d5e2-40de-abc0-2609f75b29ca, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=69bfb4cb-d5e2-40de-abc0-2609f75b29ca,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:10:48.291045 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-6a8f6b29-0a2f-4d8c-b0df-90b4a43c18d1 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.1512251 Dec 24 05:10:48.293031 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a8f6b29-0a2f-4d8c-b0df-90b4a43c18d1 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0933ef99-cb3a-4b4f-9580-ae036add7f53,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:48.294262 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34364) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:10:48.299443 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-c9733c12-fd93-4829-adc5-5caf7a9a5d79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Request body: {'security_group_rule': {'security_group_id': '0933ef99-cb3a-4b4f-9580-ae036add7f53', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:10:48.304629 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:48.343246 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c9733c12-fd93-4829-adc5-5caf7a9a5d79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:48.358340 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Pushing event updated for resources: {'Port': ['ID=69bfb4cb-d5e2-40de-abc0-2609f75b29ca,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:48.398424 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c9733c12-fd93-4829-adc5-5caf7a9a5d79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:48.402939 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c9733c12-fd93-4829-adc5-5caf7a9a5d79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:48.417810 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] Sync routers for ids ['3e033806-af20-4ee4-8d0e-05f57044dfa3'] in dv-cinder-816443-2-iscsi {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:10:48.421334 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9733c12-fd93-4829-adc5-5caf7a9a5d79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=862b0b34-fe4a-4790-9ea0-7b2b0a4856e7,revision_number=0']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:48.428805 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] Routers {'3e033806-af20-4ee4-8d0e-05f57044dfa3'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:10:48.429494 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:10:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['3e033806-af20-4ee4-8d0e-05f57044dfa3'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:10:48.429969 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c9733c12-fd93-4829-adc5-5caf7a9a5d79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:48.431262 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-c9733c12-fd93-4829-adc5-5caf7a9a5d79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1359465 Dec 24 05:10:48.434285 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34366) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:10:48.439172 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-6ddec4c9-958d-4775-a813-9395c1feab01 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Request body: {'security_group_rule': {'security_group_id': '0933ef99-cb3a-4b4f-9580-ae036add7f53', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:10:48.467322 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6ddec4c9-958d-4775-a813-9395c1feab01 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:48.528696 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6ddec4c9-958d-4775-a813-9395c1feab01 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:48.533223 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6ddec4c9-958d-4775-a813-9395c1feab01 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:48.554701 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ddec4c9-958d-4775-a813-9395c1feab01 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9f490cd7-7308-4519-895e-1a2e9d2f0001,revision_number=0']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:48.573058 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6ddec4c9-958d-4775-a813-9395c1feab01 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:48.576569 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-6ddec4c9-958d-4775-a813-9395c1feab01 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1390040 Dec 24 05:10:48.577695 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34368) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:10:48.582337 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-87180fc0-e699-47f9-bd1d-6e337e36fa49 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Request body: {'floatingip': {'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:10:48.610330 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-87180fc0-e699-47f9-bd1d-6e337e36fa49 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for floatingip, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:48.673398 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] Set router 3e033806-af20-4ee4-8d0e-05f57044dfa3 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:10:48.711584 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-87180fc0-e699-47f9-bd1d-6e337e36fa49 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:48.819085 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [None req-87180fc0-e699-47f9-bd1d-6e337e36fa49 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Allocated IP 172.27.1.212 (9b4e4b31-551f-45a9-b26a-cb44ee20a17d/f277b899-8779-420e-8a8d-bfcd5eb7f012/ae593015-66af-415c-8a46-b21299c8f203) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:10:48.870063 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'name': 'tempest-AttachVolumeTestJSON-1934153865-router', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:46Z', 'revision_number': 4, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'gw_port': {'id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:28:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 591, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': 'f59ad02b-7d9d-4dc6-8574-27886cacfc47', 'name': '', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'mac_address': 'fa:16:3e:a2:f9:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_interface', 'standard_attr_id': 592, 'fixed_ips': [{'subnet_id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:46Z', 'updated_at': '2021-12-24T05:10:46Z', 'revision_number': 2, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'subnets': [{'id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:10:48.901164 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] Checking router: 3e033806-af20-4ee4-8d0e-05f57044dfa3 for host: dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:10:48.901524 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] Updating router 3e033806-af20-4ee4-8d0e-05f57044dfa3 port f59ad02b-7d9d-4dc6-8574-27886cacfc47 binding host dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 24 05:10:48.926962 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:48.929063 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-87180fc0-e699-47f9-bd1d-6e337e36fa49 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:48.965504 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-87180fc0-e699-47f9-bd1d-6e337e36fa49 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:49.009889 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87180fc0-e699-47f9-bd1d-6e337e36fa49 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:10:49.014456 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-87180fc0-e699-47f9-bd1d-6e337e36fa49 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:10:49.018780 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87180fc0-e699-47f9-bd1d-6e337e36fa49 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:10:49.021887 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87180fc0-e699-47f9-bd1d-6e337e36fa49 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Pushing event updated for resources: {'Port': ['ID=ae593015-66af-415c-8a46-b21299c8f203,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:49.103869 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-87180fc0-e699-47f9-bd1d-6e337e36fa49 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:49.137617 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-87180fc0-e699-47f9-bd1d-6e337e36fa49 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:49.186609 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] Publish callbacks [] for port, precommit_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:49.194734 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:49.273807 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d39cbc9-dc75-4430-8ec8-81d748e677d4 None None] Pushing event updated for resources: {'Port': ['ID=f59ad02b-7d9d-4dc6-8574-27886cacfc47,revision_number=3']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:49.300701 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-87180fc0-e699-47f9-bd1d-6e337e36fa49 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:49.302837 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] Attempting to bind port f59ad02b-7d9d-4dc6-8574-27886cacfc47 on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:10:49.303296 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] Attempting to bind port f59ad02b-7d9d-4dc6-8574-27886cacfc47 by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': '58060104-31c9-4b9f-ad66-9f4a4de56096', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1'}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:10:49.303702 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] Attempting to bind port f59ad02b-7d9d-4dc6-8574-27886cacfc47 on network 075b69cb-c546-4fa5-aa29-49a5b85c94b1 {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:10:49.306412 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-87180fc0-e699-47f9-bd1d-6e337e36fa49 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:49.316717 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 10, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:10:49.317104 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] Checking segment: {'id': '58060104-31c9-4b9f-ad66-9f4a4de56096', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102478) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:10:49.317521 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:49.318988 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] Bound using segment: {'id': '58060104-31c9-4b9f-ad66-9f4a4de56096', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1'} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:10:49.319503 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] Bound port: f59ad02b-7d9d-4dc6-8574-27886cacfc47, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '58060104-31c9-4b9f-ad66-9f4a4de56096', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1'}}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:10:49.319870 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:49.389329 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87180fc0-e699-47f9-bd1d-6e337e36fa49 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Pushing event updated for resources: {'Port': ['ID=ae593015-66af-415c-8a46-b21299c8f203,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:49.396320 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-87180fc0-e699-47f9-bd1d-6e337e36fa49 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-545804'] for floatingip, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:49.404788 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] For port f59ad02b-7d9d-4dc6-8574-27886cacfc47, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102478) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:10:49.408080 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] For port f59ad02b-7d9d-4dc6-8574-27886cacfc47, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=f59ad02b-7d9d-4dc6-8574-27886cacfc47,segment=NetworkSegment(58060104-31c9-4b9f-ad66-9f4a4de56096),segment_id=58060104-31c9-4b9f-ad66-9f4a4de56096)] {{(pid=102478) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:10:49.413251 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:49.413418 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-87180fc0-e699-47f9-bd1d-6e337e36fa49 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for floatingip, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:49.415119 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-87180fc0-e699-47f9-bd1d-6e337e36fa49 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 0.8360980 Dec 24 05:10:49.471342 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] Routers {'3e033806-af20-4ee4-8d0e-05f57044dfa3'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:10:49.471973 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:10:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['3e033806-af20-4ee4-8d0e-05f57044dfa3'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:10:49.517031 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d39cbc9-dc75-4430-8ec8-81d748e677d4 None None] Pushing event updated for resources: {'Port': ['ID=f59ad02b-7d9d-4dc6-8574-27886cacfc47,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:49.552436 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-094104e6-a3d3-49a4-981c-f9794a0d2fb7 None None] Provisioning complete for port f59ad02b-7d9d-4dc6-8574-27886cacfc47 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:10:49.553081 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-094104e6-a3d3-49a4-981c-f9794a0d2fb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:49.591452 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-02214eb9-bb77-4c20-bd68-409f84520755 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-securitygroup--457847245&fields=id&tenant_id=fc4cefad8fef403e90ad695e2098ee7b HTTP/1.1" status: 200 len: 267 time: 0.0522928 Dec 24 05:10:49.637848 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] Set router 3e033806-af20-4ee4-8d0e-05f57044dfa3 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:10:49.705929 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-3b382ff4-f41e-4332-8b8a-40540b29633b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:49.707430 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-3b382ff4-f41e-4332-8b8a-40540b29633b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/networks?id=075b69cb-c546-4fa5-aa29-49a5b85c94b1 HTTP/1.1" status: 200 len: 811 time: 0.1076689 Dec 24 05:10:49.723636 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-14888221-b5dd-4103-8037-4e63e8d48b09 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/quotas/fc4cefad8fef403e90ad695e2098ee7b HTTP/1.1" status: 200 len: 375 time: 0.0098543 Dec 24 05:10:49.776286 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-6db87b73-e518-4ef2-b5b6-d88f73a9b636 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=fc4cefad8fef403e90ad695e2098ee7b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0469294 Dec 24 05:10:49.785402 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-094104e6-a3d3-49a4-981c-f9794a0d2fb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:49.843963 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-094104e6-a3d3-49a4-981c-f9794a0d2fb7 None None] For port f59ad02b-7d9d-4dc6-8574-27886cacfc47, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=f59ad02b-7d9d-4dc6-8574-27886cacfc47,segment=NetworkSegment(58060104-31c9-4b9f-ad66-9f4a4de56096),segment_id=58060104-31c9-4b9f-ad66-9f4a4de56096)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:10:49.848822 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-094104e6-a3d3-49a4-981c-f9794a0d2fb7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:49.877353 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-512c474a-23bb-4234-96d7-124e3cf3a6d5 service neutron] 10.222.0.43 "GET /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0891926 Dec 24 05:10:49.924755 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-094104e6-a3d3-49a4-981c-f9794a0d2fb7 None None] Pushing event updated for resources: {'Port': ['ID=f59ad02b-7d9d-4dc6-8574-27886cacfc47,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:49.937170 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'name': 'tempest-AttachVolumeTestJSON-1934153865-router', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:46Z', 'revision_number': 4, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'gw_port': {'id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:28:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 591, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': 'f59ad02b-7d9d-4dc6-8574-27886cacfc47', 'name': '', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'mac_address': 'fa:16:3e:a2:f9:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_interface', 'standard_attr_id': 592, 'fixed_ips': [{'subnet_id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:46Z', 'updated_at': '2021-12-24T05:10:49Z', 'revision_number': 4, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'subnets': [{'id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:10:49.969360 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca4ab47b-0e6b-46c7-a40d-1af32de63bad None None] The sync data for ids ['3e033806-af20-4ee4-8d0e-05f57044dfa3'] in dv-cinder-816443-2-iscsi is: [{'id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'name': 'tempest-AttachVolumeTestJSON-1934153865-router', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:46Z', 'revision_number': 4, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'gw_port': {'id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:28:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 591, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': 'f59ad02b-7d9d-4dc6-8574-27886cacfc47', 'name': '', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'mac_address': 'fa:16:3e:a2:f9:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_interface', 'standard_attr_id': 592, 'fixed_ips': [{'subnet_id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:46Z', 'updated_at': '2021-12-24T05:10:49Z', 'revision_number': 4, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'subnets': [{'id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:10:49.970982 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 69bfb4cb-d5e2-40de-abc0-2609f75b29ca up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:10:49.977006 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-de8183a2-821e-44a1-95d8-e70c740210ba service neutron] 10.222.0.43 "GET /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0926964 Dec 24 05:10:50.015746 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-54643259-b14d-4591-a7a8-7024aa1a07a9 None None] Provisioning complete for port f59ad02b-7d9d-4dc6-8574-27886cacfc47 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:10:50.016119 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-54643259-b14d-4591-a7a8-7024aa1a07a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:50.080600 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 69bfb4cb-d5e2-40de-abc0-2609f75b29ca triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:10:50.080975 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:50.201690 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-340acbef-6d7e-4f5c-b532-0e6a7850ccd3 req-66242600-9174-42e9-99da-a141e786e345 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 210 time: 0.0327291 Dec 24 05:10:50.461735 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:51.277665 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-b79197a7-31ec-4228-8d3c-a790946abb84 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:51.279343 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-b79197a7-31ec-4228-8d3c-a790946abb84 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.46 "GET /v2.0/networks?id=075b69cb-c546-4fa5-aa29-49a5b85c94b1 HTTP/1.1" status: 200 len: 811 time: 0.1118231 Dec 24 05:10:51.297772 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f4a02ec6-19df-45c2-b837-de669ece0101 req-ba254b7f-0bd4-4086-9d73-4516e3c55004 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 210 time: 0.0273318 Dec 24 05:10:51.366176 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-3432f141-c0ec-4660-9e64-f069918fd737 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.46 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=fc4cefad8fef403e90ad695e2098ee7b HTTP/1.1" status: 200 len: 379 time: 0.0573134 Dec 24 05:10:51.379518 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-7a7bb1d7-93ac-4d60-a251-a2845348c121 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Request body: {'port': {'device_id': '5096ad5d-d707-4082-908c-d12a3d5519cc', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'admin_state_up': True, 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'security_groups': ['0933ef99-cb3a-4b4f-9580-ae036add7f53']}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:10:51.489953 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-7a7bb1d7-93ac-4d60-a251-a2845348c121 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Made reservation on behalf of fc4cefad8fef403e90ad695e2098ee7b for: {'port': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:10:51.494553 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-7a7bb1d7-93ac-4d60-a251-a2845348c121 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:51.643634 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-7a7bb1d7-93ac-4d60-a251-a2845348c121 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Allocated IP 172.20.0.13 (075b69cb-c546-4fa5-aa29-49a5b85c94b1/314909f7-3ba5-49d4-a94f-2ebca4c9a707/b3526449-31e3-4b8f-a3a1-329333c58c47) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:10:51.788317 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-7a7bb1d7-93ac-4d60-a251-a2845348c121 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:51.822209 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-7a7bb1d7-93ac-4d60-a251-a2845348c121 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:51.865684 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-7a7bb1d7-93ac-4d60-a251-a2845348c121 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Network 075b69cb-c546-4fa5-aa29-49a5b85c94b1 is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:10:51.868980 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-7a7bb1d7-93ac-4d60-a251-a2845348c121 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:10:51.872586 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-7a7bb1d7-93ac-4d60-a251-a2845348c121 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:10:51.878743 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a7bb1d7-93ac-4d60-a251-a2845348c121 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Pushing event updated for resources: {'Port': ['ID=b3526449-31e3-4b8f-a3a1-329333c58c47,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:51.932180 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-7a7bb1d7-93ac-4d60-a251-a2845348c121 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:51.933162 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-7a7bb1d7-93ac-4d60-a251-a2845348c121 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:51.953747 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-7a7bb1d7-93ac-4d60-a251-a2845348c121 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.46 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5775425 Dec 24 05:10:51.975051 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device f59ad02b-7d9d-4dc6-8574-27886cacfc47 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:10:51.975568 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5503ceb3-85ed-40ae-b961-7c4580e07dd5 service neutron] Request body: {'port': {'device_id': '5096ad5d-d707-4082-908c-d12a3d5519cc', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81644'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:10:52.029133 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port f59ad02b-7d9d-4dc6-8574-27886cacfc47 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:10:52.029509 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:52.034451 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5503ceb3-85ed-40ae-b961-7c4580e07dd5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:52.155655 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-d25fbef4-e9f9-4f4e-9ca6-88dbd44e8f78 None None] Provisioning complete for port b3526449-31e3-4b8f-a3a1-329333c58c47 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:10:52.155878 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-d25fbef4-e9f9-4f4e-9ca6-88dbd44e8f78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:52.192514 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-d25fbef4-e9f9-4f4e-9ca6-88dbd44e8f78 None None] Port b3526449-31e3-4b8f-a3a1-329333c58c47 cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 05:10:52.292701 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5503ceb3-85ed-40ae-b961-7c4580e07dd5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b3526449-31e3-4b8f-a3a1-329333c58c47 {{(pid=102476) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:10:52.300061 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5503ceb3-85ed-40ae-b961-7c4580e07dd5 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:52.312350 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.provisioning_blocks [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5503ceb3-85ed-40ae-b961-7c4580e07dd5 service neutron] Transition to ACTIVE for port object b3526449-31e3-4b8f-a3a1-329333c58c47 will not be triggered until provisioned by entity L2. {{(pid=102476) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 24 05:10:52.319241 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5503ceb3-85ed-40ae-b961-7c4580e07dd5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:52.370997 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5503ceb3-85ed-40ae-b961-7c4580e07dd5 service neutron] Pushing event updated for resources: {'Port': ['ID=b3526449-31e3-4b8f-a3a1-329333c58c47,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:52.475906 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1d1214a-8933-4f6c-87dc-e9762ddbe340 req-2fa4bf22-a2eb-4c79-a5bf-733c12a36e84 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:52.478334 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d1d1214a-8933-4f6c-87dc-e9762ddbe340 req-2fa4bf22-a2eb-4c79-a5bf-733c12a36e84 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 944 time: 0.1036377 Dec 24 05:10:52.483342 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5503ceb3-85ed-40ae-b961-7c4580e07dd5 service neutron] Attempting to bind port b3526449-31e3-4b8f-a3a1-329333c58c47 on host hv-cinder-81644 for vnic_type normal with profile {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:10:52.483693 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5503ceb3-85ed-40ae-b961-7c4580e07dd5 service neutron] Attempting to bind port b3526449-31e3-4b8f-a3a1-329333c58c47 by drivers openvswitch,hyperv on host hv-cinder-81644 at level 0 using segments [{'id': '58060104-31c9-4b9f-ad66-9f4a4de56096', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1'}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:10:52.484026 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5503ceb3-85ed-40ae-b961-7c4580e07dd5 service neutron] Attempting to bind port b3526449-31e3-4b8f-a3a1-329333c58c47 on network 075b69cb-c546-4fa5-aa29-49a5b85c94b1 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:10:52.502327 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5503ceb3-85ed-40ae-b961-7c4580e07dd5 service neutron] Port b3526449-31e3-4b8f-a3a1-329333c58c47 on network 075b69cb-c546-4fa5-aa29-49a5b85c94b1 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81644 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 24 05:10:52.502651 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5503ceb3-85ed-40ae-b961-7c4580e07dd5 service neutron] Attempting to bind port b3526449-31e3-4b8f-a3a1-329333c58c47 on network 075b69cb-c546-4fa5-aa29-49a5b85c94b1 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:10:52.510843 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5503ceb3-85ed-40ae-b961-7c4580e07dd5 service neutron] Checking agent: {'id': '7a2ffd19-371f-4f7b-a239-eea3b5cfd55b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81644', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'started_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 10, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:10:52.511199 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5503ceb3-85ed-40ae-b961-7c4580e07dd5 service neutron] Checking segment: {'id': '58060104-31c9-4b9f-ad66-9f4a4de56096', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:10:52.511580 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5503ceb3-85ed-40ae-b961-7c4580e07dd5 service neutron] Bound using segment: {'id': '58060104-31c9-4b9f-ad66-9f4a4de56096', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1'} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:10:52.512011 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5503ceb3-85ed-40ae-b961-7c4580e07dd5 service neutron] Bound port: b3526449-31e3-4b8f-a3a1-329333c58c47, host: hv-cinder-81644, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '58060104-31c9-4b9f-ad66-9f4a4de56096', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1'}}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:10:52.512366 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5503ceb3-85ed-40ae-b961-7c4580e07dd5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:52.567617 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d1d1214a-8933-4f6c-87dc-e9762ddbe340 req-1e640c10-f881-490f-8550-bdb4465391a1 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0811892 Dec 24 05:10:52.595260 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5503ceb3-85ed-40ae-b961-7c4580e07dd5 service neutron] For port b3526449-31e3-4b8f-a3a1-329333c58c47, host hv-cinder-81644, cleared binding levels {{(pid=102476) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:10:52.598437 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5503ceb3-85ed-40ae-b961-7c4580e07dd5 service neutron] For port b3526449-31e3-4b8f-a3a1-329333c58c47, host hv-cinder-81644, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=b3526449-31e3-4b8f-a3a1-329333c58c47,segment=NetworkSegment(58060104-31c9-4b9f-ad66-9f4a4de56096),segment_id=58060104-31c9-4b9f-ad66-9f4a4de56096)] {{(pid=102476) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:10:52.605327 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5503ceb3-85ed-40ae-b961-7c4580e07dd5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:52.639545 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5503ceb3-85ed-40ae-b961-7c4580e07dd5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:52.640171 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5503ceb3-85ed-40ae-b961-7c4580e07dd5 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:52.641767 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5503ceb3-85ed-40ae-b961-7c4580e07dd5 service neutron] 10.222.0.46 "PUT /v2.0/ports/b3526449-31e3-4b8f-a3a1-329333c58c47 HTTP/1.1" status: 200 len: 1094 time: 0.6721299 Dec 24 05:10:52.644403 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5096ad5d-d707-4082-908c-d12a3d5519cc', 'tag': 'b3526449-31e3-4b8f-a3a1-329333c58c47'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:10:52.646708 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-909dbfd7-a427-499d-86af-9d7681fe3991" -d '{"events": [{"name": "network-changed", "server_uuid": "5096ad5d-d707-4082-908c-d12a3d5519cc", "tag": "b3526449-31e3-4b8f-a3a1-329333c58c47"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:10:52.677518 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5503ceb3-85ed-40ae-b961-7c4580e07dd5 service neutron] Pushing event updated for resources: {'Port': ['ID=b3526449-31e3-4b8f-a3a1-329333c58c47,revision_number=3']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:52.699140 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:10:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9a392ffd-6487-4292-a7ed-98938cbe73e4 x-openstack-request-id: req-9a392ffd-6487-4292-a7ed-98938cbe73e4 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:10:52.699426 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5096ad5d-d707-4082-908c-d12a3d5519cc", "tag": "b3526449-31e3-4b8f-a3a1-329333c58c47", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:10:52.699678 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-9a392ffd-6487-4292-a7ed-98938cbe73e4 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:10:52.700082 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5096ad5d-d707-4082-908c-d12a3d5519cc', 'tag': 'b3526449-31e3-4b8f-a3a1-329333c58c47', 'status': 'completed', 'code': 200} Dec 24 05:10:52.765576 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-de6d7340-6448-465b-aaaf-3ffa43c1ac37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:52.767093 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-de6d7340-6448-465b-aaaf-3ffa43c1ac37 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=fc4cefad8fef403e90ad695e2098ee7b&device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 1097 time: 0.0427079 Dec 24 05:10:52.818461 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-a4dca53f-ae84-499c-9d72-4c6e49256ba0 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b3526449-31e3-4b8f-a3a1-329333c58c47 HTTP/1.1" status: 200 len: 217 time: 0.0361352 Dec 24 05:10:52.874914 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5daa380c-cd6e-416f-bac1-f23383f6d048 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:52.876372 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5daa380c-cd6e-416f-bac1-f23383f6d048 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=314909f7-3ba5-49d4-a94f-2ebca4c9a707 HTTP/1.1" status: 200 len: 850 time: 0.0509620 Dec 24 05:10:52.922977 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5f78dfb0-8814-4945-bc09-58c83968b89b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:52.924318 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-5f78dfb0-8814-4945-bc09-58c83968b89b service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=075b69cb-c546-4fa5-aa29-49a5b85c94b1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0411370 Dec 24 05:10:53.027899 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-00aecc42-5e40-4776-a172-4e04bdb88960 service neutron] 10.222.0.46 "GET /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0961378 Dec 24 05:10:53.134928 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-012c984a-ba2b-44bc-a025-bf9bd5cc59da req-dfe221a9-c761-4427-ab7f-cf365dfe6ee0 service neutron] 10.222.0.46 "GET /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0985935 Dec 24 05:10:53.207959 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-9ab9478f-875f-4f54-b2c9-a12f2c1704de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:53.274661 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-909dbfd7-a427-499d-86af-9d7681fe3991 req-25611b55-63d7-4206-9be8-139444fdf419 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:53.276765 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-909dbfd7-a427-499d-86af-9d7681fe3991 req-25611b55-63d7-4206-9be8-139444fdf419 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=fc4cefad8fef403e90ad695e2098ee7b&device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 1097 time: 0.0435767 Dec 24 05:10:53.380216 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-909dbfd7-a427-499d-86af-9d7681fe3991 req-d963ba15-6e7c-4887-99ec-128ae5566c71 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:53.382120 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-909dbfd7-a427-499d-86af-9d7681fe3991 req-d963ba15-6e7c-4887-99ec-128ae5566c71 service neutron] 10.222.0.46 "GET /v2.0/networks?id=075b69cb-c546-4fa5-aa29-49a5b85c94b1 HTTP/1.1" status: 200 len: 912 time: 0.0976629 Dec 24 05:10:53.423258 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-909dbfd7-a427-499d-86af-9d7681fe3991 req-a47cc468-0f86-4cab-9862-601f7f114580 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b3526449-31e3-4b8f-a3a1-329333c58c47 HTTP/1.1" status: 200 len: 217 time: 0.0340593 Dec 24 05:10:53.473625 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-909dbfd7-a427-499d-86af-9d7681fe3991 req-d8a2ce9a-9316-44f1-9c9c-f98fa6db02be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:53.475031 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-909dbfd7-a427-499d-86af-9d7681fe3991 req-d8a2ce9a-9316-44f1-9c9c-f98fa6db02be service neutron] 10.222.0.46 "GET /v2.0/subnets?id=314909f7-3ba5-49d4-a94f-2ebca4c9a707 HTTP/1.1" status: 200 len: 850 time: 0.0447834 Dec 24 05:10:53.533111 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-909dbfd7-a427-499d-86af-9d7681fe3991 req-5a5a9b2f-af56-4dd1-999c-642b3c9aa0e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:53.534553 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-909dbfd7-a427-499d-86af-9d7681fe3991 req-5a5a9b2f-af56-4dd1-999c-642b3c9aa0e8 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=075b69cb-c546-4fa5-aa29-49a5b85c94b1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0444167 Dec 24 05:10:53.628871 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-909dbfd7-a427-499d-86af-9d7681fe3991 req-f239b16d-fbcf-4ce3-a85b-067e15aa0bc6 service neutron] 10.222.0.46 "GET /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0861146 Dec 24 05:10:53.746042 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24ad2108-f464-4a42-aa81-0fdc2b2ee8f2 req-74134113-8584-4aa7-afa7-906d088380de tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:53.747402 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-24ad2108-f464-4a42-aa81-0fdc2b2ee8f2 req-74134113-8584-4aa7-afa7-906d088380de tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 944 time: 0.1040175 Dec 24 05:10:53.769745 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-909dbfd7-a427-499d-86af-9d7681fe3991 req-fdde82ad-083f-4244-80d3-7118c1a4f310 service neutron] 10.222.0.46 "GET /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1334891 Dec 24 05:10:53.799123 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-24ad2108-f464-4a42-aa81-0fdc2b2ee8f2 req-c66b20dd-e87d-494e-896e-3c54eb95af52 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443165 Dec 24 05:10:54.949232 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adb060ca-686b-4389-9aa7-3f3ff35c7887 req-834ebb9b-a9da-4556-817a-04958fd5ad9e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:54.950836 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-adb060ca-686b-4389-9aa7-3f3ff35c7887 req-834ebb9b-a9da-4556-817a-04958fd5ad9e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 944 time: 0.0645895 Dec 24 05:10:55.003809 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-adb060ca-686b-4389-9aa7-3f3ff35c7887 req-9f3bdd76-fd31-415d-95e2-88971f096ab4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0466506 Dec 24 05:10:55.289235 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-dde1834b-f7ef-4649-8a24-a9560d177edd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:56.126248 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0d8bd5a-942d-4658-a0d8-0af952a1c6fa req-0adf920d-121b-4958-989d-02928d27fed7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:56.127602 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d0d8bd5a-942d-4658-a0d8-0af952a1c6fa req-0adf920d-121b-4958-989d-02928d27fed7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 944 time: 0.0551364 Dec 24 05:10:56.175969 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d0d8bd5a-942d-4658-a0d8-0af952a1c6fa req-e53ba5d4-7be1-4a26-9ebc-7aaf6f69dca5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422668 Dec 24 05:10:56.513069 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:57.162125 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device b3526449-31e3-4b8f-a3a1-329333c58c47 details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 05:10:57.282576 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port b3526449-31e3-4b8f-a3a1-329333c58c47, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=b3526449-31e3-4b8f-a3a1-329333c58c47,segment=NetworkSegment(58060104-31c9-4b9f-ad66-9f4a4de56096),segment_id=58060104-31c9-4b9f-ad66-9f4a4de56096)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:10:57.293656 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': 'b3526449-31e3-4b8f-a3a1-329333c58c47', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'port_id': 'b3526449-31e3-4b8f-a3a1-329333c58c47', 'mac_address': 'fa:16:3e:ca:be:3d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 128, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 05:10:57.310275 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c2284b5-068c-4563-97c6-13bca17fb68f req-59e857ea-d05d-4b2b-a7bb-ec4177dc1bb2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:57.314824 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6c2284b5-068c-4563-97c6-13bca17fb68f req-59e857ea-d05d-4b2b-a7bb-ec4177dc1bb2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 944 time: 0.0508051 Dec 24 05:10:57.333546 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:57.346777 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b3526449-31e3-4b8f-a3a1-329333c58c47 {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:10:57.360468 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6c2284b5-068c-4563-97c6-13bca17fb68f req-5e03fb24-8ea2-462a-a3f3-93ccf0bf1631 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427279 Dec 24 05:10:57.365540 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port b3526449-31e3-4b8f-a3a1-329333c58c47, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=b3526449-31e3-4b8f-a3a1-329333c58c47,segment=NetworkSegment(58060104-31c9-4b9f-ad66-9f4a4de56096),segment_id=58060104-31c9-4b9f-ad66-9f4a4de56096)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:10:57.371141 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:57.420380 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=b3526449-31e3-4b8f-a3a1-329333c58c47,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:57.427280 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:57.427631 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:57.427977 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:57.428313 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:57.428675 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:57.429005 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:57.429334 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:57.429665 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:57.429988 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:57.430315 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:57.430637 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:57.430992 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:57.431313 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:10:57.791692 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['b3526449-31e3-4b8f-a3a1-329333c58c47'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:10:57.950508 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:58.489275 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-305f2a59-1523-4e5e-b592-65673674dd24 req-4d958e19-58da-4d06-89aa-82ba314310e5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:58.490740 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-305f2a59-1523-4e5e-b592-65673674dd24 req-4d958e19-58da-4d06-89aa-82ba314310e5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 945 time: 0.0539963 Dec 24 05:10:58.538845 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-305f2a59-1523-4e5e-b592-65673674dd24 req-1aa8a3c5-04e4-44c5-b353-9b7e68c48b38 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420902 Dec 24 05:10:58.592719 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:59.173042 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device b3526449-31e3-4b8f-a3a1-329333c58c47 up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:10:59.237761 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning for port b3526449-31e3-4b8f-a3a1-329333c58c47 completed by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 24 05:10:59.242219 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port b3526449-31e3-4b8f-a3a1-329333c58c47 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:10:59.242583 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:59.319608 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:59.343738 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5096ad5d-d707-4082-908c-d12a3d5519cc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b3526449-31e3-4b8f-a3a1-329333c58c47'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:10:59.346019 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-be97e12e-cd8b-447e-8cf4-e3333e256558" -d '{"events": [{"server_uuid": "5096ad5d-d707-4082-908c-d12a3d5519cc", "name": "network-vif-plugged", "status": "completed", "tag": "b3526449-31e3-4b8f-a3a1-329333c58c47"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:10:59.362319 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port b3526449-31e3-4b8f-a3a1-329333c58c47, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=b3526449-31e3-4b8f-a3a1-329333c58c47,segment=NetworkSegment(58060104-31c9-4b9f-ad66-9f4a4de56096),segment_id=58060104-31c9-4b9f-ad66-9f4a4de56096)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:10:59.367616 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:10:59.415246 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=b3526449-31e3-4b8f-a3a1-329333c58c47,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:10:59.448170 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:10:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-12db9350-6a2a-411b-aeb9-82599bf3df1c x-openstack-request-id: req-12db9350-6a2a-411b-aeb9-82599bf3df1c {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:10:59.448467 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5096ad5d-d707-4082-908c-d12a3d5519cc", "name": "network-vif-plugged", "status": "completed", "tag": "b3526449-31e3-4b8f-a3a1-329333c58c47", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:10:59.448755 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-12db9350-6a2a-411b-aeb9-82599bf3df1c {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:10:59.449156 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5096ad5d-d707-4082-908c-d12a3d5519cc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b3526449-31e3-4b8f-a3a1-329333c58c47', 'code': 200} Dec 24 05:10:59.686716 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8123412-2587-4659-a205-4b9d6bd00f78 req-f6a3e755-56d0-4f3b-996a-fb8415689f16 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:59.688082 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d8123412-2587-4659-a205-4b9d6bd00f78 req-f6a3e755-56d0-4f3b-996a-fb8415689f16 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0776749 Dec 24 05:10:59.689840 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfe36b81-b259-4d5d-b1e1-272b09747300 req-ba958020-c6cc-4e14-973c-aeb02fd3e99b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:10:59.691173 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bfe36b81-b259-4d5d-b1e1-272b09747300 req-ba958020-c6cc-4e14-973c-aeb02fd3e99b service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 1099 time: 0.0718372 Dec 24 05:10:59.760105 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d8123412-2587-4659-a205-4b9d6bd00f78 req-12399f02-ce10-4ddb-9e46-8dca47a7a58c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0658607 Dec 24 05:10:59.762860 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bfe36b81-b259-4d5d-b1e1-272b09747300 req-60099502-18ec-47bc-9b7a-c4d41757cab8 service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0631075 Dec 24 05:11:00.881473 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f04ea2a5-2395-40bf-bbc0-c0989cc7d136 req-277c7e51-2348-459f-9da0-3dfa9423c67f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:11:00.882911 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f04ea2a5-2395-40bf-bbc0-c0989cc7d136 req-277c7e51-2348-459f-9da0-3dfa9423c67f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0484469 Dec 24 05:11:00.937762 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f04ea2a5-2395-40bf-bbc0-c0989cc7d136 req-f552678a-7408-40aa-9fc5-537f91e6d03f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0487311 Dec 24 05:11:02.056658 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2543757f-3f54-46c4-9dd3-a955f61ac8fd req-dd1e6940-5203-4747-9c15-650d0803c41c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:11:02.058107 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2543757f-3f54-46c4-9dd3-a955f61ac8fd req-dd1e6940-5203-4747-9c15-650d0803c41c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0501597 Dec 24 05:11:02.108983 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2543757f-3f54-46c4-9dd3-a955f61ac8fd req-5f628c1d-8c40-412c-aa3b-dfd3dae21713 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421100 Dec 24 05:11:02.225393 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8668788-6532-4d21-8d89-f10cd10b425a req-4626f9be-715b-46a7-b59b-d94fe8f6aed5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:11:02.226866 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e8668788-6532-4d21-8d89-f10cd10b425a req-4626f9be-715b-46a7-b59b-d94fe8f6aed5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0503399 Dec 24 05:11:02.235950 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34430) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:11:02.240409 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-33b4b733-7794-44d2-b997-da4ca3690033 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Request body: {'floatingip': {'port_id': 'b3526449-31e3-4b8f-a3a1-329333c58c47'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:11:02.278976 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-33b4b733-7794-44d2-b997-da4ca3690033 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for floatingip, before_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:11:02.726635 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-33b4b733-7794-44d2-b997-da4ca3690033 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:11:02.732460 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-33b4b733-7794-44d2-b997-da4ca3690033 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-545804'] for floatingip, after_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:11:03.070937 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.db.l3_db [None req-33b4b733-7794-44d2-b997-da4ca3690033 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Floating IP 229016fe-d27e-49b3-9c28-32c0a18ffbdb associated. External IP: 172.27.1.212, port: b3526449-31e3-4b8f-a3a1-329333c58c47. Dec 24 05:11:03.285839 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-33b4b733-7794-44d2-b997-da4ca3690033 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Router 3e033806-af20-4ee4-8d0e-05f57044dfa3 has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102477) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:11:03.408015 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-33b4b733-7794-44d2-b997-da4ca3690033 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102477) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:11:03.413518 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-33b4b733-7794-44d2-b997-da4ca3690033 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for floatingip, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:11:03.418212 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6676bd18-7a6d-4ecf-81aa-e5d7807eb959 None None] Sync routers for ids ['3e033806-af20-4ee4-8d0e-05f57044dfa3'] in dv-cinder-816443-2-iscsi {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:11:03.428575 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6676bd18-7a6d-4ecf-81aa-e5d7807eb959 None None] Routers {'3e033806-af20-4ee4-8d0e-05f57044dfa3'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:11:03.429186 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-6676bd18-7a6d-4ecf-81aa-e5d7807eb959 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:10:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['3e033806-af20-4ee4-8d0e-05f57044dfa3'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:11:03.442274 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-33b4b733-7794-44d2-b997-da4ca3690033 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "PUT /v2.0/floatingips/229016fe-d27e-49b3-9c28-32c0a18ffbdb HTTP/1.1" status: 200 len: 992 time: 1.2052276 Dec 24 05:11:03.442869 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5096ad5d-d707-4082-908c-d12a3d5519cc', 'tag': 'b3526449-31e3-4b8f-a3a1-329333c58c47'}] {{(pid=102477) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:11:03.445231 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d3e3d7a262849d185e72ba84ca6adca9bb1fee52649b04b101352e7e29a99ca8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4691e9e3-1e89-4e85-a8c3-baef27015683" -d '{"events": [{"name": "network-changed", "server_uuid": "5096ad5d-d707-4082-908c-d12a3d5519cc", "tag": "b3526449-31e3-4b8f-a3a1-329333c58c47"}]}' {{(pid=102477) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:11:03.484651 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:11:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8b4e279d-0234-456d-bf69-729598d83e04 x-openstack-request-id: req-8b4e279d-0234-456d-bf69-729598d83e04 {{(pid=102477) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:11:03.484973 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5096ad5d-d707-4082-908c-d12a3d5519cc", "tag": "b3526449-31e3-4b8f-a3a1-329333c58c47", "status": "completed", "code": 200}]} {{(pid=102477) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:11:03.485216 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-8b4e279d-0234-456d-bf69-729598d83e04 {{(pid=102477) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:11:03.485625 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5096ad5d-d707-4082-908c-d12a3d5519cc', 'tag': 'b3526449-31e3-4b8f-a3a1-329333c58c47', 'status': 'completed', 'code': 200} Dec 24 05:11:03.595752 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4691e9e3-1e89-4e85-a8c3-baef27015683 req-b3bdd87d-2d34-4b62-b644-59aeda417964 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:11:03.597767 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4691e9e3-1e89-4e85-a8c3-baef27015683 req-b3bdd87d-2d34-4b62-b644-59aeda417964 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=fc4cefad8fef403e90ad695e2098ee7b&device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 1099 time: 0.0540888 Dec 24 05:11:03.639485 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-6676bd18-7a6d-4ecf-81aa-e5d7807eb959 None None] Set router 3e033806-af20-4ee4-8d0e-05f57044dfa3 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:11:03.691701 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4691e9e3-1e89-4e85-a8c3-baef27015683 req-06226383-51c1-4d2f-8d3e-c300f135d471 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:11:03.693287 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4691e9e3-1e89-4e85-a8c3-baef27015683 req-06226383-51c1-4d2f-8d3e-c300f135d471 service neutron] 10.222.0.46 "GET /v2.0/networks?id=075b69cb-c546-4fa5-aa29-49a5b85c94b1 HTTP/1.1" status: 200 len: 912 time: 0.0872023 Dec 24 05:11:03.772620 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4691e9e3-1e89-4e85-a8c3-baef27015683 req-c6bd5739-b8e5-4a70-a340-143209014ff5 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b3526449-31e3-4b8f-a3a1-329333c58c47 HTTP/1.1" status: 200 len: 1000 time: 0.0713835 Dec 24 05:11:03.821747 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4691e9e3-1e89-4e85-a8c3-baef27015683 req-b6b846d1-ee9a-40bb-862c-078e5e944338 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:11:03.823247 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4691e9e3-1e89-4e85-a8c3-baef27015683 req-b6b846d1-ee9a-40bb-862c-078e5e944338 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=314909f7-3ba5-49d4-a94f-2ebca4c9a707 HTTP/1.1" status: 200 len: 850 time: 0.0430317 Dec 24 05:11:03.869764 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4691e9e3-1e89-4e85-a8c3-baef27015683 req-2643055b-a8b3-4979-b4d7-955d7cadb1e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:11:03.871269 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4691e9e3-1e89-4e85-a8c3-baef27015683 req-2643055b-a8b3-4979-b4d7-955d7cadb1e4 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=075b69cb-c546-4fa5-aa29-49a5b85c94b1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0409393 Dec 24 05:11:03.872876 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-6676bd18-7a6d-4ecf-81aa-e5d7807eb959 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'name': 'tempest-AttachVolumeTestJSON-1934153865-router', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:46Z', 'revision_number': 4, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'gw_port': {'id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:28:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 591, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': '229016fe-d27e-49b3-9c28-32c0a18ffbdb', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'floating_ip_address': '172.27.1.212', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'port_id': 'b3526449-31e3-4b8f-a3a1-329333c58c47', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 599, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'mac_address': 'fa:16:3e:ca:be:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5096ad5d-d707-4082-908c-d12a3d5519cc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:10:49Z', 'updated_at': '2021-12-24T05:11:02Z', 'revision_number': 1, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f59ad02b-7d9d-4dc6-8574-27886cacfc47', 'name': '', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'mac_address': 'fa:16:3e:a2:f9:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_interface', 'standard_attr_id': 592, 'fixed_ips': [{'subnet_id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:46Z', 'updated_at': '2021-12-24T05:10:49Z', 'revision_number': 5, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'subnets': [{'id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:11:03.898375 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6676bd18-7a6d-4ecf-81aa-e5d7807eb959 None None] Checking router: 3e033806-af20-4ee4-8d0e-05f57044dfa3 for host: dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:11:03.909268 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6676bd18-7a6d-4ecf-81aa-e5d7807eb959 None None] Routers {'3e033806-af20-4ee4-8d0e-05f57044dfa3'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:11:03.909268 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-6676bd18-7a6d-4ecf-81aa-e5d7807eb959 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:10:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['3e033806-af20-4ee4-8d0e-05f57044dfa3'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:11:03.966684 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4691e9e3-1e89-4e85-a8c3-baef27015683 req-e0456a3d-20fc-4565-8747-2c84d6a377b6 service neutron] 10.222.0.46 "GET /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0866537 Dec 24 05:11:04.013970 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-6676bd18-7a6d-4ecf-81aa-e5d7807eb959 None None] Set router 3e033806-af20-4ee4-8d0e-05f57044dfa3 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:11:04.064921 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4691e9e3-1e89-4e85-a8c3-baef27015683 req-614cd06e-8cff-4ea9-93d4-b137c3474d79 service neutron] 10.222.0.46 "GET /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0910964 Dec 24 05:11:04.260234 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-6676bd18-7a6d-4ecf-81aa-e5d7807eb959 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'name': 'tempest-AttachVolumeTestJSON-1934153865-router', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:46Z', 'revision_number': 4, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'gw_port': {'id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:28:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 591, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': '229016fe-d27e-49b3-9c28-32c0a18ffbdb', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'floating_ip_address': '172.27.1.212', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'port_id': 'b3526449-31e3-4b8f-a3a1-329333c58c47', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 599, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'mac_address': 'fa:16:3e:ca:be:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5096ad5d-d707-4082-908c-d12a3d5519cc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:10:49Z', 'updated_at': '2021-12-24T05:11:02Z', 'revision_number': 1, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f59ad02b-7d9d-4dc6-8574-27886cacfc47', 'name': '', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'mac_address': 'fa:16:3e:a2:f9:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_interface', 'standard_attr_id': 592, 'fixed_ips': [{'subnet_id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:46Z', 'updated_at': '2021-12-24T05:10:49Z', 'revision_number': 5, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'subnets': [{'id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:11:04.287652 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6676bd18-7a6d-4ecf-81aa-e5d7807eb959 None None] The sync data for ids ['3e033806-af20-4ee4-8d0e-05f57044dfa3'] in dv-cinder-816443-2-iscsi is: [{'id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'name': 'tempest-AttachVolumeTestJSON-1934153865-router', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:46Z', 'revision_number': 4, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'gw_port': {'id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:28:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 591, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': '229016fe-d27e-49b3-9c28-32c0a18ffbdb', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'floating_ip_address': '172.27.1.212', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'port_id': 'b3526449-31e3-4b8f-a3a1-329333c58c47', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 599, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'mac_address': 'fa:16:3e:ca:be:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5096ad5d-d707-4082-908c-d12a3d5519cc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:10:49Z', 'updated_at': '2021-12-24T05:11:02Z', 'revision_number': 1, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f59ad02b-7d9d-4dc6-8574-27886cacfc47', 'name': '', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'mac_address': 'fa:16:3e:a2:f9:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_interface', 'standard_attr_id': 592, 'fixed_ips': [{'subnet_id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:46Z', 'updated_at': '2021-12-24T05:10:49Z', 'revision_number': 5, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'subnets': [{'id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:11:04.481332 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ffdf16a-a497-481a-a5d9-acaaf0b775a4 None None] New status for floating IP 229016fe-d27e-49b3-9c28-32c0a18ffbdb: ACTIVE {{(pid=102478) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 24 05:11:10.435136 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:11:20.501497 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:11:23.220481 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-944ea1c7-2bc7-4fe2-8df9-1fd17631c5c5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:11:25.289843 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-6a173ffc-0830-4b50-8985-7f699daa2c97 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:11:26.515365 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:11:27.956446 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:11:28.599496 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:11:32.942415 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e3cb4f4a-25b7-447f-93eb-baac9ad960fb req-4a6edd29-0c5b-44e3-98bb-4a670ae265a1 service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=067b7d98-4174-409c-85af-47a2dbf63a71&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0543568 Dec 24 05:11:33.295404 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3cb4f4a-25b7-447f-93eb-baac9ad960fb req-fa9bc6a2-1bc1-47ef-8bfe-7ed992efe01a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:11:33.296787 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e3cb4f4a-25b7-447f-93eb-baac9ad960fb req-fa9bc6a2-1bc1-47ef-8bfe-7ed992efe01a service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=8b1a80c6322a493ba10c69a77168b46f&device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 1099 time: 0.3174732 Dec 24 05:11:33.406394 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3cb4f4a-25b7-447f-93eb-baac9ad960fb req-2e4a6196-90e2-47ba-be90-e7732ee88088 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:11:33.407834 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e3cb4f4a-25b7-447f-93eb-baac9ad960fb req-2e4a6196-90e2-47ba-be90-e7732ee88088 service neutron] 10.222.0.46 "GET /v2.0/networks?id=df2331c3-0dd0-460e-980f-1e2409baa35e HTTP/1.1" status: 200 len: 911 time: 0.0843062 Dec 24 05:11:33.498971 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e3cb4f4a-25b7-447f-93eb-baac9ad960fb req-795cf3cd-dabd-4b3b-b233-c6a978e8b062 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4f943d44-a70c-4b88-9cac-b16783cab1e5 HTTP/1.1" status: 200 len: 1002 time: 0.0822766 Dec 24 05:11:33.549825 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3cb4f4a-25b7-447f-93eb-baac9ad960fb req-066a48cd-075e-4844-a095-880dbe873dbf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:11:33.551129 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e3cb4f4a-25b7-447f-93eb-baac9ad960fb req-066a48cd-075e-4844-a095-880dbe873dbf service neutron] 10.222.0.46 "GET /v2.0/subnets?id=9df81c69-0712-4247-ad21-3b3a089ce4b5 HTTP/1.1" status: 200 len: 849 time: 0.0453727 Dec 24 05:11:33.598007 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3cb4f4a-25b7-447f-93eb-baac9ad960fb req-88f30239-45ab-4e94-a55e-5714d4c61d08 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:11:33.599453 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e3cb4f4a-25b7-447f-93eb-baac9ad960fb req-88f30239-45ab-4e94-a55e-5714d4c61d08 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=df2331c3-0dd0-460e-980f-1e2409baa35e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0408847 Dec 24 05:11:33.703439 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e3cb4f4a-25b7-447f-93eb-baac9ad960fb req-a19daa35-4b9f-494e-87a9-94abaedd6a18 service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0965250 Dec 24 05:11:33.799537 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e3cb4f4a-25b7-447f-93eb-baac9ad960fb req-5950f927-9211-4722-9e47-a6893942e787 service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0881348 Dec 24 05:11:47.440429 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:11:50.528170 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:11:53.224696 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-194ef541-5465-4f4e-be1f-9cabadbbfddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:11:55.291026 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-036e5084-d8e2-437f-a6ff-b8d645459b7c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:11:56.519649 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:11:57.958130 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:11:58.598637 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:01.371688 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-bef170a8-df3c-41a5-a6ec-dcbe0ae7c450 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2046201915&fields=id&tenant_id=8b1a80c6322a493ba10c69a77168b46f HTTP/1.1" status: 200 len: 267 time: 0.0464520 Dec 24 05:12:01.485877 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-c43b48e7-58b1-416d-940c-e1b620a7dd57 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:01.487706 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-c43b48e7-58b1-416d-940c-e1b620a7dd57 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/networks?id=df2331c3-0dd0-460e-980f-1e2409baa35e HTTP/1.1" status: 200 len: 810 time: 0.1063657 Dec 24 05:12:01.502924 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-985f9a1d-3513-4a21-8671-e45293d17f68 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/quotas/8b1a80c6322a493ba10c69a77168b46f HTTP/1.1" status: 200 len: 375 time: 0.0093095 Dec 24 05:12:01.567265 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-95ee6830-de17-417b-b3a7-8b9d8db210a5 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=8b1a80c6322a493ba10c69a77168b46f&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0588753 Dec 24 05:12:01.639489 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-2f695609-b277-4542-9435-0d22ebee2bb8 service neutron] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102476) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 24 05:12:01.640517 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-2f695609-b277-4542-9435-0d22ebee2bb8 service neutron] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0611649 Dec 24 05:12:01.736232 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-21ea0b56-6854-40ef-aa27-7fbd641820e6 service neutron] 10.222.0.43 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0889668 Dec 24 05:12:01.842208 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-8f2ab440-9325-4255-967c-866d1800df26 service neutron] 10.222.0.43 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0995414 Dec 24 05:12:02.133693 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ceece858-5075-48b0-bc85-98e85ed36042 req-30efb426-e271-457e-b829-64a949e84c0e tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 210 time: 0.0272534 Dec 24 05:12:03.252355 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ff495f30-8cac-45fe-9df1-28138c3f250f req-2356647c-a2a5-47f9-abc7-44d454d656a8 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 210 time: 0.0449350 Dec 24 05:12:03.259484 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-f60417bd-3c6f-4cba-a673-6363e6bd7cd8 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:03.260429 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-f60417bd-3c6f-4cba-a673-6363e6bd7cd8 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.46 "GET /v2.0/networks?id=df2331c3-0dd0-460e-980f-1e2409baa35e HTTP/1.1" status: 200 len: 810 time: 0.1542006 Dec 24 05:12:03.355401 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-bce8e6cc-a6a7-4be4-b3b0-a6cb12d0f1e6 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.46 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8b1a80c6322a493ba10c69a77168b46f HTTP/1.1" status: 200 len: 380 time: 0.0566356 Dec 24 05:12:03.365530 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Request body: {'port': {'device_id': '9549306d-17cd-474a-afc3-2cbd15168af1', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'admin_state_up': True, 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'security_groups': ['b4b0be72-ffa9-4e18-8986-808181a3a50d']}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:12:03.485207 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Made reservation on behalf of 8b1a80c6322a493ba10c69a77168b46f for: {'port': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:12:03.489673 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:03.618448 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Allocated IP 172.20.0.12 (df2331c3-0dd0-460e-980f-1e2409baa35e/9df81c69-0712-4247-ad21-3b3a089ce4b5/44208746-37c9-4355-a253-acc24e3c178d) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:12:03.758793 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:03.795470 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:03.848945 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Network df2331c3-0dd0-460e-980f-1e2409baa35e is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:12:03.853080 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:12:03.857922 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:12:03.893798 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Pushing event updated for resources: {'Port': ['ID=44208746-37c9-4355-a253-acc24e3c178d,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:12:03.912747 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:03.913385 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:03.913742 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:03.914080 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:03.914416 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:03.914748 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:03.915078 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:03.915408 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:03.915736 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:03.916068 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:03.916399 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:03.920772 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:03.921123 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:03.953421 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:03.954035 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:03.972154 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-056701dc-7635-4ee0-91d2-341615716d4b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.46 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6104317 Dec 24 05:12:03.993239 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-effe9e2d-665a-43ab-9eef-9bfd15540ee0 service neutron] Request body: {'port': {'device_id': '9549306d-17cd-474a-afc3-2cbd15168af1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81644'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:12:04.053153 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-effe9e2d-665a-43ab-9eef-9bfd15540ee0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:04.166861 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-02e0ac5c-8541-4d9d-a27c-55efd0422d5e None None] Provisioning complete for port 44208746-37c9-4355-a253-acc24e3c178d triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:12:04.167457 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-02e0ac5c-8541-4d9d-a27c-55efd0422d5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:04.201878 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-02e0ac5c-8541-4d9d-a27c-55efd0422d5e None None] Port 44208746-37c9-4355-a253-acc24e3c178d cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 05:12:04.337369 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-effe9e2d-665a-43ab-9eef-9bfd15540ee0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 44208746-37c9-4355-a253-acc24e3c178d {{(pid=102476) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:12:04.358632 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-effe9e2d-665a-43ab-9eef-9bfd15540ee0 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:04.375715 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.provisioning_blocks [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-effe9e2d-665a-43ab-9eef-9bfd15540ee0 service neutron] Transition to ACTIVE for port object 44208746-37c9-4355-a253-acc24e3c178d will not be triggered until provisioned by entity L2. {{(pid=102476) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 24 05:12:04.391309 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ce3c0d6-591a-4504-aba8-1a2aad9750ba req-894426b2-5e45-4db8-924f-ccb104e4e590 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:04.392838 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5ce3c0d6-591a-4504-aba8-1a2aad9750ba req-894426b2-5e45-4db8-924f-ccb104e4e590 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 932 time: 0.0716674 Dec 24 05:12:04.393420 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-effe9e2d-665a-43ab-9eef-9bfd15540ee0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:04.460391 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-effe9e2d-665a-43ab-9eef-9bfd15540ee0 service neutron] Pushing event updated for resources: {'Port': ['ID=44208746-37c9-4355-a253-acc24e3c178d,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:12:04.524734 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5ce3c0d6-591a-4504-aba8-1a2aad9750ba req-8c582d49-d120-4d68-b1bc-2f57242aa206 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1235220 Dec 24 05:12:04.560549 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-effe9e2d-665a-43ab-9eef-9bfd15540ee0 service neutron] Attempting to bind port 44208746-37c9-4355-a253-acc24e3c178d on host hv-cinder-81644 for vnic_type normal with profile {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:12:04.560975 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-effe9e2d-665a-43ab-9eef-9bfd15540ee0 service neutron] Attempting to bind port 44208746-37c9-4355-a253-acc24e3c178d by drivers openvswitch,hyperv on host hv-cinder-81644 at level 0 using segments [{'id': 'cb920e21-208e-474e-84a0-615ea3280b8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e'}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:12:04.561309 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-effe9e2d-665a-43ab-9eef-9bfd15540ee0 service neutron] Attempting to bind port 44208746-37c9-4355-a253-acc24e3c178d on network df2331c3-0dd0-460e-980f-1e2409baa35e {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:12:04.565745 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-effe9e2d-665a-43ab-9eef-9bfd15540ee0 service neutron] Port 44208746-37c9-4355-a253-acc24e3c178d on network df2331c3-0dd0-460e-980f-1e2409baa35e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81644 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 24 05:12:04.566062 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-effe9e2d-665a-43ab-9eef-9bfd15540ee0 service neutron] Attempting to bind port 44208746-37c9-4355-a253-acc24e3c178d on network df2331c3-0dd0-460e-980f-1e2409baa35e {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:12:04.571341 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-effe9e2d-665a-43ab-9eef-9bfd15540ee0 service neutron] Checking agent: {'id': '7a2ffd19-371f-4f7b-a239-eea3b5cfd55b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81644', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'started_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 11, 51), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:12:04.571675 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-effe9e2d-665a-43ab-9eef-9bfd15540ee0 service neutron] Checking segment: {'id': 'cb920e21-208e-474e-84a0-615ea3280b8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:12:04.572062 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-effe9e2d-665a-43ab-9eef-9bfd15540ee0 service neutron] Bound using segment: {'id': 'cb920e21-208e-474e-84a0-615ea3280b8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e'} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:12:04.572500 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-effe9e2d-665a-43ab-9eef-9bfd15540ee0 service neutron] Bound port: 44208746-37c9-4355-a253-acc24e3c178d, host: hv-cinder-81644, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'cb920e21-208e-474e-84a0-615ea3280b8a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e'}}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:12:04.572876 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-effe9e2d-665a-43ab-9eef-9bfd15540ee0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:04.635850 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-effe9e2d-665a-43ab-9eef-9bfd15540ee0 service neutron] For port 44208746-37c9-4355-a253-acc24e3c178d, host hv-cinder-81644, cleared binding levels {{(pid=102476) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:12:04.638760 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-effe9e2d-665a-43ab-9eef-9bfd15540ee0 service neutron] For port 44208746-37c9-4355-a253-acc24e3c178d, host hv-cinder-81644, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=44208746-37c9-4355-a253-acc24e3c178d,segment=NetworkSegment(cb920e21-208e-474e-84a0-615ea3280b8a),segment_id=cb920e21-208e-474e-84a0-615ea3280b8a)] {{(pid=102476) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:12:04.645081 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-effe9e2d-665a-43ab-9eef-9bfd15540ee0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:04.679837 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-effe9e2d-665a-43ab-9eef-9bfd15540ee0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:04.680587 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-effe9e2d-665a-43ab-9eef-9bfd15540ee0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:04.681974 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-effe9e2d-665a-43ab-9eef-9bfd15540ee0 service neutron] 10.222.0.46 "PUT /v2.0/ports/44208746-37c9-4355-a253-acc24e3c178d HTTP/1.1" status: 200 len: 1094 time: 0.6932278 Dec 24 05:12:04.682320 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9549306d-17cd-474a-afc3-2cbd15168af1', 'tag': '44208746-37c9-4355-a253-acc24e3c178d'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:12:04.684635 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ba7d63e9-5cbb-44e9-a093-aba689341078" -d '{"events": [{"name": "network-changed", "server_uuid": "9549306d-17cd-474a-afc3-2cbd15168af1", "tag": "44208746-37c9-4355-a253-acc24e3c178d"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:12:04.710473 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-effe9e2d-665a-43ab-9eef-9bfd15540ee0 service neutron] Pushing event updated for resources: {'Port': ['ID=44208746-37c9-4355-a253-acc24e3c178d,revision_number=3']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:12:04.729411 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:12:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ccbc57ff-bba3-4d88-8f1e-3dd51d9838b2 x-openstack-request-id: req-ccbc57ff-bba3-4d88-8f1e-3dd51d9838b2 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:12:04.729661 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9549306d-17cd-474a-afc3-2cbd15168af1", "tag": "44208746-37c9-4355-a253-acc24e3c178d", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:12:04.729915 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-ccbc57ff-bba3-4d88-8f1e-3dd51d9838b2 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:12:04.730309 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9549306d-17cd-474a-afc3-2cbd15168af1', 'tag': '44208746-37c9-4355-a253-acc24e3c178d', 'status': 'completed', 'code': 200} Dec 24 05:12:04.798393 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-867d52dc-df1d-4a59-8603-4a50efe6bb18 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:04.799905 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-867d52dc-df1d-4a59-8603-4a50efe6bb18 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=8b1a80c6322a493ba10c69a77168b46f&device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 1097 time: 0.0460701 Dec 24 05:12:04.850224 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-27f177ab-a59d-442e-b329-5e9fafc8cb81 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=44208746-37c9-4355-a253-acc24e3c178d HTTP/1.1" status: 200 len: 217 time: 0.0350008 Dec 24 05:12:04.899033 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-bc3f0414-f2ed-4bfd-9a0e-b77641cbf626 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:04.900431 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-bc3f0414-f2ed-4bfd-9a0e-b77641cbf626 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=9df81c69-0712-4247-ad21-3b3a089ce4b5 HTTP/1.1" status: 200 len: 849 time: 0.0424430 Dec 24 05:12:04.948135 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-77da135d-06f1-4697-be7b-952d0aaa3479 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:04.949395 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-77da135d-06f1-4697-be7b-952d0aaa3479 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=df2331c3-0dd0-460e-980f-1e2409baa35e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0409708 Dec 24 05:12:05.042275 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-7f5a64c2-7b88-43f2-a9ba-430b53c8aad8 service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0854142 Dec 24 05:12:05.140293 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6fedc735-9de1-46df-9cfe-6ac693303c5f req-8933fc03-cdf1-4df7-887d-2fbed062230b service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0896473 Dec 24 05:12:05.283463 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba7d63e9-5cbb-44e9-a093-aba689341078 req-0ee81117-3d94-446a-9143-3001bd15e141 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:05.284917 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ba7d63e9-5cbb-44e9-a093-aba689341078 req-0ee81117-3d94-446a-9143-3001bd15e141 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=8b1a80c6322a493ba10c69a77168b46f&device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 1097 time: 0.0418379 Dec 24 05:12:05.381326 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba7d63e9-5cbb-44e9-a093-aba689341078 req-0a68af8b-5e87-4b7e-90f8-abcd668473d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:05.382809 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ba7d63e9-5cbb-44e9-a093-aba689341078 req-0a68af8b-5e87-4b7e-90f8-abcd668473d3 service neutron] 10.222.0.46 "GET /v2.0/networks?id=df2331c3-0dd0-460e-980f-1e2409baa35e HTTP/1.1" status: 200 len: 911 time: 0.0906451 Dec 24 05:12:05.426300 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ba7d63e9-5cbb-44e9-a093-aba689341078 req-07e053d9-adf8-41be-8b1d-d842cd3d3a45 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=44208746-37c9-4355-a253-acc24e3c178d HTTP/1.1" status: 200 len: 217 time: 0.0362437 Dec 24 05:12:05.480504 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba7d63e9-5cbb-44e9-a093-aba689341078 req-76918866-4e93-490a-b4e7-0266ae882a08 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:05.482088 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ba7d63e9-5cbb-44e9-a093-aba689341078 req-76918866-4e93-490a-b4e7-0266ae882a08 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=9df81c69-0712-4247-ad21-3b3a089ce4b5 HTTP/1.1" status: 200 len: 849 time: 0.0477309 Dec 24 05:12:05.541304 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba7d63e9-5cbb-44e9-a093-aba689341078 req-dc7a76b5-7797-40b7-9c43-f1c047438651 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:05.542742 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ba7d63e9-5cbb-44e9-a093-aba689341078 req-dc7a76b5-7797-40b7-9c43-f1c047438651 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=df2331c3-0dd0-460e-980f-1e2409baa35e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0531189 Dec 24 05:12:05.638761 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ba7d63e9-5cbb-44e9-a093-aba689341078 req-bd950b6a-f32f-4185-8743-66f35e5ea006 service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0869288 Dec 24 05:12:05.648141 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75d7ae61-522d-4eaa-904b-2bb4ff32df76 req-339f5b3f-4ac0-4fd9-b01a-29dc46620ef7 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:05.649722 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-75d7ae61-522d-4eaa-904b-2bb4ff32df76 req-339f5b3f-4ac0-4fd9-b01a-29dc46620ef7 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 944 time: 0.0514998 Dec 24 05:12:05.700257 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-75d7ae61-522d-4eaa-904b-2bb4ff32df76 req-30dc572f-cf1a-4215-9ada-0b663b959472 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439255 Dec 24 05:12:05.738313 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ba7d63e9-5cbb-44e9-a093-aba689341078 req-195d91ba-d036-43d6-8442-02aed1d39d4a service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0916989 Dec 24 05:12:06.835209 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-465d5b2f-0234-43c4-b43b-0015ad094106 req-d5de0d4f-af7c-4b6b-944c-6d5737b31832 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:06.836693 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-465d5b2f-0234-43c4-b43b-0015ad094106 req-d5de0d4f-af7c-4b6b-944c-6d5737b31832 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 944 time: 0.0546529 Dec 24 05:12:06.888811 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-465d5b2f-0234-43c4-b43b-0015ad094106 req-5f41e3b9-b726-4064-b82a-86a323ddb370 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462577 Dec 24 05:12:08.012242 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43b0460a-cda3-4ec0-bd45-57b634a02aac req-4702bff6-1e78-4a3b-b3c3-7b14fdeeef5a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:08.014502 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-43b0460a-cda3-4ec0-bd45-57b634a02aac req-4702bff6-1e78-4a3b-b3c3-7b14fdeeef5a tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 944 time: 0.0557270 Dec 24 05:12:08.068571 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-43b0460a-cda3-4ec0-bd45-57b634a02aac req-74c059a6-07de-4e4a-aca7-7171231426b2 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449450 Dec 24 05:12:09.186277 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d36e24e-6336-460e-b605-10b58bd34563 req-6f37ce01-ff7b-4fd4-81e6-2a29007110c6 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:09.187617 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6d36e24e-6336-460e-b605-10b58bd34563 req-6f37ce01-ff7b-4fd4-81e6-2a29007110c6 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 944 time: 0.0498154 Dec 24 05:12:09.241877 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6d36e24e-6336-460e-b605-10b58bd34563 req-07f11b2d-c1f0-41ab-ae74-acc5b79a847b tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482185 Dec 24 05:12:10.368288 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c03f418d-2464-4cb5-957c-056c19e46925 req-ff4908dd-bb93-4837-8ce0-0bd15e1e320f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:10.369762 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c03f418d-2464-4cb5-957c-056c19e46925 req-ff4908dd-bb93-4837-8ce0-0bd15e1e320f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 944 time: 0.0548520 Dec 24 05:12:10.418099 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c03f418d-2464-4cb5-957c-056c19e46925 req-ad6deb93-a38b-404c-aaef-5a5e50921520 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422883 Dec 24 05:12:11.557808 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4883f761-d684-4ada-9402-f3d362ed5dfe req-fa03901e-4416-4f52-a378-2aea7ea05596 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:11.559308 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4883f761-d684-4ada-9402-f3d362ed5dfe req-fa03901e-4416-4f52-a378-2aea7ea05596 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 944 time: 0.0546818 Dec 24 05:12:11.612563 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4883f761-d684-4ada-9402-f3d362ed5dfe req-f2e38b21-f3f8-4558-b007-72a64635f4ca tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441632 Dec 24 05:12:12.740801 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa72842b-bf35-4115-97b6-8cb45726a70d req-e95e31aa-e326-41ca-b9a9-00248c714dba tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:12.742748 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-fa72842b-bf35-4115-97b6-8cb45726a70d req-e95e31aa-e326-41ca-b9a9-00248c714dba tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 944 time: 0.0566647 Dec 24 05:12:12.791971 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-fa72842b-bf35-4115-97b6-8cb45726a70d req-56992f91-a65f-4992-953e-7a0805a84ee6 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431647 Dec 24 05:12:13.598396 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 44208746-37c9-4355-a253-acc24e3c178d details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 05:12:13.693594 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 44208746-37c9-4355-a253-acc24e3c178d, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=44208746-37c9-4355-a253-acc24e3c178d,segment=NetworkSegment(cb920e21-208e-474e-84a0-615ea3280b8a),segment_id=cb920e21-208e-474e-84a0-615ea3280b8a)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:12:13.708694 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': '44208746-37c9-4355-a253-acc24e3c178d', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'port_id': '44208746-37c9-4355-a253-acc24e3c178d', 'mac_address': 'fa:16:3e:d2:6d:c2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 122, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 05:12:13.745822 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:13.763035 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 44208746-37c9-4355-a253-acc24e3c178d {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:12:13.782517 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 44208746-37c9-4355-a253-acc24e3c178d, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=44208746-37c9-4355-a253-acc24e3c178d,segment=NetworkSegment(cb920e21-208e-474e-84a0-615ea3280b8a),segment_id=cb920e21-208e-474e-84a0-615ea3280b8a)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:12:13.789355 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:13.836879 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=44208746-37c9-4355-a253-acc24e3c178d,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:12:13.844330 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:13.844711 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:13.845054 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:13.845385 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:13.845712 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:13.846037 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:13.846357 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:13.846676 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:13.846999 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:13.847341 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:13.847667 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:13.847981 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:13.848294 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:12:13.913370 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52bd2940-5e51-42d5-a4b9-5748f43345e9 req-81ff35e3-64cb-4042-8768-3ba85964bc0c tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:13.914884 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-52bd2940-5e51-42d5-a4b9-5748f43345e9 req-81ff35e3-64cb-4042-8768-3ba85964bc0c tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 945 time: 0.0491891 Dec 24 05:12:13.969130 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-52bd2940-5e51-42d5-a4b9-5748f43345e9 req-957f7aa6-a793-4087-81ec-df1bb3bdaae2 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452981 Dec 24 05:12:14.231000 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['44208746-37c9-4355-a253-acc24e3c178d'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:12:15.100736 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ef1b276-a25d-44cb-87bc-9ef9d7c19def req-66cf3310-223a-4918-8a88-62dd02409d50 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:15.102441 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4ef1b276-a25d-44cb-87bc-9ef9d7c19def req-66cf3310-223a-4918-8a88-62dd02409d50 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 945 time: 0.0611696 Dec 24 05:12:15.170454 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4ef1b276-a25d-44cb-87bc-9ef9d7c19def req-2132f3fe-2dd8-445f-a803-f2c403460996 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0587463 Dec 24 05:12:15.613062 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 44208746-37c9-4355-a253-acc24e3c178d up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:12:15.672029 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning for port 44208746-37c9-4355-a253-acc24e3c178d completed by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 24 05:12:15.676157 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port 44208746-37c9-4355-a253-acc24e3c178d triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:12:15.676548 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:15.755717 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:15.778838 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9549306d-17cd-474a-afc3-2cbd15168af1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '44208746-37c9-4355-a253-acc24e3c178d'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:12:15.781161 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-41703d0a-87ae-4eec-925d-90359bb9b49f" -d '{"events": [{"server_uuid": "9549306d-17cd-474a-afc3-2cbd15168af1", "name": "network-vif-plugged", "status": "completed", "tag": "44208746-37c9-4355-a253-acc24e3c178d"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:12:15.794369 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 44208746-37c9-4355-a253-acc24e3c178d, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=44208746-37c9-4355-a253-acc24e3c178d,segment=NetworkSegment(cb920e21-208e-474e-84a0-615ea3280b8a),segment_id=cb920e21-208e-474e-84a0-615ea3280b8a)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:12:15.798672 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:15.825851 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:12:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-006597b1-27f5-45f5-95bf-50589bb57d86 x-openstack-request-id: req-006597b1-27f5-45f5-95bf-50589bb57d86 {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:12:15.826121 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9549306d-17cd-474a-afc3-2cbd15168af1", "name": "network-vif-plugged", "status": "completed", "tag": "44208746-37c9-4355-a253-acc24e3c178d", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:12:15.826408 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-006597b1-27f5-45f5-95bf-50589bb57d86 {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:12:15.826798 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9549306d-17cd-474a-afc3-2cbd15168af1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '44208746-37c9-4355-a253-acc24e3c178d', 'code': 200} Dec 24 05:12:15.854022 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=44208746-37c9-4355-a253-acc24e3c178d,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:12:16.096062 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-028fd096-f400-4197-9a7b-a01a40224986 req-355a65f2-056b-4955-89e5-bd86506e77b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:16.097608 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-028fd096-f400-4197-9a7b-a01a40224986 req-355a65f2-056b-4955-89e5-bd86506e77b2 service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 1099 time: 0.0460405 Dec 24 05:12:16.143989 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-028fd096-f400-4197-9a7b-a01a40224986 req-eca626ad-416c-4c95-be04-675c73e1927d service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390317 Dec 24 05:12:16.304571 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4170bf65-cb61-43d0-8d27-85161eac4d8f req-4bcc4d9b-3075-4a70-9fd9-c6622e6eaecf tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:16.306733 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4170bf65-cb61-43d0-8d27-85161eac4d8f req-4bcc4d9b-3075-4a70-9fd9-c6622e6eaecf tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 946 time: 0.0600824 Dec 24 05:12:16.360212 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4170bf65-cb61-43d0-8d27-85161eac4d8f req-b9274e4a-0a25-43ca-a1b5-6f730d2108c6 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0472355 Dec 24 05:12:17.490107 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57c342ba-92d3-4c53-a89b-2ceb14f05f42 req-184c66ea-0e16-4aee-bf2b-3ed40327bde8 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:17.491620 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-57c342ba-92d3-4c53-a89b-2ceb14f05f42 req-184c66ea-0e16-4aee-bf2b-3ed40327bde8 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 946 time: 0.0557597 Dec 24 05:12:17.546322 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-57c342ba-92d3-4c53-a89b-2ceb14f05f42 req-2ec8ab2a-3a92-4d34-8e6e-3bcf074ea96e tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482655 Dec 24 05:12:18.667031 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed8dea4e-36cf-4b0a-8162-9b2ff1bcb71a req-be6f46e1-e4cb-4678-b2f5-a2887a0d36e1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:18.668517 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ed8dea4e-36cf-4b0a-8162-9b2ff1bcb71a req-be6f46e1-e4cb-4678-b2f5-a2887a0d36e1 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 946 time: 0.0537758 Dec 24 05:12:18.720222 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ed8dea4e-36cf-4b0a-8162-9b2ff1bcb71a req-711102a5-88ac-4f08-a3c6-b2eb12f07db3 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455256 Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:18.893497 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:12:18.896676 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:18.896676 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:12:18.896676 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:18.896676 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:12:18.896676 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:18.896676 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:12:18.896676 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:18.896676 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:12:18.896676 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:18.896676 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:12:18.896676 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:12:18.896676 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:12:18.896676 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4ddc9a3-beed-40d9-a185-94fa3141ad8b req-302dba19-5e0f-4477-a278-985096b71352 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:18.897871 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e4ddc9a3-beed-40d9-a185-94fa3141ad8b req-302dba19-5e0f-4477-a278-985096b71352 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 946 time: 0.0505590 Dec 24 05:12:18.947058 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e4ddc9a3-beed-40d9-a185-94fa3141ad8b req-9d08a3a1-1944-4cf4-8b69-03d53a2cc663 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438802 Dec 24 05:12:18.970295 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34670) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:12:19.151297 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-030d3bbb-13b0-4d0d-8c46-7eefff37db43 tempest-TestVolumeBootPattern-1420950562 tempest-TestVolumeBootPattern-1420950562-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:19.152803 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-030d3bbb-13b0-4d0d-8c46-7eefff37db43 tempest-TestVolumeBootPattern-1420950562 tempest-TestVolumeBootPattern-1420950562-project-admin] 10.222.0.43 "GET /v2.0/ports?device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 1094 time: 0.1815326 Dec 24 05:12:19.155721 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34676) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:12:19.160083 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-af16b7ad-be59-4c74-b658-10f842490e5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Request body: {'floatingip': {'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'port_id': '44208746-37c9-4355-a253-acc24e3c178d', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'fixed_ip_address': '172.20.0.12'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:12:19.184328 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-af16b7ad-be59-4c74-b658-10f842490e5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for floatingip, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:19.284708 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-af16b7ad-be59-4c74-b658-10f842490e5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:19.394569 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [None req-af16b7ad-be59-4c74-b658-10f842490e5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Allocated IP 172.27.1.32 (9b4e4b31-551f-45a9-b26a-cb44ee20a17d/f277b899-8779-420e-8a8d-bfcd5eb7f012/4660a148-071e-4d58-8df4-2ca7ec0af5c9) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:12:19.500281 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-af16b7ad-be59-4c74-b658-10f842490e5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:19.535736 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-af16b7ad-be59-4c74-b658-10f842490e5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:19.579600 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af16b7ad-be59-4c74-b658-10f842490e5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:12:19.582578 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-af16b7ad-be59-4c74-b658-10f842490e5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:12:19.587386 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af16b7ad-be59-4c74-b658-10f842490e5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:12:19.590478 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af16b7ad-be59-4c74-b658-10f842490e5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Pushing event updated for resources: {'Port': ['ID=4660a148-071e-4d58-8df4-2ca7ec0af5c9,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:12:19.942594 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-af16b7ad-be59-4c74-b658-10f842490e5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:20.011835 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-af16b7ad-be59-4c74-b658-10f842490e5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:20.183133 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-af16b7ad-be59-4c74-b658-10f842490e5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:20.190547 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-af16b7ad-be59-4c74-b658-10f842490e5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:20.255693 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af16b7ad-be59-4c74-b658-10f842490e5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Pushing event updated for resources: {'Port': ['ID=4660a148-071e-4d58-8df4-2ca7ec0af5c9,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:12:20.274502 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-af16b7ad-be59-4c74-b658-10f842490e5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-545804'] for floatingip, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:20.380824 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.l3_db [None req-af16b7ad-be59-4c74-b658-10f842490e5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Floating IP 5ce8edab-729c-418c-9bed-ca75bb258c20 associated. External IP: 172.27.1.32, port: 44208746-37c9-4355-a253-acc24e3c178d. Dec 24 05:12:20.526008 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:20.591785 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-af16b7ad-be59-4c74-b658-10f842490e5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Router 9df11fe3-ba73-4793-a582-0e00f27a374d has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102476) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:12:20.703370 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-af16b7ad-be59-4c74-b658-10f842490e5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:12:20.714800 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9db3b015-b12b-44c7-84eb-9dac75eeb9c1 None None] Sync routers for ids ['9df11fe3-ba73-4793-a582-0e00f27a374d'] in dv-cinder-816443-2-iscsi {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:12:20.725145 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-af16b7ad-be59-4c74-b658-10f842490e5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for floatingip, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:20.725352 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9db3b015-b12b-44c7-84eb-9dac75eeb9c1 None None] Routers {'9df11fe3-ba73-4793-a582-0e00f27a374d'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:12:20.725869 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-9db3b015-b12b-44c7-84eb-9dac75eeb9c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:11:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['9df11fe3-ba73-4793-a582-0e00f27a374d'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:12:20.752085 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-af16b7ad-be59-4c74-b658-10f842490e5f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.5953546 Dec 24 05:12:20.752719 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9549306d-17cd-474a-afc3-2cbd15168af1', 'tag': '44208746-37c9-4355-a253-acc24e3c178d'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:12:20.754982 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b28630ad-a086-4e23-9ac8-b41c5a843bb2" -d '{"events": [{"name": "network-changed", "server_uuid": "9549306d-17cd-474a-afc3-2cbd15168af1", "tag": "44208746-37c9-4355-a253-acc24e3c178d"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:12:20.791833 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:12:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-03efcd9e-8c0a-46df-baa9-6c37372c06bf x-openstack-request-id: req-03efcd9e-8c0a-46df-baa9-6c37372c06bf {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:12:20.792127 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9549306d-17cd-474a-afc3-2cbd15168af1", "tag": "44208746-37c9-4355-a253-acc24e3c178d", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:12:20.792383 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-03efcd9e-8c0a-46df-baa9-6c37372c06bf {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:12:20.792815 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9549306d-17cd-474a-afc3-2cbd15168af1', 'tag': '44208746-37c9-4355-a253-acc24e3c178d', 'status': 'completed', 'code': 200} Dec 24 05:12:20.832926 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-9db3b015-b12b-44c7-84eb-9dac75eeb9c1 None None] Set router 9df11fe3-ba73-4793-a582-0e00f27a374d gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:12:20.887678 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b28630ad-a086-4e23-9ac8-b41c5a843bb2 req-0c3aa712-1dee-4e0e-8fd0-6652e13ea2c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:20.889582 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b28630ad-a086-4e23-9ac8-b41c5a843bb2 req-0c3aa712-1dee-4e0e-8fd0-6652e13ea2c8 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=8b1a80c6322a493ba10c69a77168b46f&device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 1099 time: 0.0431318 Dec 24 05:12:21.065203 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-9db3b015-b12b-44c7-84eb-9dac75eeb9c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': '5ce8edab-729c-418c-9bed-ca75bb258c20', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'floating_ip_address': '172.27.1.32', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'port_id': '44208746-37c9-4355-a253-acc24e3c178d', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 603, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'mac_address': 'fa:16:3e:d2:6d:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9549306d-17cd-474a-afc3-2cbd15168af1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:12:19Z', 'updated_at': '2021-12-24T05:12:19Z', 'revision_number': 0, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'fixed_ip_address_scope': None}, {'id': 'dce0027a-d049-4ae2-9714-ef593a9b7a8f', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'floating_ip_address': '172.27.1.210', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'port_id': '4f943d44-a70c-4b88-9cac-b16783cab1e5', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 580, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'mac_address': 'fa:16:3e:5a:15:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '067b7d98-4174-409c-85af-47a2dbf63a71', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:09:59Z', 'updated_at': '2021-12-24T05:10:01Z', 'revision_number': 1, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '826094e8-3c74-4e96-9507-84128f7209f1', 'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'mac_address': 'fa:16:3e:b3:73:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:21Z', 'updated_at': '2021-12-24T05:06:27Z', 'revision_number': 5, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'subnets': [{'id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:12:21.092840 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9db3b015-b12b-44c7-84eb-9dac75eeb9c1 None None] Checking router: 9df11fe3-ba73-4793-a582-0e00f27a374d for host: dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:12:21.102962 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9db3b015-b12b-44c7-84eb-9dac75eeb9c1 None None] Routers {'9df11fe3-ba73-4793-a582-0e00f27a374d'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:12:21.103623 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-9db3b015-b12b-44c7-84eb-9dac75eeb9c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:11:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['9df11fe3-ba73-4793-a582-0e00f27a374d'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:12:21.212982 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-9db3b015-b12b-44c7-84eb-9dac75eeb9c1 None None] Set router 9df11fe3-ba73-4793-a582-0e00f27a374d gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:12:21.260576 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b28630ad-a086-4e23-9ac8-b41c5a843bb2 req-0e89e408-c81c-44f3-abcb-8a5641b8e748 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:21.262118 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b28630ad-a086-4e23-9ac8-b41c5a843bb2 req-0e89e408-c81c-44f3-abcb-8a5641b8e748 service neutron] 10.222.0.46 "GET /v2.0/networks?id=df2331c3-0dd0-460e-980f-1e2409baa35e HTTP/1.1" status: 200 len: 911 time: 0.3653324 Dec 24 05:12:21.332813 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b28630ad-a086-4e23-9ac8-b41c5a843bb2 req-a9a9eeb6-3894-4a62-b262-7bc89eb5a545 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=44208746-37c9-4355-a253-acc24e3c178d HTTP/1.1" status: 200 len: 999 time: 0.0623274 Dec 24 05:12:21.383436 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b28630ad-a086-4e23-9ac8-b41c5a843bb2 req-428381a7-34d9-442c-a748-36ec541ab67b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:21.385826 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b28630ad-a086-4e23-9ac8-b41c5a843bb2 req-428381a7-34d9-442c-a748-36ec541ab67b service neutron] 10.222.0.46 "GET /v2.0/subnets?id=9df81c69-0712-4247-ad21-3b3a089ce4b5 HTTP/1.1" status: 200 len: 849 time: 0.0454080 Dec 24 05:12:21.437781 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b28630ad-a086-4e23-9ac8-b41c5a843bb2 req-96e94713-94b7-40df-b10b-204d07e690c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:21.439445 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b28630ad-a086-4e23-9ac8-b41c5a843bb2 req-96e94713-94b7-40df-b10b-204d07e690c8 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=df2331c3-0dd0-460e-980f-1e2409baa35e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0470231 Dec 24 05:12:21.465820 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-9db3b015-b12b-44c7-84eb-9dac75eeb9c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': '5ce8edab-729c-418c-9bed-ca75bb258c20', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'floating_ip_address': '172.27.1.32', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'port_id': '44208746-37c9-4355-a253-acc24e3c178d', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 603, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'mac_address': 'fa:16:3e:d2:6d:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9549306d-17cd-474a-afc3-2cbd15168af1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:12:19Z', 'updated_at': '2021-12-24T05:12:19Z', 'revision_number': 0, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'fixed_ip_address_scope': None}, {'id': 'dce0027a-d049-4ae2-9714-ef593a9b7a8f', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'floating_ip_address': '172.27.1.210', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'port_id': '4f943d44-a70c-4b88-9cac-b16783cab1e5', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 580, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'mac_address': 'fa:16:3e:5a:15:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '067b7d98-4174-409c-85af-47a2dbf63a71', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:09:59Z', 'updated_at': '2021-12-24T05:10:01Z', 'revision_number': 1, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '826094e8-3c74-4e96-9507-84128f7209f1', 'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'mac_address': 'fa:16:3e:b3:73:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:21Z', 'updated_at': '2021-12-24T05:06:27Z', 'revision_number': 5, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'subnets': [{'id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:12:21.491916 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9db3b015-b12b-44c7-84eb-9dac75eeb9c1 None None] The sync data for ids ['9df11fe3-ba73-4793-a582-0e00f27a374d'] in dv-cinder-816443-2-iscsi is: [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': '5ce8edab-729c-418c-9bed-ca75bb258c20', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'floating_ip_address': '172.27.1.32', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'port_id': '44208746-37c9-4355-a253-acc24e3c178d', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 603, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'mac_address': 'fa:16:3e:d2:6d:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9549306d-17cd-474a-afc3-2cbd15168af1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:12:19Z', 'updated_at': '2021-12-24T05:12:19Z', 'revision_number': 0, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'fixed_ip_address_scope': None}, {'id': 'dce0027a-d049-4ae2-9714-ef593a9b7a8f', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'floating_ip_address': '172.27.1.210', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'port_id': '4f943d44-a70c-4b88-9cac-b16783cab1e5', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 580, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'mac_address': 'fa:16:3e:5a:15:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '067b7d98-4174-409c-85af-47a2dbf63a71', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:09:59Z', 'updated_at': '2021-12-24T05:10:01Z', 'revision_number': 1, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '826094e8-3c74-4e96-9507-84128f7209f1', 'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'mac_address': 'fa:16:3e:b3:73:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:21Z', 'updated_at': '2021-12-24T05:06:27Z', 'revision_number': 5, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'subnets': [{'id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:12:21.569942 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b28630ad-a086-4e23-9ac8-b41c5a843bb2 req-a34d9e86-b5ce-4bfb-a888-ddc564804a26 service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0859282 Dec 24 05:12:21.673417 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b28630ad-a086-4e23-9ac8-b41c5a843bb2 req-9dfd5d22-09f2-4ee6-b504-cab409cb4f18 service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0953557 Dec 24 05:12:21.680404 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-744f0880-6c85-4d61-99f0-ed87e8ff412c None None] New status for floating IP 5ce8edab-729c-418c-9bed-ca75bb258c20: ACTIVE {{(pid=102478) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 24 05:12:23.231637 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-df75b2b1-8afb-47fb-8c90-eef33e73f9ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:24.445517 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:12:25.291961 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-5c910490-5989-4466-afbd-4b8e3ac34caf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:26.525814 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:27.967113 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:28.583383 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:33.354035 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3e3db813-3012-4929-9358-d2d241b339cc req-f6daa1b9-af5c-47d0-978c-f16688cd9d5b service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=067b7d98-4174-409c-85af-47a2dbf63a71&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0427177 Dec 24 05:12:33.497099 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e3db813-3012-4929-9358-d2d241b339cc req-18970f83-7732-47e9-8531-b1e97f6d39a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:33.498599 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3e3db813-3012-4929-9358-d2d241b339cc req-18970f83-7732-47e9-8531-b1e97f6d39a3 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=8b1a80c6322a493ba10c69a77168b46f&device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 1099 time: 0.0435979 Dec 24 05:12:33.609970 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e3db813-3012-4929-9358-d2d241b339cc req-d28cd3be-2dad-4ee3-8e24-89de2ab163fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:33.611352 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3e3db813-3012-4929-9358-d2d241b339cc req-d28cd3be-2dad-4ee3-8e24-89de2ab163fb service neutron] 10.222.0.46 "GET /v2.0/networks?id=df2331c3-0dd0-460e-980f-1e2409baa35e HTTP/1.1" status: 200 len: 911 time: 0.0887852 Dec 24 05:12:33.679926 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3e3db813-3012-4929-9358-d2d241b339cc req-20fd6913-5b1e-42e3-9c48-b3c083ef7147 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4f943d44-a70c-4b88-9cac-b16783cab1e5 HTTP/1.1" status: 200 len: 1002 time: 0.0603456 Dec 24 05:12:33.745461 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e3db813-3012-4929-9358-d2d241b339cc req-a86e5a71-ddbb-448c-8f6c-1c407940a9fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:33.746866 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3e3db813-3012-4929-9358-d2d241b339cc req-a86e5a71-ddbb-448c-8f6c-1c407940a9fd service neutron] 10.222.0.46 "GET /v2.0/subnets?id=9df81c69-0712-4247-ad21-3b3a089ce4b5 HTTP/1.1" status: 200 len: 849 time: 0.0584228 Dec 24 05:12:33.803126 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e3db813-3012-4929-9358-d2d241b339cc req-2454d00e-39f7-48e1-8e00-aaef573c6673 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:33.804626 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3e3db813-3012-4929-9358-d2d241b339cc req-2454d00e-39f7-48e1-8e00-aaef573c6673 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=df2331c3-0dd0-460e-980f-1e2409baa35e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0447667 Dec 24 05:12:33.896022 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3e3db813-3012-4929-9358-d2d241b339cc req-3604943b-f085-4939-aad8-48cb2fb0004f service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0832546 Dec 24 05:12:33.984962 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3e3db813-3012-4929-9358-d2d241b339cc req-7afcd485-1751-48ba-a0c1-699af03cc072 service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0805836 Dec 24 05:12:37.641283 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edd73ee6-d600-455e-bd75-a9f580d2a444 req-f1cd3b70-93dd-476e-b34f-3a6f18735504 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:37.642995 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-edd73ee6-d600-455e-bd75-a9f580d2a444 req-f1cd3b70-93dd-476e-b34f-3a6f18735504 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0536544 Dec 24 05:12:37.694830 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-edd73ee6-d600-455e-bd75-a9f580d2a444 req-c541e99d-6b51-41cf-9176-b0b07013e267 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457597 Dec 24 05:12:38.825657 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8730b33e-f6a0-4c3a-975f-12faa8d29b30 req-885cc0f4-5c3d-4128-9db2-2996b7c5fe2a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:38.827139 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8730b33e-f6a0-4c3a-975f-12faa8d29b30 req-885cc0f4-5c3d-4128-9db2-2996b7c5fe2a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0506823 Dec 24 05:12:38.882588 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8730b33e-f6a0-4c3a-975f-12faa8d29b30 req-5b01c36c-4021-4cfb-8f1e-77ff35ebd6ca tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0493605 Dec 24 05:12:40.014541 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eaa2f8d-99c1-44ef-82f1-340182e32682 req-94859f6f-daa8-475a-850c-f087f3321c85 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:40.016009 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8eaa2f8d-99c1-44ef-82f1-340182e32682 req-94859f6f-daa8-475a-850c-f087f3321c85 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0553503 Dec 24 05:12:40.065193 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8eaa2f8d-99c1-44ef-82f1-340182e32682 req-f7cb3147-2b68-4217-87dd-0fcbc1bb6d52 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423748 Dec 24 05:12:41.201406 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e79fc537-1775-4af2-bae2-ee1a4fc82374 req-1694c760-0517-4be9-909d-e8c320ae8c03 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:41.202899 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e79fc537-1775-4af2-bae2-ee1a4fc82374 req-1694c760-0517-4be9-909d-e8c320ae8c03 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0575397 Dec 24 05:12:41.251704 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e79fc537-1775-4af2-bae2-ee1a4fc82374 req-19d3a573-40cc-42b5-916b-86a30004b848 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426338 Dec 24 05:12:42.378335 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b14bd28-c257-4fba-a41c-2a4746d1d294 req-09afb3bc-5ade-4f76-ab85-6eb2106609d7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:42.379782 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8b14bd28-c257-4fba-a41c-2a4746d1d294 req-09afb3bc-5ade-4f76-ab85-6eb2106609d7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0499539 Dec 24 05:12:42.432252 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8b14bd28-c257-4fba-a41c-2a4746d1d294 req-c86039f4-5230-4120-a77b-4b7843a72363 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0464032 Dec 24 05:12:43.564198 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f16fbb85-8ac1-4ca2-8380-7a401966f458 req-1b861f60-18d9-491b-880f-4f567c090302 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:43.565766 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f16fbb85-8ac1-4ca2-8380-7a401966f458 req-1b861f60-18d9-491b-880f-4f567c090302 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0567775 Dec 24 05:12:43.615172 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f16fbb85-8ac1-4ca2-8380-7a401966f458 req-b5eb9c4a-1c9d-4bcb-8aa6-c804105fa77b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433550 Dec 24 05:12:44.747396 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88a1524c-ebab-4819-9fb4-b63675efa258 req-a1cd404e-b76c-4478-919a-85e6ecc436ff tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:44.748882 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-88a1524c-ebab-4819-9fb4-b63675efa258 req-a1cd404e-b76c-4478-919a-85e6ecc436ff tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0524364 Dec 24 05:12:44.800539 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-88a1524c-ebab-4819-9fb4-b63675efa258 req-15dc9ab3-b4ac-4f3f-bed3-18e8d3a110dc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442293 Dec 24 05:12:45.934546 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-991d2e33-60ff-4ac9-b080-e936e1a80b8e req-63582cd1-016f-4ed6-b439-31908176c025 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:45.936014 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-991d2e33-60ff-4ac9-b080-e936e1a80b8e req-63582cd1-016f-4ed6-b439-31908176c025 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0538001 Dec 24 05:12:45.986393 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-991d2e33-60ff-4ac9-b080-e936e1a80b8e req-ed728aa1-4851-40e1-a825-a27a00eb8b4d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440509 Dec 24 05:12:47.123297 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f8e022d-0ade-4be4-8a58-a3ae0eb098bf req-ee6eee88-f085-4753-98d7-6a392ce8637e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:47.124760 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0f8e022d-0ade-4be4-8a58-a3ae0eb098bf req-ee6eee88-f085-4753-98d7-6a392ce8637e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0597215 Dec 24 05:12:47.173053 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0f8e022d-0ade-4be4-8a58-a3ae0eb098bf req-aec9e2b9-93e3-400b-b732-47218a616879 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408144 Dec 24 05:12:48.299611 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73a38bc6-09c2-45ba-8b3c-a463387f3f21 req-aa9ac7a3-f4ad-41ce-83d4-fed1a3fc0b36 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:48.301152 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-73a38bc6-09c2-45ba-8b3c-a463387f3f21 req-aa9ac7a3-f4ad-41ce-83d4-fed1a3fc0b36 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0550497 Dec 24 05:12:48.350937 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-73a38bc6-09c2-45ba-8b3c-a463387f3f21 req-706f4793-4b30-4905-8af0-081413762c14 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430996 Dec 24 05:12:49.479050 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c72ab520-0e9a-4d65-8d1d-f25c66ea1ad8 req-bf66912a-90bf-4e06-b01f-210479eb3801 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:49.480555 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c72ab520-0e9a-4d65-8d1d-f25c66ea1ad8 req-bf66912a-90bf-4e06-b01f-210479eb3801 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0532274 Dec 24 05:12:49.530766 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c72ab520-0e9a-4d65-8d1d-f25c66ea1ad8 req-fa0d494b-fec8-474e-9887-17dd349f79cd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410407 Dec 24 05:12:50.542575 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:50.651671 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f129778-b929-4ac0-9616-c80e513f6b80 req-7fa387b6-962a-472c-a95c-ed074e14b495 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:50.653200 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8f129778-b929-4ac0-9616-c80e513f6b80 req-7fa387b6-962a-472c-a95c-ed074e14b495 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0529568 Dec 24 05:12:50.707789 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8f129778-b929-4ac0-9616-c80e513f6b80 req-63fafc9c-c449-4a75-ab96-d26ff98d0060 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454555 Dec 24 05:12:51.846296 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-146e1d4a-d77e-4217-aa18-580d60d34226 req-c45506b8-ad4a-43e3-bb37-a6004c848ea4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:51.847754 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-146e1d4a-d77e-4217-aa18-580d60d34226 req-c45506b8-ad4a-43e3-bb37-a6004c848ea4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0561275 Dec 24 05:12:51.901768 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-146e1d4a-d77e-4217-aa18-580d60d34226 req-88b5908d-7e54-4a25-b804-85b06fe2f1cc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452640 Dec 24 05:12:53.053751 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1680b1a-94ea-446a-b02f-5a7658255b72 req-d630775f-163b-4a29-94fe-6d05390bc9c2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:53.055284 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e1680b1a-94ea-446a-b02f-5a7658255b72 req-d630775f-163b-4a29-94fe-6d05390bc9c2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0554609 Dec 24 05:12:53.108494 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e1680b1a-94ea-446a-b02f-5a7658255b72 req-249decca-f78a-45de-9b98-5d14911035d8 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0460465 Dec 24 05:12:53.217015 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-9fb0535b-33ab-4e1c-8b0d-b1a90e550fa2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:54.239677 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1086966-05a3-41d7-ae83-4aab7b531a3c req-bdfb9ed4-3339-42a1-9554-e55b6070ed60 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:54.241072 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d1086966-05a3-41d7-ae83-4aab7b531a3c req-bdfb9ed4-3339-42a1-9554-e55b6070ed60 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0507548 Dec 24 05:12:54.289906 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-d1086966-05a3-41d7-ae83-4aab7b531a3c req-2b59450e-7cf2-4c49-9b30-ae5e96687fbd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427470 Dec 24 05:12:55.285242 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e8560787-f578-46a5-970e-4610a26382d1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:55.421584 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-588eec84-bb6b-48aa-b425-a4b4aa361d9c req-0c28a443-1297-4a76-8b11-56d51856c8dc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:55.423062 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-588eec84-bb6b-48aa-b425-a4b4aa361d9c req-0c28a443-1297-4a76-8b11-56d51856c8dc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0563903 Dec 24 05:12:55.475316 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-588eec84-bb6b-48aa-b425-a4b4aa361d9c req-2c191196-ad22-4729-9f30-e05d567a06b3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432599 Dec 24 05:12:56.529824 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:56.610433 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a9a1268-11a8-4e87-822a-9bee6078c281 req-eb6ba4fc-5739-4172-8a3b-4d4cd0f95372 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:56.612334 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6a9a1268-11a8-4e87-822a-9bee6078c281 req-eb6ba4fc-5739-4172-8a3b-4d4cd0f95372 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0564029 Dec 24 05:12:56.670187 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6a9a1268-11a8-4e87-822a-9bee6078c281 req-3644bd2b-24ba-432c-846e-be1167218a91 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0511937 Dec 24 05:12:57.818773 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c161f8c6-bcb2-47ff-8200-f8059875294f req-e9ce2fac-5f1b-457f-a8bd-121a9de66505 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:57.820316 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c161f8c6-bcb2-47ff-8200-f8059875294f req-e9ce2fac-5f1b-457f-a8bd-121a9de66505 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0608149 Dec 24 05:12:57.868728 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c161f8c6-bcb2-47ff-8200-f8059875294f req-a24df36a-cbd6-4a47-a483-4b9f9ce9ef22 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421100 Dec 24 05:12:57.965800 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:58.597535 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:12:59.011068 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f7845e6-7e6d-481e-9bdb-7502d2f93977 req-28c41327-25c2-4029-80b0-b5114367d4e6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:59.012505 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3f7845e6-7e6d-481e-9bdb-7502d2f93977 req-28c41327-25c2-4029-80b0-b5114367d4e6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0575519 Dec 24 05:12:59.061813 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3f7845e6-7e6d-481e-9bdb-7502d2f93977 req-25daa1f0-664b-43b5-a02a-cb34a78269ec tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409768 Dec 24 05:12:59.272947 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e64b2990-0083-4897-bf66-10b3202eaea6 req-2df1a14d-d4b2-43f9-a796-b9cb64e76cdc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:59.274720 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e64b2990-0083-4897-bf66-10b3202eaea6 req-2df1a14d-d4b2-43f9-a796-b9cb64e76cdc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0529222 Dec 24 05:12:59.325579 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e64b2990-0083-4897-bf66-10b3202eaea6 req-5f4b8d2c-18ba-439b-8fbe-ad4e68a1d4fa tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450375 Dec 24 05:12:59.354030 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2da683ce-29b9-4227-98e4-df2e08d41aa9 req-2459c3fe-520e-4208-905b-5dd05ae7ba7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:59.355611 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2da683ce-29b9-4227-98e4-df2e08d41aa9 req-2459c3fe-520e-4208-905b-5dd05ae7ba7f service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=fc4cefad8fef403e90ad695e2098ee7b&device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 1099 time: 0.0440648 Dec 24 05:12:59.449377 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2da683ce-29b9-4227-98e4-df2e08d41aa9 req-53c956cf-6c63-400c-a06e-1642fe8f1659 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:59.450759 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2da683ce-29b9-4227-98e4-df2e08d41aa9 req-53c956cf-6c63-400c-a06e-1642fe8f1659 service neutron] 10.222.0.46 "GET /v2.0/networks?id=075b69cb-c546-4fa5-aa29-49a5b85c94b1 HTTP/1.1" status: 200 len: 912 time: 0.0878041 Dec 24 05:12:59.517584 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2da683ce-29b9-4227-98e4-df2e08d41aa9 req-2464828e-2432-44dc-b78b-d0c140409546 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b3526449-31e3-4b8f-a3a1-329333c58c47 HTTP/1.1" status: 200 len: 1002 time: 0.0595744 Dec 24 05:12:59.574247 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2da683ce-29b9-4227-98e4-df2e08d41aa9 req-125c58ed-9fbd-41bd-b58c-b68a59a95dee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:59.575782 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2da683ce-29b9-4227-98e4-df2e08d41aa9 req-125c58ed-9fbd-41bd-b58c-b68a59a95dee service neutron] 10.222.0.46 "GET /v2.0/subnets?id=314909f7-3ba5-49d4-a94f-2ebca4c9a707 HTTP/1.1" status: 200 len: 850 time: 0.0499394 Dec 24 05:12:59.628045 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2da683ce-29b9-4227-98e4-df2e08d41aa9 req-a135a4e4-0998-4f0d-a232-31f37b17d4b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:12:59.629569 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2da683ce-29b9-4227-98e4-df2e08d41aa9 req-a135a4e4-0998-4f0d-a232-31f37b17d4b3 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=075b69cb-c546-4fa5-aa29-49a5b85c94b1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0465882 Dec 24 05:12:59.719346 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2da683ce-29b9-4227-98e4-df2e08d41aa9 req-dda2d813-047a-4d5d-8965-69a20c63bc62 service neutron] 10.222.0.46 "GET /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0817969 Dec 24 05:12:59.812547 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2da683ce-29b9-4227-98e4-df2e08d41aa9 req-52cf2d3f-476a-47af-bf72-e40bdec3c871 service neutron] 10.222.0.46 "GET /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0851505 Dec 24 05:13:00.449180 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-567d5ee0-30a0-4e40-a7f4-a5d5f3c943ee req-fe6b0d35-3197-4782-8a08-9e0d82a45d55 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:13:00.450796 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-567d5ee0-30a0-4e40-a7f4-a5d5f3c943ee req-fe6b0d35-3197-4782-8a08-9e0d82a45d55 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0534072 Dec 24 05:13:00.502702 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-567d5ee0-30a0-4e40-a7f4-a5d5f3c943ee req-3cbca286-7f10-419a-bed6-ee5882f3e27c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441024 Dec 24 05:13:01.450118 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:13:01.639040 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23253528-0f70-4e0c-8318-69c4ad955a83 req-20568a31-e107-4163-a1ae-2e633963acb7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:13:01.640407 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-23253528-0f70-4e0c-8318-69c4ad955a83 req-20568a31-e107-4163-a1ae-2e633963acb7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0550127 Dec 24 05:13:01.689488 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-23253528-0f70-4e0c-8318-69c4ad955a83 req-7b4a61f2-93d6-40d1-8654-d72a9ad47e27 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430357 Dec 24 05:13:20.547470 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:13:23.223900 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-9b097049-5975-4a22-99a2-d62bc1cedbb9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:13:25.290465 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-4c4c8ddc-0ae2-4669-8a09-ada91ae1a9d9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:13:26.533374 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:13:27.977341 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:13:28.595913 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:13:34.016374 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bd126646-eb5e-45cd-aab2-59bd8de0bd5e req-6f011d8a-ef47-4eca-91cd-1d4e41629559 service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0452030 Dec 24 05:13:34.090952 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd126646-eb5e-45cd-aab2-59bd8de0bd5e req-d6ff4879-29bf-4bb8-9bfb-a1cabd50b266 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:13:34.092426 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bd126646-eb5e-45cd-aab2-59bd8de0bd5e req-d6ff4879-29bf-4bb8-9bfb-a1cabd50b266 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=fc4cefad8fef403e90ad695e2098ee7b&device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 1099 time: 0.0426710 Dec 24 05:13:34.202116 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd126646-eb5e-45cd-aab2-59bd8de0bd5e req-08e69ed8-5606-450f-8698-4495f652dc30 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:13:34.203550 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bd126646-eb5e-45cd-aab2-59bd8de0bd5e req-08e69ed8-5606-450f-8698-4495f652dc30 service neutron] 10.222.0.46 "GET /v2.0/networks?id=075b69cb-c546-4fa5-aa29-49a5b85c94b1 HTTP/1.1" status: 200 len: 912 time: 0.0890763 Dec 24 05:13:34.273814 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bd126646-eb5e-45cd-aab2-59bd8de0bd5e req-d22ea3a8-94ca-4e97-b4d2-8f84483e8ed3 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b3526449-31e3-4b8f-a3a1-329333c58c47 HTTP/1.1" status: 200 len: 1002 time: 0.0616815 Dec 24 05:13:34.327691 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd126646-eb5e-45cd-aab2-59bd8de0bd5e req-40975a65-cfde-45b2-b285-f8a35cc26212 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:13:34.329272 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bd126646-eb5e-45cd-aab2-59bd8de0bd5e req-40975a65-cfde-45b2-b285-f8a35cc26212 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=314909f7-3ba5-49d4-a94f-2ebca4c9a707 HTTP/1.1" status: 200 len: 850 time: 0.0448277 Dec 24 05:13:34.377355 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd126646-eb5e-45cd-aab2-59bd8de0bd5e req-b6739fe2-b596-4ad8-9706-20374e8a59c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:13:34.378790 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bd126646-eb5e-45cd-aab2-59bd8de0bd5e req-b6739fe2-b596-4ad8-9706-20374e8a59c1 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=075b69cb-c546-4fa5-aa29-49a5b85c94b1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0402067 Dec 24 05:13:34.480891 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bd126646-eb5e-45cd-aab2-59bd8de0bd5e req-1955d7ff-8893-4055-9ab3-6a1c959016df service neutron] 10.222.0.46 "GET /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0946243 Dec 24 05:13:34.568503 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-bd126646-eb5e-45cd-aab2-59bd8de0bd5e req-24d0ee4a-55fe-435a-a2d0-c7e5c59ad692 service neutron] 10.222.0.46 "GET /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0806959 Dec 24 05:13:38.453414 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:13:50.545316 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:13:53.224671 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-a010a96c-0430-4764-b7ab-243ac0111a30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:13:55.298632 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-71368661-0946-4f31-bd9b-09ea885f8eb9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:13:56.543199 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:13:57.986363 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:13:58.597557 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:13:58.801432 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1926652-b0c2-487f-bc9c-7e979e580612 req-1edd7852-cc87-4b82-8fed-b66e193116ec tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:13:58.802989 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a1926652-b0c2-487f-bc9c-7e979e580612 req-1edd7852-cc87-4b82-8fed-b66e193116ec tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0690200 Dec 24 05:13:58.873194 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a1926652-b0c2-487f-bc9c-7e979e580612 req-88892682-b98d-4165-a090-a333a26684e6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0588408 Dec 24 05:14:00.011050 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60c8336a-bdb8-4c86-b249-00552f2202ff req-e9033ae8-5485-4c88-9b57-0c5aafc72cca tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:00.012562 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-60c8336a-bdb8-4c86-b249-00552f2202ff req-e9033ae8-5485-4c88-9b57-0c5aafc72cca tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0512986 Dec 24 05:14:00.060180 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-60c8336a-bdb8-4c86-b249-00552f2202ff req-d67aec9e-b3e1-484b-90e4-e9665db92a41 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416224 Dec 24 05:14:01.191147 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-570c6db3-3121-4976-b2bf-3226a7b027d3 req-a8b46c64-bf14-4cad-823e-1587639a4970 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:01.192698 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-570c6db3-3121-4976-b2bf-3226a7b027d3 req-a8b46c64-bf14-4cad-823e-1587639a4970 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0515335 Dec 24 05:14:01.250335 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-570c6db3-3121-4976-b2bf-3226a7b027d3 req-9bb9ac97-5b3b-4745-9f61-a8cdc73fa9d5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0511649 Dec 24 05:14:02.384906 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6440e12c-f7c4-4214-abd7-54a12e9148eb req-0f865412-5b1d-4f18-b3ad-5bcf32d861e4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:02.386596 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6440e12c-f7c4-4214-abd7-54a12e9148eb req-0f865412-5b1d-4f18-b3ad-5bcf32d861e4 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0541420 Dec 24 05:14:02.442067 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6440e12c-f7c4-4214-abd7-54a12e9148eb req-0c88453a-61d9-4a6c-b4b8-d758131dc39f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0467541 Dec 24 05:14:03.578282 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60be6957-f94d-4171-95d4-2b14f7fd2bf4 req-91d81686-bdd0-4f40-9e70-2039b21a7de7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:03.579717 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-60be6957-f94d-4171-95d4-2b14f7fd2bf4 req-91d81686-bdd0-4f40-9e70-2039b21a7de7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0542409 Dec 24 05:14:03.629669 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-60be6957-f94d-4171-95d4-2b14f7fd2bf4 req-cb234170-8988-4ba4-9045-a4cf0e77a147 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407927 Dec 24 05:14:04.750453 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c9373ec-294c-4a5a-a6b5-e682e0a9da35 req-e4eef56e-8c8f-4a2f-948e-bdf920095cd6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:04.751927 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3c9373ec-294c-4a5a-a6b5-e682e0a9da35 req-e4eef56e-8c8f-4a2f-948e-bdf920095cd6 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0530043 Dec 24 05:14:04.799172 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3c9373ec-294c-4a5a-a6b5-e682e0a9da35 req-b9805f0a-a910-472e-9cae-201b46ac2efa tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413177 Dec 24 05:14:05.926574 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f505ff4f-35ba-48e4-8621-497e780c69f4 req-741ca79b-6448-47a7-ab58-498d9d09f51f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:05.928037 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f505ff4f-35ba-48e4-8621-497e780c69f4 req-741ca79b-6448-47a7-ab58-498d9d09f51f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0525014 Dec 24 05:14:05.978509 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f505ff4f-35ba-48e4-8621-497e780c69f4 req-747c8c84-668b-4eec-9562-350030902c59 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425267 Dec 24 05:14:07.101477 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-294b9e66-c38c-445e-b2dc-837935ca1482 req-365889a1-5b64-47b0-875f-8a293bfb7e9a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:07.102936 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-294b9e66-c38c-445e-b2dc-837935ca1482 req-365889a1-5b64-47b0-875f-8a293bfb7e9a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0494208 Dec 24 05:14:07.160606 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-294b9e66-c38c-445e-b2dc-837935ca1482 req-60cb8d19-4f7d-4af4-b254-f7ecc858bc7b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0514205 Dec 24 05:14:08.305010 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5ff3259-528d-4665-94a2-f76a6561b3d9 req-2a32d64f-42f1-4cf5-9594-7e848a685629 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:08.306397 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f5ff3259-528d-4665-94a2-f76a6561b3d9 req-2a32d64f-42f1-4cf5-9594-7e848a685629 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0609620 Dec 24 05:14:08.364545 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f5ff3259-528d-4665-94a2-f76a6561b3d9 req-f8e7b4d2-f4b7-4a2e-90ab-09dcb260e44b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0517862 Dec 24 05:14:09.603002 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49a9b680-45c8-43c5-ae10-088c89f7d9c8 req-f57a98ee-48f7-4700-885a-c9fb0119519e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:09.604413 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-49a9b680-45c8-43c5-ae10-088c89f7d9c8 req-f57a98ee-48f7-4700-885a-c9fb0119519e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.1583328 Dec 24 05:14:09.654448 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-49a9b680-45c8-43c5-ae10-088c89f7d9c8 req-34e7c49f-12f0-4b89-b9cc-391644edbf95 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440178 Dec 24 05:14:09.853985 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1693c8b9-aa91-4d1a-bab6-3b8eb58cfba8 req-e2eed5f1-d073-495f-9de5-3cc3c5dca7c1 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:09.856002 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1693c8b9-aa91-4d1a-bab6-3b8eb58cfba8 req-e2eed5f1-d073-495f-9de5-3cc3c5dca7c1 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0517237 Dec 24 05:14:09.905289 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1693c8b9-aa91-4d1a-bab6-3b8eb58cfba8 req-89fbae45-d6b2-407c-8036-603f7f3e927c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432129 Dec 24 05:14:09.915302 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34862) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:14:09.934779 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec6de091-b7f5-4411-a27d-774300d78679 req-de7f3213-c818-4906-a46c-96f40c3ad3fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:09.936356 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ec6de091-b7f5-4411-a27d-774300d78679 req-de7f3213-c818-4906-a46c-96f40c3ad3fb service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=fc4cefad8fef403e90ad695e2098ee7b&device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 1099 time: 0.0420589 Dec 24 05:14:10.029790 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec6de091-b7f5-4411-a27d-774300d78679 req-70c97f38-0295-4a09-96a6-2c5e62fac7c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:10.031369 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ec6de091-b7f5-4411-a27d-774300d78679 req-70c97f38-0295-4a09-96a6-2c5e62fac7c2 service neutron] 10.222.0.46 "GET /v2.0/networks?id=075b69cb-c546-4fa5-aa29-49a5b85c94b1 HTTP/1.1" status: 200 len: 912 time: 0.0867121 Dec 24 05:14:10.077882 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Deleting port 4660a148-071e-4d58-8df4-2ca7ec0af5c9 {{(pid=102477) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:14:10.078179 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:10.103412 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ec6de091-b7f5-4411-a27d-774300d78679 req-9215bcb2-0e9d-4fd9-974c-5b072a154c10 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b3526449-31e3-4b8f-a3a1-329333c58c47 HTTP/1.1" status: 200 len: 1002 time: 0.0631499 Dec 24 05:14:10.152026 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:10.152274 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:10.154130 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec6de091-b7f5-4411-a27d-774300d78679 req-43981016-ee6b-4134-b115-73394baa15bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:10.155648 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ec6de091-b7f5-4411-a27d-774300d78679 req-43981016-ee6b-4134-b115-73394baa15bb service neutron] 10.222.0.46 "GET /v2.0/subnets?id=314909f7-3ba5-49d4-a94f-2ebca4c9a707 HTTP/1.1" status: 200 len: 850 time: 0.0446930 Dec 24 05:14:10.163774 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling delete_port for 4660a148-071e-4d58-8df4-2ca7ec0af5c9 owned by network:floatingip {{(pid=102477) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:14:10.204671 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec6de091-b7f5-4411-a27d-774300d78679 req-22f8cb92-5d64-4cf5-af50-02944ee70905 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:10.206239 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ec6de091-b7f5-4411-a27d-774300d78679 req-22f8cb92-5d64-4cf5-af50-02944ee70905 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=075b69cb-c546-4fa5-aa29-49a5b85c94b1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0430021 Dec 24 05:14:10.303201 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ec6de091-b7f5-4411-a27d-774300d78679 req-8fc37981-78b2-4977-bc02-f9454dc99352 service neutron] 10.222.0.46 "GET /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0900092 Dec 24 05:14:10.321767 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:10.345340 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Pushing event deleted for resources: {'Port': ['ID=4660a148-071e-4d58-8df4-2ca7ec0af5c9,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:14:10.355832 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:10.356285 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:10.356567 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:10.356905 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:10.357326 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:10.357712 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:10.358074 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:10.358494 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:10.359248 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:10.359248 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:10.359464 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:10.359839 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:10.360112 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:10.396329 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ec6de091-b7f5-4411-a27d-774300d78679 req-450e4bbf-50ff-4ec5-863f-668b1299199f service neutron] 10.222.0.46 "GET /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857818 Dec 24 05:14:10.422557 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for floatingip, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:10.422798 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.db.l3_db [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Floating IP 5ce8edab-729c-418c-9bed-ca75bb258c20 disassociated (deleted). External IP: 172.27.1.32, port: 44208746-37c9-4355-a253-acc24e3c178d. Dec 24 05:14:10.638933 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Router 9df11fe3-ba73-4793-a582-0e00f27a374d has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102477) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:14:10.747645 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102477) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:14:10.752513 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for floatingip, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:10.757797 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1fb0cfa-557f-4de9-86ac-f2d0758410cf None None] Sync routers for ids ['9df11fe3-ba73-4793-a582-0e00f27a374d'] in dv-cinder-816443-2-iscsi {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:14:10.778975 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1fb0cfa-557f-4de9-86ac-f2d0758410cf None None] Routers {'9df11fe3-ba73-4793-a582-0e00f27a374d'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:14:10.779729 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-a1fb0cfa-557f-4de9-86ac-f2d0758410cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:13:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['9df11fe3-ba73-4793-a582-0e00f27a374d'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:14:10.782913 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-a76fb601-9bad-4ecb-85f2-cf0dc82461b0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "DELETE /v2.0/floatingips/5ce8edab-729c-418c-9bed-ca75bb258c20 HTTP/1.1" status: 204 len: 168 time: 0.8641806 Dec 24 05:14:10.782913 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9549306d-17cd-474a-afc3-2cbd15168af1', 'tag': '44208746-37c9-4355-a253-acc24e3c178d'}] {{(pid=102477) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:14:10.785138 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d3e3d7a262849d185e72ba84ca6adca9bb1fee52649b04b101352e7e29a99ca8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9787d025-4fa4-4f44-a75b-036eef9abb30" -d '{"events": [{"name": "network-changed", "server_uuid": "9549306d-17cd-474a-afc3-2cbd15168af1", "tag": "44208746-37c9-4355-a253-acc24e3c178d"}]}' {{(pid=102477) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:14:10.886635 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:14:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5be69c5d-5d66-4cdd-8c8c-1d612ad75bc7 x-openstack-request-id: req-5be69c5d-5d66-4cdd-8c8c-1d612ad75bc7 {{(pid=102477) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:14:10.886927 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9549306d-17cd-474a-afc3-2cbd15168af1", "tag": "44208746-37c9-4355-a253-acc24e3c178d", "status": "completed", "code": 200}]} {{(pid=102477) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:14:10.887178 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-5be69c5d-5d66-4cdd-8c8c-1d612ad75bc7 {{(pid=102477) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:14:10.887578 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9549306d-17cd-474a-afc3-2cbd15168af1', 'tag': '44208746-37c9-4355-a253-acc24e3c178d', 'status': 'completed', 'code': 200} Dec 24 05:14:10.893845 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-a1fb0cfa-557f-4de9-86ac-f2d0758410cf None None] Set router 9df11fe3-ba73-4793-a582-0e00f27a374d gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:14:11.015988 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c6d6cc5-376b-49b9-a518-5b34c0352ae2 req-990a9e54-f2e6-4edb-acc7-c38ffd8f1e93 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:11.018480 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0c6d6cc5-376b-49b9-a518-5b34c0352ae2 req-990a9e54-f2e6-4edb-acc7-c38ffd8f1e93 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 946 time: 0.0589678 Dec 24 05:14:11.068819 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-588ac5c6-33e3-4176-b39d-ca9072e11eec req-1a8e4fa2-93ca-4682-b52c-48d22ead18f5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:11.071014 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-588ac5c6-33e3-4176-b39d-ca9072e11eec req-1a8e4fa2-93ca-4682-b52c-48d22ead18f5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0757365 Dec 24 05:14:11.077915 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9787d025-4fa4-4f44-a75b-036eef9abb30 req-4c78c42c-2290-40ac-ab31-625144b4bada service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:11.079473 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9787d025-4fa4-4f44-a75b-036eef9abb30 req-4c78c42c-2290-40ac-ab31-625144b4bada service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=8b1a80c6322a493ba10c69a77168b46f&device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 1099 time: 0.0980484 Dec 24 05:14:11.088379 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0c6d6cc5-376b-49b9-a518-5b34c0352ae2 req-b1c81d75-fbcc-434a-8b59-d103a8236ee2 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0596733 Dec 24 05:14:11.161921 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-a1fb0cfa-557f-4de9-86ac-f2d0758410cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': 'dce0027a-d049-4ae2-9714-ef593a9b7a8f', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'floating_ip_address': '172.27.1.210', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'port_id': '4f943d44-a70c-4b88-9cac-b16783cab1e5', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 580, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'mac_address': 'fa:16:3e:5a:15:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '067b7d98-4174-409c-85af-47a2dbf63a71', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:09:59Z', 'updated_at': '2021-12-24T05:10:01Z', 'revision_number': 1, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '826094e8-3c74-4e96-9507-84128f7209f1', 'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'mac_address': 'fa:16:3e:b3:73:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:21Z', 'updated_at': '2021-12-24T05:06:27Z', 'revision_number': 5, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'subnets': [{'id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:14:11.189341 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-588ac5c6-33e3-4176-b39d-ca9072e11eec req-3ec3f119-3770-4e68-aa50-2551ca1d336e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1087475 Dec 24 05:14:11.189577 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1fb0cfa-557f-4de9-86ac-f2d0758410cf None None] Checking router: 9df11fe3-ba73-4793-a582-0e00f27a374d for host: dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:14:11.198661 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1fb0cfa-557f-4de9-86ac-f2d0758410cf None None] Routers {'9df11fe3-ba73-4793-a582-0e00f27a374d'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:14:11.199266 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-a1fb0cfa-557f-4de9-86ac-f2d0758410cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:13:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['9df11fe3-ba73-4793-a582-0e00f27a374d'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:14:11.208028 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9787d025-4fa4-4f44-a75b-036eef9abb30 req-ff84041c-d02b-4a82-bb06-7c4b31441e50 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:11.210210 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9787d025-4fa4-4f44-a75b-036eef9abb30 req-ff84041c-d02b-4a82-bb06-7c4b31441e50 service neutron] 10.222.0.46 "GET /v2.0/networks?id=df2331c3-0dd0-460e-980f-1e2409baa35e HTTP/1.1" status: 200 len: 911 time: 0.1203392 Dec 24 05:14:11.254535 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9787d025-4fa4-4f44-a75b-036eef9abb30 req-6e52eade-b5d8-4f3c-9928-4de24cf6be75 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=44208746-37c9-4355-a253-acc24e3c178d HTTP/1.1" status: 200 len: 217 time: 0.0336363 Dec 24 05:14:11.303883 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9787d025-4fa4-4f44-a75b-036eef9abb30 req-84d64c2e-fb61-4170-873b-fbbaa8244ba5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:11.304114 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-a1fb0cfa-557f-4de9-86ac-f2d0758410cf None None] Set router 9df11fe3-ba73-4793-a582-0e00f27a374d gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:14:11.305354 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9787d025-4fa4-4f44-a75b-036eef9abb30 req-84d64c2e-fb61-4170-873b-fbbaa8244ba5 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=9df81c69-0712-4247-ad21-3b3a089ce4b5 HTTP/1.1" status: 200 len: 849 time: 0.0428472 Dec 24 05:14:11.356865 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9787d025-4fa4-4f44-a75b-036eef9abb30 req-6ae18aa6-d0fd-41cc-9747-43576ab54e54 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:11.358366 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9787d025-4fa4-4f44-a75b-036eef9abb30 req-6ae18aa6-d0fd-41cc-9747-43576ab54e54 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=df2331c3-0dd0-460e-980f-1e2409baa35e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0441725 Dec 24 05:14:11.452149 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9787d025-4fa4-4f44-a75b-036eef9abb30 req-35b1fb45-8f23-439b-8971-b31326d1bb14 service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837259 Dec 24 05:14:11.527462 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-a1fb0cfa-557f-4de9-86ac-f2d0758410cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': 'dce0027a-d049-4ae2-9714-ef593a9b7a8f', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'floating_ip_address': '172.27.1.210', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'port_id': '4f943d44-a70c-4b88-9cac-b16783cab1e5', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 580, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'mac_address': 'fa:16:3e:5a:15:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '067b7d98-4174-409c-85af-47a2dbf63a71', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:09:59Z', 'updated_at': '2021-12-24T05:10:01Z', 'revision_number': 1, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '826094e8-3c74-4e96-9507-84128f7209f1', 'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'mac_address': 'fa:16:3e:b3:73:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:21Z', 'updated_at': '2021-12-24T05:06:27Z', 'revision_number': 5, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'subnets': [{'id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:14:11.548198 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9787d025-4fa4-4f44-a75b-036eef9abb30 req-458eddc7-eec8-4734-abf5-4ab6a4bd67ef service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0865645 Dec 24 05:14:11.556976 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1fb0cfa-557f-4de9-86ac-f2d0758410cf None None] The sync data for ids ['9df11fe3-ba73-4793-a582-0e00f27a374d'] in dv-cinder-816443-2-iscsi is: [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': 'dce0027a-d049-4ae2-9714-ef593a9b7a8f', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'floating_ip_address': '172.27.1.210', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'port_id': '4f943d44-a70c-4b88-9cac-b16783cab1e5', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 580, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'mac_address': 'fa:16:3e:5a:15:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '067b7d98-4174-409c-85af-47a2dbf63a71', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:09:59Z', 'updated_at': '2021-12-24T05:10:01Z', 'revision_number': 1, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '826094e8-3c74-4e96-9507-84128f7209f1', 'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'mac_address': 'fa:16:3e:b3:73:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:21Z', 'updated_at': '2021-12-24T05:06:27Z', 'revision_number': 5, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'subnets': [{'id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:14:11.799429 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a39dca77-04d9-43a4-8d4e-f9eaa48889af None None] New status for floating IP 5ce8edab-729c-418c-9bed-ca75bb258c20: DOWN {{(pid=102478) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 24 05:14:12.209643 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ebac5a0-f422-4f82-a891-e8f2a01251ed req-ccc66f53-ea5d-468e-8b3a-c6b865813e62 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:12.211147 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4ebac5a0-f422-4f82-a891-e8f2a01251ed req-ccc66f53-ea5d-468e-8b3a-c6b865813e62 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 946 time: 0.0547988 Dec 24 05:14:12.273335 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4ebac5a0-f422-4f82-a891-e8f2a01251ed req-798c6124-f7fe-41f9-95f6-13159b71ae11 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0549710 Dec 24 05:14:12.361830 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09584205-dc17-4add-a095-b7e74006921e req-4203da03-3a1b-4c73-ae66-91667533ebfc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:12.363392 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-09584205-dc17-4add-a095-b7e74006921e req-4203da03-3a1b-4c73-ae66-91667533ebfc tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.1014242 Dec 24 05:14:12.411432 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-09584205-dc17-4add-a095-b7e74006921e req-a7752800-5e7c-4434-8b9c-3eba34277560 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420408 Dec 24 05:14:12.921472 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-116f687f-ddec-4a8e-a229-62ae6807f1a5 req-0a946dd4-4a70-44bd-a6f1-bfc29a573df5 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:12.922899 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-116f687f-ddec-4a8e-a229-62ae6807f1a5 req-0a946dd4-4a70-44bd-a6f1-bfc29a573df5 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.46 "GET /v2.0/ports?device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 946 time: 0.0624888 Dec 24 05:14:13.022636 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-116f687f-ddec-4a8e-a229-62ae6807f1a5 req-27cd970b-4573-40a0-bcf9-7b4a41ad12da tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Deleting port 44208746-37c9-4355-a253-acc24e3c178d {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:14:13.022993 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-116f687f-ddec-4a8e-a229-62ae6807f1a5 req-27cd970b-4573-40a0-bcf9-7b4a41ad12da tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:13.118849 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-116f687f-ddec-4a8e-a229-62ae6807f1a5 req-27cd970b-4573-40a0-bcf9-7b4a41ad12da tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] For port 44208746-37c9-4355-a253-acc24e3c178d, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=44208746-37c9-4355-a253-acc24e3c178d,segment=NetworkSegment(cb920e21-208e-474e-84a0-615ea3280b8a),segment_id=cb920e21-208e-474e-84a0-615ea3280b8a)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:14:13.119219 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-116f687f-ddec-4a8e-a229-62ae6807f1a5 req-27cd970b-4573-40a0-bcf9-7b4a41ad12da tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:13.131942 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-116f687f-ddec-4a8e-a229-62ae6807f1a5 req-27cd970b-4573-40a0-bcf9-7b4a41ad12da tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling delete_port for 44208746-37c9-4355-a253-acc24e3c178d owned by compute:nova {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:14:13.280513 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-116f687f-ddec-4a8e-a229-62ae6807f1a5 req-27cd970b-4573-40a0-bcf9-7b4a41ad12da tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:13.316226 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27cd970b-4573-40a0-bcf9-7b4a41ad12da tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Pushing event deleted for resources: {'Port': ['ID=44208746-37c9-4355-a253-acc24e3c178d,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:14:13.328445 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd970b-4573-40a0-bcf9-7b4a41ad12da tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:13.328828 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd970b-4573-40a0-bcf9-7b4a41ad12da tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:13.329176 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd970b-4573-40a0-bcf9-7b4a41ad12da tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:13.329520 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd970b-4573-40a0-bcf9-7b4a41ad12da tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:13.329855 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd970b-4573-40a0-bcf9-7b4a41ad12da tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:13.330183 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd970b-4573-40a0-bcf9-7b4a41ad12da tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:13.330531 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd970b-4573-40a0-bcf9-7b4a41ad12da tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:13.330839 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd970b-4573-40a0-bcf9-7b4a41ad12da tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:13.331250 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd970b-4573-40a0-bcf9-7b4a41ad12da tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:13.331496 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd970b-4573-40a0-bcf9-7b4a41ad12da tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:13.331843 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd970b-4573-40a0-bcf9-7b4a41ad12da tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:13.332157 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd970b-4573-40a0-bcf9-7b4a41ad12da tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:13.332485 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cd970b-4573-40a0-bcf9-7b4a41ad12da tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:13.367040 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-116f687f-ddec-4a8e-a229-62ae6807f1a5 req-27cd970b-4573-40a0-bcf9-7b4a41ad12da tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] No DVR routers for this DVR port 44208746-37c9-4355-a253-acc24e3c178d on host hv-cinder-81644 {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:14:13.369695 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-116f687f-ddec-4a8e-a229-62ae6807f1a5 req-27cd970b-4573-40a0-bcf9-7b4a41ad12da tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:13.373317 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-116f687f-ddec-4a8e-a229-62ae6807f1a5 req-27cd970b-4573-40a0-bcf9-7b4a41ad12da tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.46 "DELETE /v2.0/ports/44208746-37c9-4355-a253-acc24e3c178d HTTP/1.1" status: 204 len: 173 time: 0.4439046 Dec 24 05:14:13.373793 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9549306d-17cd-474a-afc3-2cbd15168af1', 'name': 'network-vif-deleted', 'tag': '44208746-37c9-4355-a253-acc24e3c178d'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:14:13.376090 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-10933861-e9cb-454f-b704-506e91a5575b" -d '{"events": [{"server_uuid": "9549306d-17cd-474a-afc3-2cbd15168af1", "name": "network-vif-deleted", "tag": "44208746-37c9-4355-a253-acc24e3c178d"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:14:13.418600 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:14:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-03e4865d-5eb3-4e91-a556-b65c66993afe x-openstack-request-id: req-03e4865d-5eb3-4e91-a556-b65c66993afe {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:14:13.418967 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9549306d-17cd-474a-afc3-2cbd15168af1", "name": "network-vif-deleted", "tag": "44208746-37c9-4355-a253-acc24e3c178d", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:14:13.419253 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-03e4865d-5eb3-4e91-a556-b65c66993afe {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:14:13.419707 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9549306d-17cd-474a-afc3-2cbd15168af1', 'name': 'network-vif-deleted', 'tag': '44208746-37c9-4355-a253-acc24e3c178d', 'status': 'completed', 'code': 200} Dec 24 05:14:13.604223 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1ff5fae7-ca52-45e3-8213-c0e8f33eef05 req-11710b7e-06f7-4bc8-836e-9148b63d63f0 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=9549306d-17cd-474a-afc3-2cbd15168af1 HTTP/1.1" status: 200 len: 210 time: 0.2584882 Dec 24 05:14:15.456991 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:14:16.141702 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 44208746-37c9-4355-a253-acc24e3c178d no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:14:16.172484 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] No Port match for: 44208746-37c9-4355-a253-acc24e3c178d {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:14:16.172869 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 44208746-37c9-4355-a253-acc24e3c178d not bound to the agent host hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:14:16.921409 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34910) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:14:17.086578 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-7bd6ef65-ccd4-463f-a53e-191f576b2e6f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Deleting port d0c465d3-97ea-4b50-b6a9-56d33f3c4791 {{(pid=102477) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:14:17.086868 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7bd6ef65-ccd4-463f-a53e-191f576b2e6f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:17.163667 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7bd6ef65-ccd4-463f-a53e-191f576b2e6f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:17.163912 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7bd6ef65-ccd4-463f-a53e-191f576b2e6f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:17.175453 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-7bd6ef65-ccd4-463f-a53e-191f576b2e6f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling delete_port for d0c465d3-97ea-4b50-b6a9-56d33f3c4791 owned by network:floatingip {{(pid=102477) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:14:17.326193 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7bd6ef65-ccd4-463f-a53e-191f576b2e6f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:17.360060 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bd6ef65-ccd4-463f-a53e-191f576b2e6f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Pushing event deleted for resources: {'Port': ['ID=d0c465d3-97ea-4b50-b6a9-56d33f3c4791,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:14:17.418963 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7bd6ef65-ccd4-463f-a53e-191f576b2e6f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for floatingip, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:17.419192 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.db.l3_db [None req-7bd6ef65-ccd4-463f-a53e-191f576b2e6f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Floating IP dce0027a-d049-4ae2-9714-ef593a9b7a8f disassociated (deleted). External IP: 172.27.1.210, port: 4f943d44-a70c-4b88-9cac-b16783cab1e5. Dec 24 05:14:17.657035 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7bd6ef65-ccd4-463f-a53e-191f576b2e6f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Router 9df11fe3-ba73-4793-a582-0e00f27a374d has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102477) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:14:17.764149 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7bd6ef65-ccd4-463f-a53e-191f576b2e6f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102477) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:14:17.768987 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7bd6ef65-ccd4-463f-a53e-191f576b2e6f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for floatingip, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:17.774898 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-076374f1-064c-44ba-b7e0-1da50d04a4c6 None None] Sync routers for ids ['9df11fe3-ba73-4793-a582-0e00f27a374d'] in dv-cinder-816443-2-iscsi {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:14:17.784479 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-076374f1-064c-44ba-b7e0-1da50d04a4c6 None None] Routers {'9df11fe3-ba73-4793-a582-0e00f27a374d'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:14:17.785099 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-076374f1-064c-44ba-b7e0-1da50d04a4c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:13:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['9df11fe3-ba73-4793-a582-0e00f27a374d'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:14:17.797658 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-7bd6ef65-ccd4-463f-a53e-191f576b2e6f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "DELETE /v2.0/floatingips/dce0027a-d049-4ae2-9714-ef593a9b7a8f HTTP/1.1" status: 204 len: 168 time: 0.8751347 Dec 24 05:14:17.798361 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '067b7d98-4174-409c-85af-47a2dbf63a71', 'tag': '4f943d44-a70c-4b88-9cac-b16783cab1e5'}] {{(pid=102477) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:14:17.800867 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d3e3d7a262849d185e72ba84ca6adca9bb1fee52649b04b101352e7e29a99ca8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4955443c-412f-4476-9fd4-ae15cee2cfc8" -d '{"events": [{"name": "network-changed", "server_uuid": "067b7d98-4174-409c-85af-47a2dbf63a71", "tag": "4f943d44-a70c-4b88-9cac-b16783cab1e5"}]}' {{(pid=102477) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:14:17.837718 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:14:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-03edb431-f875-489c-b9f8-70da308fd707 x-openstack-request-id: req-03edb431-f875-489c-b9f8-70da308fd707 {{(pid=102477) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:14:17.838011 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "067b7d98-4174-409c-85af-47a2dbf63a71", "tag": "4f943d44-a70c-4b88-9cac-b16783cab1e5", "status": "completed", "code": 200}]} {{(pid=102477) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:14:17.838264 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-03edb431-f875-489c-b9f8-70da308fd707 {{(pid=102477) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:14:17.838672 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '067b7d98-4174-409c-85af-47a2dbf63a71', 'tag': '4f943d44-a70c-4b88-9cac-b16783cab1e5', 'status': 'completed', 'code': 200} Dec 24 05:14:17.898936 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-076374f1-064c-44ba-b7e0-1da50d04a4c6 None None] Set router 9df11fe3-ba73-4793-a582-0e00f27a374d gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:14:17.925929 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4955443c-412f-4476-9fd4-ae15cee2cfc8 req-c3892ed6-af56-4d12-8f20-de4c05039b4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:17.927455 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4955443c-412f-4476-9fd4-ae15cee2cfc8 req-c3892ed6-af56-4d12-8f20-de4c05039b4f service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=8b1a80c6322a493ba10c69a77168b46f&device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 1099 time: 0.0418856 Dec 24 05:14:18.090768 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17049ba7-55a7-4aeb-82d1-da91750db0e4 req-085aac72-1c6c-44fa-95ef-a27e043dfb13 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:18.092367 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-17049ba7-55a7-4aeb-82d1-da91750db0e4 req-085aac72-1c6c-44fa-95ef-a27e043dfb13 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 946 time: 0.1065061 Dec 24 05:14:18.100492 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-076374f1-064c-44ba-b7e0-1da50d04a4c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '826094e8-3c74-4e96-9507-84128f7209f1', 'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'mac_address': 'fa:16:3e:b3:73:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:21Z', 'updated_at': '2021-12-24T05:06:27Z', 'revision_number': 5, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'subnets': [{'id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:14:18.121345 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4955443c-412f-4476-9fd4-ae15cee2cfc8 req-78e54ea5-cc55-4060-943f-446c67735e6e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:18.123168 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4955443c-412f-4476-9fd4-ae15cee2cfc8 req-78e54ea5-cc55-4060-943f-446c67735e6e service neutron] 10.222.0.46 "GET /v2.0/networks?id=df2331c3-0dd0-460e-980f-1e2409baa35e HTTP/1.1" status: 200 len: 911 time: 0.1458883 Dec 24 05:14:18.131425 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-076374f1-064c-44ba-b7e0-1da50d04a4c6 None None] Checking router: 9df11fe3-ba73-4793-a582-0e00f27a374d for host: dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:14:18.139986 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-076374f1-064c-44ba-b7e0-1da50d04a4c6 None None] Routers {'9df11fe3-ba73-4793-a582-0e00f27a374d'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:14:18.140597 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-076374f1-064c-44ba-b7e0-1da50d04a4c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:13:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['9df11fe3-ba73-4793-a582-0e00f27a374d'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:14:18.180156 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4955443c-412f-4476-9fd4-ae15cee2cfc8 req-e86d727f-6899-4583-8f45-43114d942a55 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=4f943d44-a70c-4b88-9cac-b16783cab1e5 HTTP/1.1" status: 200 len: 217 time: 0.0439808 Dec 24 05:14:18.189332 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-17049ba7-55a7-4aeb-82d1-da91750db0e4 req-c74c46a7-d81c-44b6-8d9f-3eaccd0ac592 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0899584 Dec 24 05:14:18.233916 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4955443c-412f-4476-9fd4-ae15cee2cfc8 req-9e693f75-4b2b-42fa-926d-95f8f8e78cd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:18.235413 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4955443c-412f-4476-9fd4-ae15cee2cfc8 req-9e693f75-4b2b-42fa-926d-95f8f8e78cd3 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=9df81c69-0712-4247-ad21-3b3a089ce4b5 HTTP/1.1" status: 200 len: 849 time: 0.0452271 Dec 24 05:14:18.244567 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-076374f1-064c-44ba-b7e0-1da50d04a4c6 None None] Set router 9df11fe3-ba73-4793-a582-0e00f27a374d gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:14:18.285168 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4955443c-412f-4476-9fd4-ae15cee2cfc8 req-1d8d4453-d6c5-496e-9a13-2fff90b74058 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:18.286685 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4955443c-412f-4476-9fd4-ae15cee2cfc8 req-1d8d4453-d6c5-496e-9a13-2fff90b74058 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=df2331c3-0dd0-460e-980f-1e2409baa35e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0422111 Dec 24 05:14:18.386730 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4955443c-412f-4476-9fd4-ae15cee2cfc8 req-270403d0-dcf8-47e1-9d39-563bd5dca51c service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0916626 Dec 24 05:14:18.477508 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4955443c-412f-4476-9fd4-ae15cee2cfc8 req-ca7ad84f-e6e8-4a1f-8013-0dc76394b88d service neutron] 10.222.0.46 "GET /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817454 Dec 24 05:14:18.536966 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-076374f1-064c-44ba-b7e0-1da50d04a4c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '826094e8-3c74-4e96-9507-84128f7209f1', 'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'mac_address': 'fa:16:3e:b3:73:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:21Z', 'updated_at': '2021-12-24T05:06:27Z', 'revision_number': 5, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'subnets': [{'id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:14:18.565988 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-076374f1-064c-44ba-b7e0-1da50d04a4c6 None None] The sync data for ids ['9df11fe3-ba73-4793-a582-0e00f27a374d'] in dv-cinder-816443-2-iscsi is: [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:22Z', 'revision_number': 4, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '826094e8-3c74-4e96-9507-84128f7209f1', 'name': '', 'network_id': 'df2331c3-0dd0-460e-980f-1e2409baa35e', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'mac_address': 'fa:16:3e:b3:73:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:21Z', 'updated_at': '2021-12-24T05:06:27Z', 'revision_number': 5, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'subnets': [{'id': '9df81c69-0712-4247-ad21-3b3a089ce4b5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:14:18.782000 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-934acb65-50c5-47be-984c-923c631baf90 None None] New status for floating IP dce0027a-d049-4ae2-9714-ef593a9b7a8f: DOWN {{(pid=102478) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 24 05:14:19.319400 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae973b39-5864-40d8-adb8-cae60932e8f3 req-f3ccbb8e-cac5-4c94-b404-2b6e3518cfe7 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:19.320943 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ae973b39-5864-40d8-adb8-cae60932e8f3 req-f3ccbb8e-cac5-4c94-b404-2b6e3518cfe7 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 946 time: 0.0496359 Dec 24 05:14:19.377212 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ae973b39-5864-40d8-adb8-cae60932e8f3 req-96f85003-1589-4e16-b320-6432b5fb6a3d tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/security-groups?id=b4b0be72-ffa9-4e18-8986-808181a3a50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0499218 Dec 24 05:14:19.791126 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83788575-1799-42d7-98a5-4ebef89472d4 req-345dd20c-2387-45aa-944e-0cd82f54706f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:14:19.792556 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-83788575-1799-42d7-98a5-4ebef89472d4 req-345dd20c-2387-45aa-944e-0cd82f54706f tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.46 "GET /v2.0/ports?device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 946 time: 0.0620246 Dec 24 05:14:19.893088 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-83788575-1799-42d7-98a5-4ebef89472d4 req-239bc6b2-8feb-4d1e-b44a-8a51f96fec19 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Deleting port 4f943d44-a70c-4b88-9cac-b16783cab1e5 {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:14:19.893406 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-83788575-1799-42d7-98a5-4ebef89472d4 req-239bc6b2-8feb-4d1e-b44a-8a51f96fec19 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:19.995288 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-83788575-1799-42d7-98a5-4ebef89472d4 req-239bc6b2-8feb-4d1e-b44a-8a51f96fec19 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] For port 4f943d44-a70c-4b88-9cac-b16783cab1e5, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=4f943d44-a70c-4b88-9cac-b16783cab1e5,segment=NetworkSegment(cb920e21-208e-474e-84a0-615ea3280b8a),segment_id=cb920e21-208e-474e-84a0-615ea3280b8a)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:14:19.995642 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-83788575-1799-42d7-98a5-4ebef89472d4 req-239bc6b2-8feb-4d1e-b44a-8a51f96fec19 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:20.009496 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-83788575-1799-42d7-98a5-4ebef89472d4 req-239bc6b2-8feb-4d1e-b44a-8a51f96fec19 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling delete_port for 4f943d44-a70c-4b88-9cac-b16783cab1e5 owned by compute:nova {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:14:20.151506 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-83788575-1799-42d7-98a5-4ebef89472d4 req-239bc6b2-8feb-4d1e-b44a-8a51f96fec19 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:20.193852 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-239bc6b2-8feb-4d1e-b44a-8a51f96fec19 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Pushing event deleted for resources: {'Port': ['ID=4f943d44-a70c-4b88-9cac-b16783cab1e5,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:14:20.239036 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-83788575-1799-42d7-98a5-4ebef89472d4 req-239bc6b2-8feb-4d1e-b44a-8a51f96fec19 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] No DVR routers for this DVR port 4f943d44-a70c-4b88-9cac-b16783cab1e5 on host hv-cinder-81644 {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:14:20.241642 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-83788575-1799-42d7-98a5-4ebef89472d4 req-239bc6b2-8feb-4d1e-b44a-8a51f96fec19 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:20.245011 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-83788575-1799-42d7-98a5-4ebef89472d4 req-239bc6b2-8feb-4d1e-b44a-8a51f96fec19 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.46 "DELETE /v2.0/ports/4f943d44-a70c-4b88-9cac-b16783cab1e5 HTTP/1.1" status: 204 len: 173 time: 0.4461391 Dec 24 05:14:20.245467 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '067b7d98-4174-409c-85af-47a2dbf63a71', 'name': 'network-vif-deleted', 'tag': '4f943d44-a70c-4b88-9cac-b16783cab1e5'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:14:20.248276 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9b74e44a-385e-4482-852a-e3e58bedad20" -d '{"events": [{"server_uuid": "067b7d98-4174-409c-85af-47a2dbf63a71", "name": "network-vif-deleted", "tag": "4f943d44-a70c-4b88-9cac-b16783cab1e5"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:14:20.287261 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:14:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8e51f98a-7aab-4a34-9c3a-d77961d3fdbe x-openstack-request-id: req-8e51f98a-7aab-4a34-9c3a-d77961d3fdbe {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:14:20.287605 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "067b7d98-4174-409c-85af-47a2dbf63a71", "name": "network-vif-deleted", "tag": "4f943d44-a70c-4b88-9cac-b16783cab1e5", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:14:20.288282 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-8e51f98a-7aab-4a34-9c3a-d77961d3fdbe {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:14:20.288282 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '067b7d98-4174-409c-85af-47a2dbf63a71', 'name': 'network-vif-deleted', 'tag': '4f943d44-a70c-4b88-9cac-b16783cab1e5', 'status': 'completed', 'code': 200} Dec 24 05:14:20.476552 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-076c5340-dc94-42a3-b6c3-1f921b8aa2d2 req-1be8f115-31d5-46a1-ba2d-cbf6990e1ac4 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "GET /v2.0/ports?device_id=067b7d98-4174-409c-85af-47a2dbf63a71 HTTP/1.1" status: 200 len: 210 time: 0.0302067 Dec 24 05:14:20.527621 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:21.538240 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34926) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:14:21.665782 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-bdabd4d2-5903-4953-93a2-81a0145ac968 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Deleting port baf7ca44-439e-4b17-91b8-d3a9fe7a64b1 {{(pid=102477) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:14:21.666005 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-bdabd4d2-5903-4953-93a2-81a0145ac968 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:21.750355 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-bdabd4d2-5903-4953-93a2-81a0145ac968 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:21.750643 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-bdabd4d2-5903-4953-93a2-81a0145ac968 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:21.762922 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-bdabd4d2-5903-4953-93a2-81a0145ac968 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Calling delete_port for baf7ca44-439e-4b17-91b8-d3a9fe7a64b1 owned by network:floatingip {{(pid=102477) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:14:21.905924 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-bdabd4d2-5903-4953-93a2-81a0145ac968 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:21.930604 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdabd4d2-5903-4953-93a2-81a0145ac968 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Pushing event deleted for resources: {'Port': ['ID=baf7ca44-439e-4b17-91b8-d3a9fe7a64b1,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:14:21.995086 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-bdabd4d2-5903-4953-93a2-81a0145ac968 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for floatingip, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:21.997882 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-bdabd4d2-5903-4953-93a2-81a0145ac968 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for floatingip, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:21.999026 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-bdabd4d2-5903-4953-93a2-81a0145ac968 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "DELETE /v2.0/floatingips/6fbeb9ef-353a-4f33-9ebc-492b12a0ebd9 HTTP/1.1" status: 204 len: 168 time: 0.4597874 Dec 24 05:14:22.136972 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 4f943d44-a70c-4b88-9cac-b16783cab1e5 no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:14:22.158113 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] No Port match for: 4f943d44-a70c-4b88-9cac-b16783cab1e5 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:14:22.158467 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 4f943d44-a70c-4b88-9cac-b16783cab1e5 not bound to the agent host hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:14:23.222712 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34938) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:14:23.225274 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-d15c50ac-4673-420b-9d7d-ea81891024ea None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:23.278396 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c4b40439-a44e-4949-8a2c-71380f02cf94 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:23.304338 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c4b40439-a44e-4949-8a2c-71380f02cf94 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:23.365059 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c4b40439-a44e-4949-8a2c-71380f02cf94 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:23.367752 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c4b40439-a44e-4949-8a2c-71380f02cf94 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:23.368932 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-c4b40439-a44e-4949-8a2c-71380f02cf94 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] 10.222.0.43 "DELETE /v2.0/security-groups/b4b0be72-ffa9-4e18-8986-808181a3a50d HTTP/1.1" status: 204 len: 168 time: 0.1452198 Dec 24 05:14:23.377963 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4b40439-a44e-4949-8a2c-71380f02cf94 tempest-TestVolumeBootPattern-1007278304 tempest-TestVolumeBootPattern-1007278304-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b4b0be72-ffa9-4e18-8986-808181a3a50d,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:14:23.423865 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34942) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:14:24.137027 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1e4b3d1f-9893-465c-9f77-325eadee6b06 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-548364'] for router_interface, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:24.395191 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-1e4b3d1f-9893-465c-9f77-325eadee6b06 admin admin] Deleting port 826094e8-3c74-4e96-9507-84128f7209f1 {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:14:24.395540 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1e4b3d1f-9893-465c-9f77-325eadee6b06 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:24.482475 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [None req-1e4b3d1f-9893-465c-9f77-325eadee6b06 admin admin] For port 826094e8-3c74-4e96-9507-84128f7209f1, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=826094e8-3c74-4e96-9507-84128f7209f1,segment=NetworkSegment(cb920e21-208e-474e-84a0-615ea3280b8a),segment_id=cb920e21-208e-474e-84a0-615ea3280b8a)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:14:24.483180 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1e4b3d1f-9893-465c-9f77-325eadee6b06 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:24.495790 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-1e4b3d1f-9893-465c-9f77-325eadee6b06 admin admin] Calling delete_port for 826094e8-3c74-4e96-9507-84128f7209f1 owned by network:router_interface {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:14:24.691678 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1e4b3d1f-9893-465c-9f77-325eadee6b06 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:24.716613 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e4b3d1f-9893-465c-9f77-325eadee6b06 admin admin] Pushing event deleted for resources: {'Port': ['ID=826094e8-3c74-4e96-9507-84128f7209f1,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:14:24.887552 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1e4b3d1f-9893-465c-9f77-325eadee6b06 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-627465', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-548448'] for router_interface, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:25.104125 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1e4b3d1f-9893-465c-9f77-325eadee6b06 admin admin] Router 9df11fe3-ba73-4793-a582-0e00f27a374d has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102476) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:14:25.215297 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1e4b3d1f-9893-465c-9f77-325eadee6b06 admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:14:25.221202 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-1e4b3d1f-9893-465c-9f77-325eadee6b06 admin admin] 10.222.0.43 "PUT /v2.0/routers/9df11fe3-ba73-4793-a582-0e00f27a374d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7962146 Dec 24 05:14:25.225001 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34946) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:14:25.227853 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05bd9041-5196-4a75-8f85-968c3481571a None None] Sync routers for ids ['9df11fe3-ba73-4793-a582-0e00f27a374d'] in dv-cinder-816443-2-iscsi {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:14:25.239343 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05bd9041-5196-4a75-8f85-968c3481571a None None] Routers {'9df11fe3-ba73-4793-a582-0e00f27a374d'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:14:25.239881 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-05bd9041-5196-4a75-8f85-968c3481571a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:13:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['9df11fe3-ba73-4793-a582-0e00f27a374d'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:14:25.292848 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-51b6d6cd-a955-4cf0-a324-86bf559fb533 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:25.332778 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-46473a2c-aa54-46a9-836a-d6a7bcaab631 admin admin] Publish callbacks [] for router, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:25.344535 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-05bd9041-5196-4a75-8f85-968c3481571a None None] Set router 9df11fe3-ba73-4793-a582-0e00f27a374d gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:14:25.438571 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-46473a2c-aa54-46a9-836a-d6a7bcaab631 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:25.501619 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-46473a2c-aa54-46a9-836a-d6a7bcaab631 admin admin] Deleting port cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5 {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:14:25.502324 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-46473a2c-aa54-46a9-836a-d6a7bcaab631 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:25.527090 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-05bd9041-5196-4a75-8f85-968c3481571a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26'}], 'enable_snat': True}, 'gw_port_id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:14:24Z', 'revision_number': 5, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port': {'id': 'cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:a5:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 532, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:06:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:14:25.553884 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05bd9041-5196-4a75-8f85-968c3481571a None None] Checking router: 9df11fe3-ba73-4793-a582-0e00f27a374d for host: dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:14:25.562756 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05bd9041-5196-4a75-8f85-968c3481571a None None] Routers {'9df11fe3-ba73-4793-a582-0e00f27a374d'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:14:25.563376 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-05bd9041-5196-4a75-8f85-968c3481571a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:14:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['9df11fe3-ba73-4793-a582-0e00f27a374d'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:14:25.586148 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [None req-46473a2c-aa54-46a9-836a-d6a7bcaab631 admin admin] For port cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:14:25.586544 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-46473a2c-aa54-46a9-836a-d6a7bcaab631 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:25.598638 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-46473a2c-aa54-46a9-836a-d6a7bcaab631 admin admin] Calling delete_port for cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5 owned by network:router_gateway {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:14:25.648014 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-05bd9041-5196-4a75-8f85-968c3481571a None None] Set router 9df11fe3-ba73-4793-a582-0e00f27a374d gateway port host: None {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:14:25.700980 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-05bd9041-5196-4a75-8f85-968c3481571a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:14:25Z', 'revision_number': 6, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port_host': None}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:14:25.727649 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05bd9041-5196-4a75-8f85-968c3481571a None None] The sync data for ids ['9df11fe3-ba73-4793-a582-0e00f27a374d'] in dv-cinder-816443-2-iscsi is: [{'id': '9df11fe3-ba73-4793-a582-0e00f27a374d', 'name': 'tempest-TestVolumeBootPattern-65459633-router', 'tenant_id': '8b1a80c6322a493ba10c69a77168b46f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:19Z', 'updated_at': '2021-12-24T05:14:25Z', 'revision_number': 6, 'project_id': '8b1a80c6322a493ba10c69a77168b46f', 'gw_port_host': None}] {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:14:25.771894 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-46473a2c-aa54-46a9-836a-d6a7bcaab631 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:25.795582 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46473a2c-aa54-46a9-836a-d6a7bcaab631 admin admin] Pushing event deleted for resources: {'Port': ['ID=cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:14:25.858687 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-46473a2c-aa54-46a9-836a-d6a7bcaab631 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-545986'] for router_gateway, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:25.957765 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-46473a2c-aa54-46a9-836a-d6a7bcaab631 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-546088', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2070312'] for router, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:25.960348 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-46473a2c-aa54-46a9-836a-d6a7bcaab631 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:26.011588 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-46473a2c-aa54-46a9-836a-d6a7bcaab631 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-546081'] for router, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:26.012699 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-46473a2c-aa54-46a9-836a-d6a7bcaab631 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 9df11fe3-ba73-4793-a582-0e00f27a374d {{(pid=102476) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 24 05:14:26.018388 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-46473a2c-aa54-46a9-836a-d6a7bcaab631 admin admin] Publish callbacks [] for router, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:26.020152 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-46473a2c-aa54-46a9-836a-d6a7bcaab631 admin admin] 10.222.0.43 "DELETE /v2.0/routers/9df11fe3-ba73-4793-a582-0e00f27a374d HTTP/1.1" status: 204 len: 168 time: 0.7939901 Dec 24 05:14:26.024093 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34948) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:14:26.067805 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.db_base_plugin_v2 [None req-c212849b-ba79-4ebb-b203-d29715cfaabf admin admin] Deleting subnet 9df81c69-0712-4247-ad21-3b3a089ce4b5 {{(pid=102477) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Dec 24 05:14:26.070926 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c212849b-ba79-4ebb-b203-d29715cfaabf admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:26.109934 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c212849b-ba79-4ebb-b203-d29715cfaabf admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-29535554'] for subnet, precommit_delete_associations {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:26.204151 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c212849b-ba79-4ebb-b203-d29715cfaabf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3590439'] for subnet, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:26.260242 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c212849b-ba79-4ebb-b203-d29715cfaabf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3590440', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-29535541', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-29853072'] for subnet, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:26.287376 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c212849b-ba79-4ebb-b203-d29715cfaabf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:26.290534 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-c212849b-ba79-4ebb-b203-d29715cfaabf admin admin] 10.222.0.43 "DELETE /v2.0/subnets/9df81c69-0712-4247-ad21-3b3a089ce4b5 HTTP/1.1" status: 204 len: 168 time: 0.2654362 Dec 24 05:14:26.291511 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c212849b-ba79-4ebb-b203-d29715cfaabf admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9df81c69-0712-4247-ad21-3b3a089ce4b5,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:14:26.293160 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34950) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:14:26.294990 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f10f3f5c-aeb6-4954-aba2-ac62e03123ec None None] Network df2331c3-0dd0-460e-980f-1e2409baa35e requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:14:26.361890 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3a1c3ec7-34cb-408d-b7f0-bb43873a3b65 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3741433'] for network, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:26.427108 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-3a1c3ec7-34cb-408d-b7f0-bb43873a3b65 admin admin] Deleting port cdcaf45c-ae0e-4d57-8f82-9506240faf0a {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:14:26.427452 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3a1c3ec7-34cb-408d-b7f0-bb43873a3b65 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:26.506006 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [None req-3a1c3ec7-34cb-408d-b7f0-bb43873a3b65 admin admin] For port cdcaf45c-ae0e-4d57-8f82-9506240faf0a, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=cdcaf45c-ae0e-4d57-8f82-9506240faf0a,segment=NetworkSegment(cb920e21-208e-474e-84a0-615ea3280b8a),segment_id=cb920e21-208e-474e-84a0-615ea3280b8a)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:14:26.506744 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3a1c3ec7-34cb-408d-b7f0-bb43873a3b65 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:26.522202 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-3a1c3ec7-34cb-408d-b7f0-bb43873a3b65 admin admin] Calling delete_port for cdcaf45c-ae0e-4d57-8f82-9506240faf0a owned by network:dhcp {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:14:26.527713 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-867983b5-7687-4ecc-92af-839911f665f2 None None] DHCP port deletion for df2331c3-0dd0-460e-980f-1e2409baa35e request from dv-cinder-816443-2-iscsi {{(pid=102478) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 24 05:14:26.542176 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 826094e8-3c74-4e96-9507-84128f7209f1 no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:14:26.568792 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: 826094e8-3c74-4e96-9507-84128f7209f1 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:14:26.569091 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 826094e8-3c74-4e96-9507-84128f7209f1 not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:14:26.571164 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:26.610995 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3a1c3ec7-34cb-408d-b7f0-bb43873a3b65 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:26.613067 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-867983b5-7687-4ecc-92af-839911f665f2 None None] Deleting port cdcaf45c-ae0e-4d57-8f82-9506240faf0a {{(pid=102478) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:14:26.613736 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-867983b5-7687-4ecc-92af-839911f665f2 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:26.638674 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a1c3ec7-34cb-408d-b7f0-bb43873a3b65 admin admin] Pushing event deleted for resources: {'Port': ['ID=cdcaf45c-ae0e-4d57-8f82-9506240faf0a,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:14:26.640852 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a1c3ec7-34cb-408d-b7f0-bb43873a3b65 admin admin] No DVR routers for this DVR port cdcaf45c-ae0e-4d57-8f82-9506240faf0a on host dv-cinder-816443-2-iscsi {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:14:26.677804 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-867983b5-7687-4ecc-92af-839911f665f2 None None] For port cdcaf45c-ae0e-4d57-8f82-9506240faf0a, host dv-cinder-816443-2-iscsi, got binding levels [] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:14:26.678200 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-867983b5-7687-4ecc-92af-839911f665f2 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:26.691253 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-867983b5-7687-4ecc-92af-839911f665f2 None None] Calling delete_port for cdcaf45c-ae0e-4d57-8f82-9506240faf0a owned by network:dhcp {{(pid=102478) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:14:26.695301 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.ipam_backend_mixin [None req-867983b5-7687-4ecc-92af-839911f665f2 None None] Port cdcaf45c-ae0e-4d57-8f82-9506240faf0a was not found and therefore no delete operation was performed {{(pid=102478) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 24 05:14:26.696545 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-867983b5-7687-4ecc-92af-839911f665f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010'] for port, after_delete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:26.711160 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3a1c3ec7-34cb-408d-b7f0-bb43873a3b65 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3595960', 'neutron.services.segments.db._delete_segments_for_network-8750577966942'] for network, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:26.726858 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-867983b5-7687-4ecc-92af-839911f665f2 None None] No DVR routers for this DVR port cdcaf45c-ae0e-4d57-8f82-9506240faf0a on host dv-cinder-816443-2-iscsi {{(pid=102478) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:14:26.731927 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-867983b5-7687-4ecc-92af-839911f665f2 None None] Pushing event deleted for resources: {'Port': ['ID=cdcaf45c-ae0e-4d57-8f82-9506240faf0a,revision_number=None']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:14:26.736708 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-3a1c3ec7-34cb-408d-b7f0-bb43873a3b65 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['df2331c3-0dd0-460e-980f-1e2409baa35e']}} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:14:26.740386 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-867983b5-7687-4ecc-92af-839911f665f2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:26.740767 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-867983b5-7687-4ecc-92af-839911f665f2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:26.741119 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-867983b5-7687-4ecc-92af-839911f665f2 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:26.741428 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-867983b5-7687-4ecc-92af-839911f665f2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:26.741751 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-867983b5-7687-4ecc-92af-839911f665f2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:26.742071 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-867983b5-7687-4ecc-92af-839911f665f2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:26.742391 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-867983b5-7687-4ecc-92af-839911f665f2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:26.742708 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-867983b5-7687-4ecc-92af-839911f665f2 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:26.743065 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-867983b5-7687-4ecc-92af-839911f665f2 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:26.743387 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-867983b5-7687-4ecc-92af-839911f665f2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:26.743637 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-867983b5-7687-4ecc-92af-839911f665f2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:26.743944 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-867983b5-7687-4ecc-92af-839911f665f2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:26.744238 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-867983b5-7687-4ecc-92af-839911f665f2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:14:26.754429 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-3a1c3ec7-34cb-408d-b7f0-bb43873a3b65 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cb920e21-208e-474e-84a0-615ea3280b8a') {'for_net_delete': True} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:14:26.754724 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-3a1c3ec7-34cb-408d-b7f0-bb43873a3b65 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cb920e21-208e-474e-84a0-615ea3280b8a') {} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:14:26.764898 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3a1c3ec7-34cb-408d-b7f0-bb43873a3b65 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750577970535', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-32509733'] for segment, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:26.778332 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3a1c3ec7-34cb-408d-b7f0-bb43873a3b65 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:26.785046 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3a1c3ec7-34cb-408d-b7f0-bb43873a3b65 admin admin] Releasing vlan 122 on physical network physnet1 to pool {{(pid=102476) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 24 05:14:26.785437 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3a1c3ec7-34cb-408d-b7f0-bb43873a3b65 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-32528320'] for segment, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: Traceback (most recent call last): Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: timer() Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: cb(*args, **kw) Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: return func(*args, **kwargs) Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: self._notify() Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: self.callback(batched_events) Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: event.method(event) Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: aggregate_uuid = self.p_client.list_aggregates( Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: return f(self, *a, **k) Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: return self._get(url).json() Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: return self.request(url, 'GET', **kwargs) Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: base_url = self.get_endpoint(auth, allow=allow, Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 24 05:14:26.787343 dv-cinder-816443-2-iscsi neutron-server[102476]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 24 05:14:26.848980 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3a1c3ec7-34cb-408d-b7f0-bb43873a3b65 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3595937', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-546046'] for network, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:26.853563 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-3a1c3ec7-34cb-408d-b7f0-bb43873a3b65 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:26.856820 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-3a1c3ec7-34cb-408d-b7f0-bb43873a3b65 admin admin] 10.222.0.43 "DELETE /v2.0/networks/df2331c3-0dd0-460e-980f-1e2409baa35e HTTP/1.1" status: 204 len: 168 time: 0.5626240 Dec 24 05:14:26.859865 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34952) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:14:26.868989 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a1c3ec7-34cb-408d-b7f0-bb43873a3b65 admin admin] Pushing event deleted for resources: {'Network': ['ID=df2331c3-0dd0-460e-980f-1e2409baa35e,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:14:27.215738 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eb6ca79f-6b8b-4425-a1d0-a41f63d49d35 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-548364'] for router_interface, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:27.465338 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-eb6ca79f-6b8b-4425-a1d0-a41f63d49d35 admin admin] Deleting port 651e2e0a-96cc-4dd5-a12b-875c42bbdf24 {{(pid=102477) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:14:27.465686 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eb6ca79f-6b8b-4425-a1d0-a41f63d49d35 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:27.553554 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.db [None req-eb6ca79f-6b8b-4425-a1d0-a41f63d49d35 admin admin] For port 651e2e0a-96cc-4dd5-a12b-875c42bbdf24, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=651e2e0a-96cc-4dd5-a12b-875c42bbdf24,segment=NetworkSegment(4a78b754-1ec8-4968-9b2e-553c2cd2237b),segment_id=4a78b754-1ec8-4968-9b2e-553c2cd2237b)] {{(pid=102477) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:14:27.553811 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eb6ca79f-6b8b-4425-a1d0-a41f63d49d35 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:27.566020 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-eb6ca79f-6b8b-4425-a1d0-a41f63d49d35 admin admin] Calling delete_port for 651e2e0a-96cc-4dd5-a12b-875c42bbdf24 owned by network:router_interface {{(pid=102477) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:14:27.751424 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eb6ca79f-6b8b-4425-a1d0-a41f63d49d35 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:27.784474 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb6ca79f-6b8b-4425-a1d0-a41f63d49d35 admin admin] Pushing event deleted for resources: {'Port': ['ID=651e2e0a-96cc-4dd5-a12b-875c42bbdf24,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:14:27.948428 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eb6ca79f-6b8b-4425-a1d0-a41f63d49d35 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-627465', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-548448'] for router_interface, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:27.980214 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:28.119152 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5 no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:14:28.139523 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:14:28.140321 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device cd330059-0f6c-4c2c-b3ed-3fa8e26da6a5 not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:14:28.140421 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device cdcaf45c-ae0e-4d57-8f82-9506240faf0a no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:14:28.160006 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: cdcaf45c-ae0e-4d57-8f82-9506240faf0a {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:14:28.160348 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device cdcaf45c-ae0e-4d57-8f82-9506240faf0a not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:14:28.389176 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eb6ca79f-6b8b-4425-a1d0-a41f63d49d35 admin admin] Router ba235614-f658-4ae3-8e87-a8cacc752ef0 has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102477) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:14:28.503113 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eb6ca79f-6b8b-4425-a1d0-a41f63d49d35 admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102477) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:14:28.508516 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-eb6ca79f-6b8b-4425-a1d0-a41f63d49d35 admin admin] 10.222.0.43 "PUT /v2.0/routers/ba235614-f658-4ae3-8e87-a8cacc752ef0/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6474540 Dec 24 05:14:28.511188 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34954) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:14:28.513240 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-738fd5bf-cfc9-4272-b693-bd2ae5c854ec None None] Sync routers for ids ['ba235614-f658-4ae3-8e87-a8cacc752ef0'] in dv-cinder-816443-2-iscsi {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:14:28.524517 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-738fd5bf-cfc9-4272-b693-bd2ae5c854ec None None] Routers {'ba235614-f658-4ae3-8e87-a8cacc752ef0'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:14:28.525169 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-738fd5bf-cfc9-4272-b693-bd2ae5c854ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:14:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['ba235614-f658-4ae3-8e87-a8cacc752ef0'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:14:28.617923 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a35de3ff-6529-4b60-a04f-2219eaf84c98 admin admin] Publish callbacks [] for router, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:28.623131 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:28.639228 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-738fd5bf-cfc9-4272-b693-bd2ae5c854ec None None] Set router ba235614-f658-4ae3-8e87-a8cacc752ef0 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:14:28.724406 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a35de3ff-6529-4b60-a04f-2219eaf84c98 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:28.778539 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-a35de3ff-6529-4b60-a04f-2219eaf84c98 admin admin] Deleting port 0eabffd2-992f-410d-9b71-973d0d669377 {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:14:28.778835 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a35de3ff-6529-4b60-a04f-2219eaf84c98 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:28.871472 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [None req-a35de3ff-6529-4b60-a04f-2219eaf84c98 admin admin] For port 0eabffd2-992f-410d-9b71-973d0d669377, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=0eabffd2-992f-410d-9b71-973d0d669377,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:14:28.871851 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a35de3ff-6529-4b60-a04f-2219eaf84c98 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:28.886212 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-a35de3ff-6529-4b60-a04f-2219eaf84c98 admin admin] Calling delete_port for 0eabffd2-992f-410d-9b71-973d0d669377 owned by network:router_gateway {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:14:28.955471 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-738fd5bf-cfc9-4272-b693-bd2ae5c854ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ba235614-f658-4ae3-8e87-a8cacc752ef0', 'name': 'tempest-TestVolumeBootPattern-26042513-router', 'tenant_id': 'bf7b649b22d644f4971ea81dfca887e0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.176'}], 'enable_snat': True}, 'gw_port_id': '0eabffd2-992f-410d-9b71-973d0d669377', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:25Z', 'updated_at': '2021-12-24T05:14:27Z', 'revision_number': 5, 'project_id': 'bf7b649b22d644f4971ea81dfca887e0', 'gw_port': {'id': '0eabffd2-992f-410d-9b71-973d0d669377', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:9b:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ba235614-f658-4ae3-8e87-a8cacc752ef0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.176', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:06:25Z', 'updated_at': '2021-12-24T05:06:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:14:28.982210 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-738fd5bf-cfc9-4272-b693-bd2ae5c854ec None None] Checking router: ba235614-f658-4ae3-8e87-a8cacc752ef0 for host: dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:14:28.990876 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-738fd5bf-cfc9-4272-b693-bd2ae5c854ec None None] Routers {'ba235614-f658-4ae3-8e87-a8cacc752ef0'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:14:28.991524 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-738fd5bf-cfc9-4272-b693-bd2ae5c854ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:14:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['ba235614-f658-4ae3-8e87-a8cacc752ef0'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:14:29.054952 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a35de3ff-6529-4b60-a04f-2219eaf84c98 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:29.078420 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-738fd5bf-cfc9-4272-b693-bd2ae5c854ec None None] Set router ba235614-f658-4ae3-8e87-a8cacc752ef0 gateway port host: None {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:14:29.080326 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a35de3ff-6529-4b60-a04f-2219eaf84c98 admin admin] Pushing event deleted for resources: {'Port': ['ID=0eabffd2-992f-410d-9b71-973d0d669377,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:14:29.134604 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-738fd5bf-cfc9-4272-b693-bd2ae5c854ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ba235614-f658-4ae3-8e87-a8cacc752ef0', 'name': 'tempest-TestVolumeBootPattern-26042513-router', 'tenant_id': 'bf7b649b22d644f4971ea81dfca887e0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:25Z', 'updated_at': '2021-12-24T05:14:28Z', 'revision_number': 6, 'project_id': 'bf7b649b22d644f4971ea81dfca887e0', 'gw_port_host': None}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:14:29.145692 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a35de3ff-6529-4b60-a04f-2219eaf84c98 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-545986'] for router_gateway, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:29.161146 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-738fd5bf-cfc9-4272-b693-bd2ae5c854ec None None] The sync data for ids ['ba235614-f658-4ae3-8e87-a8cacc752ef0'] in dv-cinder-816443-2-iscsi is: [{'id': 'ba235614-f658-4ae3-8e87-a8cacc752ef0', 'name': 'tempest-TestVolumeBootPattern-26042513-router', 'tenant_id': 'bf7b649b22d644f4971ea81dfca887e0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:06:25Z', 'updated_at': '2021-12-24T05:14:28Z', 'revision_number': 6, 'project_id': 'bf7b649b22d644f4971ea81dfca887e0', 'gw_port_host': None}] {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:14:29.236130 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a35de3ff-6529-4b60-a04f-2219eaf84c98 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-546088', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2070312'] for router, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:29.238363 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a35de3ff-6529-4b60-a04f-2219eaf84c98 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:29.290421 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a35de3ff-6529-4b60-a04f-2219eaf84c98 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-546081'] for router, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:29.290945 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a35de3ff-6529-4b60-a04f-2219eaf84c98 admin admin] Fanout notify agent at l3_agent the message router_deleted on router ba235614-f658-4ae3-8e87-a8cacc752ef0 {{(pid=102476) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 24 05:14:29.295310 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-a35de3ff-6529-4b60-a04f-2219eaf84c98 admin admin] Publish callbacks [] for router, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:29.297286 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-a35de3ff-6529-4b60-a04f-2219eaf84c98 admin admin] 10.222.0.43 "DELETE /v2.0/routers/ba235614-f658-4ae3-8e87-a8cacc752ef0 HTTP/1.1" status: 204 len: 168 time: 0.7849705 Dec 24 05:14:29.299829 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34956) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:14:29.345931 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_v2 [None req-6ee5df5e-f3bf-4e22-aa4e-aaba1b3352e7 admin admin] Deleting subnet be96039d-7619-4886-a09d-561401ca5c41 {{(pid=102476) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Dec 24 05:14:29.349102 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6ee5df5e-f3bf-4e22-aa4e-aaba1b3352e7 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:29.386542 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6ee5df5e-f3bf-4e22-aa4e-aaba1b3352e7 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-32509714'] for subnet, precommit_delete_associations {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:29.491871 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6ee5df5e-f3bf-4e22-aa4e-aaba1b3352e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3590439'] for subnet, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:29.558312 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6ee5df5e-f3bf-4e22-aa4e-aaba1b3352e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3590440', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-32528482', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-32970397'] for subnet, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:29.586112 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ee5df5e-f3bf-4e22-aa4e-aaba1b3352e7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=be96039d-7619-4886-a09d-561401ca5c41,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:14:29.589841 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6ee5df5e-f3bf-4e22-aa4e-aaba1b3352e7 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:29.593934 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-6ee5df5e-f3bf-4e22-aa4e-aaba1b3352e7 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/be96039d-7619-4886-a09d-561401ca5c41 HTTP/1.1" status: 204 len: 168 time: 0.2930882 Dec 24 05:14:29.596384 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34958) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:14:29.605010 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-11766903-8b02-4693-8d3e-6b5053486897 None None] Network 0609ed93-c812-4af1-9df9-9ff4b30f6db5 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:14:29.665381 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d9d2c2f0-7c86-4c4b-b5c2-b3d3cb0044b9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3741433'] for network, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:29.722450 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-d9d2c2f0-7c86-4c4b-b5c2-b3d3cb0044b9 admin admin] Deleting port b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0 {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:14:29.722822 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d9d2c2f0-7c86-4c4b-b5c2-b3d3cb0044b9 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:29.788264 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [None req-d9d2c2f0-7c86-4c4b-b5c2-b3d3cb0044b9 admin admin] For port b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0,segment=NetworkSegment(4a78b754-1ec8-4968-9b2e-553c2cd2237b),segment_id=4a78b754-1ec8-4968-9b2e-553c2cd2237b)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:14:29.788714 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d9d2c2f0-7c86-4c4b-b5c2-b3d3cb0044b9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:29.801250 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-d9d2c2f0-7c86-4c4b-b5c2-b3d3cb0044b9 admin admin] Calling delete_port for b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0 owned by network:dhcp {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:14:29.885937 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d9d2c2f0-7c86-4c4b-b5c2-b3d3cb0044b9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:29.909771 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9624079a-ca93-4e11-8a68-e0f3d7de1ce1 None None] DHCP port deletion for 0609ed93-c812-4af1-9df9-9ff4b30f6db5 request from dv-cinder-816443-2-iscsi {{(pid=102478) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 24 05:14:29.918838 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9d2c2f0-7c86-4c4b-b5c2-b3d3cb0044b9 admin admin] Pushing event deleted for resources: {'Port': ['ID=b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:14:29.920703 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9d2c2f0-7c86-4c4b-b5c2-b3d3cb0044b9 admin admin] No DVR routers for this DVR port b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0 on host dv-cinder-816443-2-iscsi {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:14:29.993803 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d9d2c2f0-7c86-4c4b-b5c2-b3d3cb0044b9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3595960', 'neutron.services.segments.db._delete_segments_for_network-8750577966942'] for network, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:30.015455 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-d9d2c2f0-7c86-4c4b-b5c2-b3d3cb0044b9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0609ed93-c812-4af1-9df9-9ff4b30f6db5']}} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:14:30.025442 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-d9d2c2f0-7c86-4c4b-b5c2-b3d3cb0044b9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4a78b754-1ec8-4968-9b2e-553c2cd2237b') {'for_net_delete': True} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:14:30.025744 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-d9d2c2f0-7c86-4c4b-b5c2-b3d3cb0044b9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4a78b754-1ec8-4968-9b2e-553c2cd2237b') {} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:14:30.044100 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d9d2c2f0-7c86-4c4b-b5c2-b3d3cb0044b9 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750577970535', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-32509733'] for segment, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:30.059123 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d9d2c2f0-7c86-4c4b-b5c2-b3d3cb0044b9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:30.065704 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 651e2e0a-96cc-4dd5-a12b-875c42bbdf24 no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:14:30.066289 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d9d2c2f0-7c86-4c4b-b5c2-b3d3cb0044b9 admin admin] Releasing vlan 144 on physical network physnet1 to pool {{(pid=102476) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 24 05:14:30.066289 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d9d2c2f0-7c86-4c4b-b5c2-b3d3cb0044b9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-32528320'] for segment, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: Traceback (most recent call last): Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: timer() Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: cb(*args, **kw) Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: return func(*args, **kwargs) Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: self._notify() Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: self.callback(batched_events) Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: event.method(event) Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: aggregate_uuid = self.p_client.list_aggregates( Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: return f(self, *a, **k) Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: return self._get(url).json() Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: return self.request(url, 'GET', **kwargs) Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: base_url = self.get_endpoint(auth, allow=allow, Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 24 05:14:30.068271 dv-cinder-816443-2-iscsi neutron-server[102476]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 24 05:14:30.086433 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: 651e2e0a-96cc-4dd5-a12b-875c42bbdf24 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:14:30.086780 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 651e2e0a-96cc-4dd5-a12b-875c42bbdf24 not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:14:30.087212 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 0eabffd2-992f-410d-9b71-973d0d669377 no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:14:30.105933 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: 0eabffd2-992f-410d-9b71-973d0d669377 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:14:30.106280 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 0eabffd2-992f-410d-9b71-973d0d669377 not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:14:30.106702 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0 no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:14:30.123342 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d9d2c2f0-7c86-4c4b-b5c2-b3d3cb0044b9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3595937', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-546046'] for network, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:30.129405 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-d9d2c2f0-7c86-4c4b-b5c2-b3d3cb0044b9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:30.130750 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:14:30.131295 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device b0b0b5e0-b35a-499c-b0d0-06e7466d1ab0 not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:14:30.132951 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-d9d2c2f0-7c86-4c4b-b5c2-b3d3cb0044b9 admin admin] 10.222.0.43 "DELETE /v2.0/networks/0609ed93-c812-4af1-9df9-9ff4b30f6db5 HTTP/1.1" status: 204 len: 168 time: 0.5355327 Dec 24 05:14:30.144114 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9d2c2f0-7c86-4c4b-b5c2-b3d3cb0044b9 admin admin] Pushing event deleted for resources: {'Network': ['ID=0609ed93-c812-4af1-9df9-9ff4b30f6db5,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:14:30.264873 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34962) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:14:30.306873 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-b7d24849-268b-462e-a8fe-1eb0a5b33570 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=8b1a80c6322a493ba10c69a77168b46f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0407922 Dec 24 05:14:30.309428 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 34964) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:14:30.357189 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-5a13659f-04e4-4975-bc4f-b0ca15b53e34 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:30.378386 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-5a13659f-04e4-4975-bc4f-b0ca15b53e34 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:30.425650 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-5a13659f-04e4-4975-bc4f-b0ca15b53e34 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:30.428312 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-5a13659f-04e4-4975-bc4f-b0ca15b53e34 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:30.429492 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-5a13659f-04e4-4975-bc4f-b0ca15b53e34 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/814e46cc-f537-4c44-8e22-29ecbc1440eb HTTP/1.1" status: 204 len: 168 time: 0.1191998 Dec 24 05:14:30.438109 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a13659f-04e4-4975-bc4f-b0ca15b53e34 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=814e46cc-f537-4c44-8e22-29ecbc1440eb,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:14:30.770555 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34970) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:14:30.812069 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-402fc8b6-cd49-4960-b28f-a17a624425a9 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=bf7b649b22d644f4971ea81dfca887e0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0403080 Dec 24 05:14:30.814784 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34972) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:14:30.866630 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c7588b5b-e012-4540-aa37-40b2b7ef574f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:30.893226 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c7588b5b-e012-4540-aa37-40b2b7ef574f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:30.949618 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c7588b5b-e012-4540-aa37-40b2b7ef574f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:30.952228 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c7588b5b-e012-4540-aa37-40b2b7ef574f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:30.953782 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-c7588b5b-e012-4540-aa37-40b2b7ef574f admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/41262f8f-341a-4db3-8afd-e3698a9aab93 HTTP/1.1" status: 204 len: 168 time: 0.1377985 Dec 24 05:14:30.961811 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7588b5b-e012-4540-aa37-40b2b7ef574f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=41262f8f-341a-4db3-8afd-e3698a9aab93,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:14:40.328329 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [req-beba0bd9-2294-4e9e-b31f-9d7551530791 req-9a1b46fb-7652-4f2d-a2b3-64690a1dda5a service neutron] (102477) timed out ('10.222.0.46', 62330) {{(pid=102477) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 24 05:14:42.037356 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [req-75dea018-2e13-4310-9906-f2f2fba97f61 req-6b83bff8-e941-4bb9-b4f4-fd229e70fb6a service neutron] (102476) timed out ('10.222.0.46', 62358) {{(pid=102476) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 24 05:14:50.529230 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:52.460740 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:14:53.230562 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-ee55bb99-a7d7-4e89-9317-e6aacbb763ac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:55.309117 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-c66d6172-7a56-4fff-a1e6-4129293100c8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:56.546318 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:57.994365 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:14:58.594012 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:15.981438 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5672750-f221-47cc-983c-6bf3adaf46e7 req-d9498849-7bc0-4282-a00c-16ab6360a5cb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:15.982934 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d5672750-f221-47cc-983c-6bf3adaf46e7 req-d9498849-7bc0-4282-a00c-16ab6360a5cb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0594025 Dec 24 05:15:16.033799 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-d5672750-f221-47cc-983c-6bf3adaf46e7 req-50e2d600-5a08-4363-b857-118ac742929e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438511 Dec 24 05:15:17.160253 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc3f2302-d0c5-4b45-8ac8-71ea57ca3045 req-5224bdb1-75e5-4410-8fda-dc7efb8825d7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:17.161752 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-cc3f2302-d0c5-4b45-8ac8-71ea57ca3045 req-5224bdb1-75e5-4410-8fda-dc7efb8825d7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0517340 Dec 24 05:15:17.216492 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-cc3f2302-d0c5-4b45-8ac8-71ea57ca3045 req-0460fd3a-844a-4d40-9dbb-1d3430872960 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0459785 Dec 24 05:15:18.070861 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-764ebf07-9575-46c3-806d-4fa5e1880a7e req-4566eefe-6af9-40be-9e80-a479876b9b4d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:18.072340 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-764ebf07-9575-46c3-806d-4fa5e1880a7e req-4566eefe-6af9-40be-9e80-a479876b9b4d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.46 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.0585241 Dec 24 05:15:18.169054 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-764ebf07-9575-46c3-806d-4fa5e1880a7e req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Deleting port b3526449-31e3-4b8f-a3a1-329333c58c47 {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:15:18.169362 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-764ebf07-9575-46c3-806d-4fa5e1880a7e req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:18.257872 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-764ebf07-9575-46c3-806d-4fa5e1880a7e req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] For port b3526449-31e3-4b8f-a3a1-329333c58c47, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=b3526449-31e3-4b8f-a3a1-329333c58c47,segment=NetworkSegment(58060104-31c9-4b9f-ad66-9f4a4de56096),segment_id=58060104-31c9-4b9f-ad66-9f4a4de56096)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:15:18.258221 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-764ebf07-9575-46c3-806d-4fa5e1880a7e req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:18.691031 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abff0a48-f493-49fe-ae9e-c638c16f1f88 req-afbce017-5384-4940-933c-ffdeae4c7ce3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:18.692414 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-abff0a48-f493-49fe-ae9e-c638c16f1f88 req-afbce017-5384-4940-933c-ffdeae4c7ce3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=5096ad5d-d707-4082-908c-d12a3d5519cc HTTP/1.1" status: 200 len: 946 time: 0.3899369 Dec 24 05:15:18.781195 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-764ebf07-9575-46c3-806d-4fa5e1880a7e req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:18.781559 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-764ebf07-9575-46c3-806d-4fa5e1880a7e req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-545804'] for floatingip, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:18.781810 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.l3_db [req-764ebf07-9575-46c3-806d-4fa5e1880a7e req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Floating IP 229016fe-d27e-49b3-9c28-32c0a18ffbdb disassociated. External IP: 172.27.1.212, port: b3526449-31e3-4b8f-a3a1-329333c58c47. Dec 24 05:15:18.782196 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-764ebf07-9575-46c3-806d-4fa5e1880a7e req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling delete_port for b3526449-31e3-4b8f-a3a1-329333c58c47 owned by compute:nova {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:15:18.790293 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-abff0a48-f493-49fe-ae9e-c638c16f1f88 req-96d0bdc4-0b1a-44bb-989d-66b1525b7245 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=0933ef99-cb3a-4b4f-9580-ae036add7f53&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0893779 Dec 24 05:15:18.920666 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-764ebf07-9575-46c3-806d-4fa5e1880a7e req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:18.954587 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Pushing event deleted for resources: {'Port': ['ID=b3526449-31e3-4b8f-a3a1-329333c58c47,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:15:18.967543 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:18.967892 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:18.968234 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:18.968560 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:18.968927 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:18.969255 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:18.969580 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:18.969876 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:18.970213 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:18.970539 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:18.971036 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:18.971160 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:18.971492 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:19.084922 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [req-764ebf07-9575-46c3-806d-4fa5e1880a7e req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Router 3e033806-af20-4ee4-8d0e-05f57044dfa3 has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102476) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:15:19.195992 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-764ebf07-9575-46c3-806d-4fa5e1880a7e req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:15:19.207958 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e336c00e-f831-4605-b985-26da69bcadf5 None None] Sync routers for ids ['3e033806-af20-4ee4-8d0e-05f57044dfa3'] in dv-cinder-816443-2-iscsi {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:15:19.218902 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e336c00e-f831-4605-b985-26da69bcadf5 None None] Routers {'3e033806-af20-4ee4-8d0e-05f57044dfa3'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:15:19.219511 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-e336c00e-f831-4605-b985-26da69bcadf5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:14:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['3e033806-af20-4ee4-8d0e-05f57044dfa3'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:15:19.237254 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-764ebf07-9575-46c3-806d-4fa5e1880a7e req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] No DVR routers for this DVR port b3526449-31e3-4b8f-a3a1-329333c58c47 on host hv-cinder-81644 {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:15:19.239798 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-764ebf07-9575-46c3-806d-4fa5e1880a7e req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:19.244448 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-764ebf07-9575-46c3-806d-4fa5e1880a7e req-507055d9-2cd4-4d07-9d80-079e2d5b14ee tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.46 "DELETE /v2.0/ports/b3526449-31e3-4b8f-a3a1-329333c58c47 HTTP/1.1" status: 204 len: 173 time: 1.1650314 Dec 24 05:15:19.244926 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5096ad5d-d707-4082-908c-d12a3d5519cc', 'name': 'network-vif-deleted', 'tag': 'b3526449-31e3-4b8f-a3a1-329333c58c47'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:15:19.247225 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e5dccbc5-5f3b-41b3-8932-a5c64bbc72ec" -d '{"events": [{"server_uuid": "5096ad5d-d707-4082-908c-d12a3d5519cc", "name": "network-vif-deleted", "tag": "b3526449-31e3-4b8f-a3a1-329333c58c47"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:15:19.289213 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:15:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-11964b0c-3a5f-4e22-8230-29564f69a286 x-openstack-request-id: req-11964b0c-3a5f-4e22-8230-29564f69a286 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:15:19.289686 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5096ad5d-d707-4082-908c-d12a3d5519cc", "name": "network-vif-deleted", "tag": "b3526449-31e3-4b8f-a3a1-329333c58c47", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:15:19.289799 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-11964b0c-3a5f-4e22-8230-29564f69a286 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:15:19.290188 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5096ad5d-d707-4082-908c-d12a3d5519cc', 'name': 'network-vif-deleted', 'tag': 'b3526449-31e3-4b8f-a3a1-329333c58c47', 'status': 'completed', 'code': 200} Dec 24 05:15:19.335119 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-e336c00e-f831-4605-b985-26da69bcadf5 None None] Set router 3e033806-af20-4ee4-8d0e-05f57044dfa3 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:15:19.547289 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-e336c00e-f831-4605-b985-26da69bcadf5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'name': 'tempest-AttachVolumeTestJSON-1934153865-router', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:46Z', 'revision_number': 4, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'gw_port': {'id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:28:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 591, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': 'f59ad02b-7d9d-4dc6-8574-27886cacfc47', 'name': '', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'mac_address': 'fa:16:3e:a2:f9:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_interface', 'standard_attr_id': 592, 'fixed_ips': [{'subnet_id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:46Z', 'updated_at': '2021-12-24T05:10:49Z', 'revision_number': 5, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'subnets': [{'id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:15:19.573616 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e336c00e-f831-4605-b985-26da69bcadf5 None None] Checking router: 3e033806-af20-4ee4-8d0e-05f57044dfa3 for host: dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:15:19.582071 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e336c00e-f831-4605-b985-26da69bcadf5 None None] Routers {'3e033806-af20-4ee4-8d0e-05f57044dfa3'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:15:19.582667 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-e336c00e-f831-4605-b985-26da69bcadf5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:14:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['3e033806-af20-4ee4-8d0e-05f57044dfa3'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:15:19.692178 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-e336c00e-f831-4605-b985-26da69bcadf5 None None] Set router 3e033806-af20-4ee4-8d0e-05f57044dfa3 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:15:19.879887 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 34998) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:15:19.936869 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e1f620e2-80e3-41ff-ad78-2d98482180bf tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:19.964856 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e1f620e2-80e3-41ff-ad78-2d98482180bf tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:19.989795 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-e336c00e-f831-4605-b985-26da69bcadf5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'name': 'tempest-AttachVolumeTestJSON-1934153865-router', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:46Z', 'revision_number': 4, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'gw_port': {'id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:28:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 591, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': 'f59ad02b-7d9d-4dc6-8574-27886cacfc47', 'name': '', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'mac_address': 'fa:16:3e:a2:f9:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_interface', 'standard_attr_id': 592, 'fixed_ips': [{'subnet_id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:46Z', 'updated_at': '2021-12-24T05:10:49Z', 'revision_number': 5, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'subnets': [{'id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:15:20.014388 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e1f620e2-80e3-41ff-ad78-2d98482180bf tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:20.017254 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e1f620e2-80e3-41ff-ad78-2d98482180bf tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:20.020971 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-e1f620e2-80e3-41ff-ad78-2d98482180bf tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "DELETE /v2.0/security-groups/0933ef99-cb3a-4b4f-9580-ae036add7f53 HTTP/1.1" status: 204 len: 168 time: 0.1398997 Dec 24 05:15:20.021342 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 35000) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:15:20.023782 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e336c00e-f831-4605-b985-26da69bcadf5 None None] The sync data for ids ['3e033806-af20-4ee4-8d0e-05f57044dfa3'] in dv-cinder-816443-2-iscsi is: [{'id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'name': 'tempest-AttachVolumeTestJSON-1934153865-router', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:46Z', 'revision_number': 4, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'gw_port': {'id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:28:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 591, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': 'f59ad02b-7d9d-4dc6-8574-27886cacfc47', 'name': '', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'mac_address': 'fa:16:3e:a2:f9:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_interface', 'standard_attr_id': 592, 'fixed_ips': [{'subnet_id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:46Z', 'updated_at': '2021-12-24T05:10:49Z', 'revision_number': 5, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'subnets': [{'id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:15:20.031582 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1f620e2-80e3-41ff-ad78-2d98482180bf tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0933ef99-cb3a-4b4f-9580-ae036add7f53,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:15:20.034318 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.api.v2.resource [None req-56267c62-928a-4499-8e88-34f7f198e9ae tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] show failed (client error): The resource could not be found. Dec 24 05:15:20.038600 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-56267c62-928a-4499-8e88-34f7f198e9ae tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups/0933ef99-cb3a-4b4f-9580-ae036add7f53 HTTP/1.1" status: 404 len: 347 time: 0.0161550 Dec 24 05:15:20.039168 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 35002) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:15:20.164783 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-e56fa887-55b2-4c02-9983-95db3cf47a29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Deleting port ae593015-66af-415c-8a46-b21299c8f203 {{(pid=102477) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:15:20.165126 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e56fa887-55b2-4c02-9983-95db3cf47a29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:20.242276 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e56fa887-55b2-4c02-9983-95db3cf47a29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:20.243341 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e56fa887-55b2-4c02-9983-95db3cf47a29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:20.245541 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c96fb04f-db43-4b47-a438-1ca8f4dee9cf None None] New status for floating IP 229016fe-d27e-49b3-9c28-32c0a18ffbdb: DOWN {{(pid=102478) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 24 05:15:20.255553 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-e56fa887-55b2-4c02-9983-95db3cf47a29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling delete_port for ae593015-66af-415c-8a46-b21299c8f203 owned by network:floatingip {{(pid=102477) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:15:20.405444 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e56fa887-55b2-4c02-9983-95db3cf47a29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:20.430735 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e56fa887-55b2-4c02-9983-95db3cf47a29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Pushing event deleted for resources: {'Port': ['ID=ae593015-66af-415c-8a46-b21299c8f203,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:15:20.454148 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56fa887-55b2-4c02-9983-95db3cf47a29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:20.454498 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56fa887-55b2-4c02-9983-95db3cf47a29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:20.454849 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56fa887-55b2-4c02-9983-95db3cf47a29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:20.455192 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56fa887-55b2-4c02-9983-95db3cf47a29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:20.455522 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56fa887-55b2-4c02-9983-95db3cf47a29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:20.455852 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56fa887-55b2-4c02-9983-95db3cf47a29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:20.456183 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56fa887-55b2-4c02-9983-95db3cf47a29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:20.456513 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56fa887-55b2-4c02-9983-95db3cf47a29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:20.456863 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56fa887-55b2-4c02-9983-95db3cf47a29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:20.457195 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56fa887-55b2-4c02-9983-95db3cf47a29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:20.457521 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56fa887-55b2-4c02-9983-95db3cf47a29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:20.457831 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56fa887-55b2-4c02-9983-95db3cf47a29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:20.458147 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e56fa887-55b2-4c02-9983-95db3cf47a29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:20.503247 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e56fa887-55b2-4c02-9983-95db3cf47a29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for floatingip, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:20.506087 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e56fa887-55b2-4c02-9983-95db3cf47a29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for floatingip, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:20.507322 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-e56fa887-55b2-4c02-9983-95db3cf47a29 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "DELETE /v2.0/floatingips/229016fe-d27e-49b3-9c28-32c0a18ffbdb HTTP/1.1" status: 204 len: 168 time: 0.4671934 Dec 24 05:15:20.548161 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:21.877807 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 35008) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:15:21.882800 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-dce9eaf3-1d8f-4969-a95e-811024bb4d16 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1185760474', 'description': 'tempest-description--1935559569'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:15:21.906896 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-dce9eaf3-1d8f-4969-a95e-811024bb4d16 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:21.976694 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-dce9eaf3-1d8f-4969-a95e-811024bb4d16 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:21.983694 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-dce9eaf3-1d8f-4969-a95e-811024bb4d16 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:22.013927 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-dce9eaf3-1d8f-4969-a95e-811024bb4d16 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:22.015162 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-dce9eaf3-1d8f-4969-a95e-811024bb4d16 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.1362431 Dec 24 05:15:22.016285 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dce9eaf3-1d8f-4969-a95e-811024bb4d16 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Pushing event updated for resources: {'SecurityGroup': ['ID=84a9183e-c79a-4f14-8b75-aebd4aef7ba8,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:15:22.018287 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 35010) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:15:22.023654 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-4873fb68-536f-47bc-8602-dca11ad25873 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Request body: {'security_group_rule': {'security_group_id': '84a9183e-c79a-4f14-8b75-aebd4aef7ba8', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:15:22.053617 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4873fb68-536f-47bc-8602-dca11ad25873 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:22.105228 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4873fb68-536f-47bc-8602-dca11ad25873 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:22.110201 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4873fb68-536f-47bc-8602-dca11ad25873 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:22.128279 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4873fb68-536f-47bc-8602-dca11ad25873 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2638eade-5f61-466b-80b7-d0bb4103628f,revision_number=0']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:15:22.136725 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-4873fb68-536f-47bc-8602-dca11ad25873 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:22.137935 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-4873fb68-536f-47bc-8602-dca11ad25873 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1185927 Dec 24 05:15:22.140849 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 35012) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:15:22.145190 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-6048a025-dcb8-4008-9de5-0aed68d976d0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Request body: {'security_group_rule': {'security_group_id': '84a9183e-c79a-4f14-8b75-aebd4aef7ba8', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:15:22.175907 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6048a025-dcb8-4008-9de5-0aed68d976d0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:22.231613 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6048a025-dcb8-4008-9de5-0aed68d976d0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:22.237194 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6048a025-dcb8-4008-9de5-0aed68d976d0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:22.254436 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6048a025-dcb8-4008-9de5-0aed68d976d0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=35679c60-d057-403f-82d4-0665e4c3bd0b,revision_number=0']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:15:22.263208 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6048a025-dcb8-4008-9de5-0aed68d976d0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:22.264428 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-6048a025-dcb8-4008-9de5-0aed68d976d0 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1225727 Dec 24 05:15:22.267684 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 35014) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:15:22.271987 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-e74db8c0-22ec-4b2d-bba1-f48a09f91eda tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Request body: {'floatingip': {'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:15:22.297818 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e74db8c0-22ec-4b2d-bba1-f48a09f91eda tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for floatingip, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:22.399586 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e74db8c0-22ec-4b2d-bba1-f48a09f91eda tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:22.461934 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device b3526449-31e3-4b8f-a3a1-329333c58c47 no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:15:22.481587 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] No Port match for: b3526449-31e3-4b8f-a3a1-329333c58c47 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:15:22.481930 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device b3526449-31e3-4b8f-a3a1-329333c58c47 not bound to the agent host hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:15:22.502033 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [None req-e74db8c0-22ec-4b2d-bba1-f48a09f91eda tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Allocated IP 172.27.1.168 (9b4e4b31-551f-45a9-b26a-cb44ee20a17d/f277b899-8779-420e-8a8d-bfcd5eb7f012/31df7585-2560-489b-8b06-2ffd3a2a2887) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:15:22.613936 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e74db8c0-22ec-4b2d-bba1-f48a09f91eda tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:22.651469 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e74db8c0-22ec-4b2d-bba1-f48a09f91eda tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:22.689777 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e74db8c0-22ec-4b2d-bba1-f48a09f91eda tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:15:22.692716 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-e74db8c0-22ec-4b2d-bba1-f48a09f91eda tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:15:22.696235 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e74db8c0-22ec-4b2d-bba1-f48a09f91eda tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:15:22.701486 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e74db8c0-22ec-4b2d-bba1-f48a09f91eda tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Pushing event updated for resources: {'Port': ['ID=31df7585-2560-489b-8b06-2ffd3a2a2887,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:15:22.793629 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e74db8c0-22ec-4b2d-bba1-f48a09f91eda tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:22.831066 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e74db8c0-22ec-4b2d-bba1-f48a09f91eda tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:22.998137 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e74db8c0-22ec-4b2d-bba1-f48a09f91eda tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:23.006188 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e74db8c0-22ec-4b2d-bba1-f48a09f91eda tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:23.070657 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e74db8c0-22ec-4b2d-bba1-f48a09f91eda tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Pushing event updated for resources: {'Port': ['ID=31df7585-2560-489b-8b06-2ffd3a2a2887,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:15:23.082862 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e74db8c0-22ec-4b2d-bba1-f48a09f91eda tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-545804'] for floatingip, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:23.105314 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-e74db8c0-22ec-4b2d-bba1-f48a09f91eda tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for floatingip, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:23.106623 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-e74db8c0-22ec-4b2d-bba1-f48a09f91eda tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 0.8379936 Dec 24 05:15:23.226803 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-d9dbad8e-72cc-42ac-8a64-2a2d92f4c0ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:23.312393 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-e1d4b7d8-1496-4acc-b5f3-5fbdc757a62e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-securitygroup--1185760474&fields=id&tenant_id=fc4cefad8fef403e90ad695e2098ee7b HTTP/1.1" status: 200 len: 267 time: 0.0443456 Dec 24 05:15:23.426580 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-26f8e228-4933-4acc-a4a1-f14261ae1884 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:23.428162 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-26f8e228-4933-4acc-a4a1-f14261ae1884 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/networks?id=075b69cb-c546-4fa5-aa29-49a5b85c94b1 HTTP/1.1" status: 200 len: 811 time: 0.1086943 Dec 24 05:15:23.449263 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-e459e31d-af7f-4964-b653-c45673d39687 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/quotas/fc4cefad8fef403e90ad695e2098ee7b HTTP/1.1" status: 200 len: 375 time: 0.0093703 Dec 24 05:15:23.506659 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-a5f47308-d8ce-4def-bd83-e12238deff38 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=fc4cefad8fef403e90ad695e2098ee7b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0519483 Dec 24 05:15:23.706592 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-6ba019d1-d7c9-4a66-a007-f334af36359f service neutron] 10.222.0.43 "GET /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1877563 Dec 24 05:15:23.799340 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-3735f39e-5e45-43de-b2cc-99859bba417e service neutron] 10.222.0.43 "GET /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0854206 Dec 24 05:15:24.993135 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-01a8df78-e661-40c7-b8a6-daf3e64185d1 req-2107ff5c-208d-4d1b-8414-6b48cb7ec98b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 210 time: 0.0268455 Dec 24 05:15:25.309145 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-0c57c1f5-9a83-491f-9877-4f4f83cd013b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:26.074607 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c835dd4d-0012-41ef-aaeb-00624daf8893 req-694b8b31-03d0-4459-aa39-2e17c217efdb tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 210 time: 0.0262959 Dec 24 05:15:26.546675 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:27.163958 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-f69f6768-30bb-43f3-89d3-0f9efdf1757c req-ee0132a3-d8a7-4db9-a651-4406eb46d9fa tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 210 time: 0.0308802 Dec 24 05:15:27.991557 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:28.253882 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-fb8d74d4-4082-4507-bf4c-150b40ffb56d req-45b6bbee-4fe6-42c4-85ed-558097236dfd tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 210 time: 0.0339644 Dec 24 05:15:28.601219 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:29.360329 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a0b770e4-55d7-45cd-8452-a1e35cef06d0 req-7ef34ac1-b56a-4458-b86b-365698eff2a7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 210 time: 0.0271249 Dec 24 05:15:29.465590 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:15:30.245951 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-5422276a-4f8e-4485-87bc-fdc0b887b4db tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:30.247395 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-5422276a-4f8e-4485-87bc-fdc0b887b4db tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.46 "GET /v2.0/networks?id=075b69cb-c546-4fa5-aa29-49a5b85c94b1 HTTP/1.1" status: 200 len: 811 time: 0.1044712 Dec 24 05:15:30.319138 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-1eb1f8e9-32cd-4b0d-a243-d275f3bf6e2f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.46 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=fc4cefad8fef403e90ad695e2098ee7b HTTP/1.1" status: 200 len: 380 time: 0.0559328 Dec 24 05:15:30.331847 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-11fe76d9-e0c7-4f1f-9688-98d73131bc79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Request body: {'port': {'device_id': 'b386bfda-4228-4be5-b718-1bd4a43bb5a6', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'admin_state_up': True, 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'security_groups': ['84a9183e-c79a-4f14-8b75-aebd4aef7ba8']}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:15:30.448920 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-11fe76d9-e0c7-4f1f-9688-98d73131bc79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Made reservation on behalf of fc4cefad8fef403e90ad695e2098ee7b for: {'port': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:15:30.452428 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-11fe76d9-e0c7-4f1f-9688-98d73131bc79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:30.468213 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c4b64e83-4c25-4ccc-847c-03480b380383 req-2aa60b2e-e49a-492b-89a9-b9c359fdf5ad tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 210 time: 0.0302930 Dec 24 05:15:30.579830 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-11fe76d9-e0c7-4f1f-9688-98d73131bc79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Allocated IP 172.20.0.4 (075b69cb-c546-4fa5-aa29-49a5b85c94b1/314909f7-3ba5-49d4-a94f-2ebca4c9a707/5dfd861f-9d99-4555-bfe9-1c8d6b3f537e) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:15:30.715238 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-11fe76d9-e0c7-4f1f-9688-98d73131bc79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:30.755764 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-11fe76d9-e0c7-4f1f-9688-98d73131bc79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:30.800257 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-11fe76d9-e0c7-4f1f-9688-98d73131bc79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Network 075b69cb-c546-4fa5-aa29-49a5b85c94b1 is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:15:30.803373 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-11fe76d9-e0c7-4f1f-9688-98d73131bc79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:15:30.807261 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-11fe76d9-e0c7-4f1f-9688-98d73131bc79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:15:30.813470 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11fe76d9-e0c7-4f1f-9688-98d73131bc79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Pushing event updated for resources: {'Port': ['ID=5dfd861f-9d99-4555-bfe9-1c8d6b3f537e,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:15:30.861150 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-11fe76d9-e0c7-4f1f-9688-98d73131bc79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:30.861677 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-11fe76d9-e0c7-4f1f-9688-98d73131bc79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:30.879485 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-11fe76d9-e0c7-4f1f-9688-98d73131bc79 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.46 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5511820 Dec 24 05:15:30.996676 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-bb337179-c170-421e-920e-4ce748917acb service neutron] Request body: {'port': {'device_id': 'b386bfda-4228-4be5-b718-1bd4a43bb5a6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81644'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:15:31.041589 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-2cca8c22-268a-4f83-8a45-4c4700de08f3 None None] Provisioning complete for port 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:15:31.042194 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-2cca8c22-268a-4f83-8a45-4c4700de08f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:31.052851 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-bb337179-c170-421e-920e-4ce748917acb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:31.075388 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-2cca8c22-268a-4f83-8a45-4c4700de08f3 None None] Port 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 05:15:31.308446 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-bb337179-c170-421e-920e-4ce748917acb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e {{(pid=102476) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:15:31.316127 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-bb337179-c170-421e-920e-4ce748917acb service neutron] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:31.332569 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.provisioning_blocks [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-bb337179-c170-421e-920e-4ce748917acb service neutron] Transition to ACTIVE for port object 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e will not be triggered until provisioned by entity L2. {{(pid=102476) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 24 05:15:31.338778 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-bb337179-c170-421e-920e-4ce748917acb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:31.390559 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb337179-c170-421e-920e-4ce748917acb service neutron] Pushing event updated for resources: {'Port': ['ID=5dfd861f-9d99-4555-bfe9-1c8d6b3f537e,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:15:31.463356 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-bb337179-c170-421e-920e-4ce748917acb service neutron] Attempting to bind port 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e on host hv-cinder-81644 for vnic_type normal with profile {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:15:31.464104 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-bb337179-c170-421e-920e-4ce748917acb service neutron] Attempting to bind port 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e by drivers openvswitch,hyperv on host hv-cinder-81644 at level 0 using segments [{'id': '58060104-31c9-4b9f-ad66-9f4a4de56096', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1'}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:15:31.464104 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-bb337179-c170-421e-920e-4ce748917acb service neutron] Attempting to bind port 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e on network 075b69cb-c546-4fa5-aa29-49a5b85c94b1 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:15:31.468478 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-bb337179-c170-421e-920e-4ce748917acb service neutron] Port 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e on network 075b69cb-c546-4fa5-aa29-49a5b85c94b1 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81644 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 24 05:15:31.468818 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-bb337179-c170-421e-920e-4ce748917acb service neutron] Attempting to bind port 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e on network 075b69cb-c546-4fa5-aa29-49a5b85c94b1 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:15:31.473723 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-bb337179-c170-421e-920e-4ce748917acb service neutron] Checking agent: {'id': '7a2ffd19-371f-4f7b-a239-eea3b5cfd55b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81644', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'started_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 15, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:15:31.474047 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-bb337179-c170-421e-920e-4ce748917acb service neutron] Checking segment: {'id': '58060104-31c9-4b9f-ad66-9f4a4de56096', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:15:31.474427 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-bb337179-c170-421e-920e-4ce748917acb service neutron] Bound using segment: {'id': '58060104-31c9-4b9f-ad66-9f4a4de56096', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1'} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:15:31.474845 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-bb337179-c170-421e-920e-4ce748917acb service neutron] Bound port: 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e, host: hv-cinder-81644, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '58060104-31c9-4b9f-ad66-9f4a4de56096', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1'}}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:15:31.475196 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-bb337179-c170-421e-920e-4ce748917acb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:31.545488 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-bb337179-c170-421e-920e-4ce748917acb service neutron] For port 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e, host hv-cinder-81644, cleared binding levels {{(pid=102476) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:15:31.577249 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-bb337179-c170-421e-920e-4ce748917acb service neutron] For port 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e, host hv-cinder-81644, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=5dfd861f-9d99-4555-bfe9-1c8d6b3f537e,segment=NetworkSegment(58060104-31c9-4b9f-ad66-9f4a4de56096),segment_id=58060104-31c9-4b9f-ad66-9f4a4de56096)] {{(pid=102476) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:15:31.583178 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-bb337179-c170-421e-920e-4ce748917acb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:31.646699 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afdb74e0-949c-4fe4-bc03-e1a848ddaa50 req-dedeeec4-9174-4bdf-847d-9cf7fa22a00a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:31.648218 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-afdb74e0-949c-4fe4-bc03-e1a848ddaa50 req-dedeeec4-9174-4bdf-847d-9cf7fa22a00a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 943 time: 0.1047788 Dec 24 05:15:31.651485 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-bb337179-c170-421e-920e-4ce748917acb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:31.652097 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-bb337179-c170-421e-920e-4ce748917acb service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:31.653451 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-bb337179-c170-421e-920e-4ce748917acb service neutron] 10.222.0.46 "PUT /v2.0/ports/5dfd861f-9d99-4555-bfe9-1c8d6b3f537e HTTP/1.1" status: 200 len: 1093 time: 0.7090318 Dec 24 05:15:31.653945 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b386bfda-4228-4be5-b718-1bd4a43bb5a6', 'tag': '5dfd861f-9d99-4555-bfe9-1c8d6b3f537e'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:15:31.656199 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8342fb50-e7bf-4da3-9d4f-412abf596d34" -d '{"events": [{"name": "network-changed", "server_uuid": "b386bfda-4228-4be5-b718-1bd4a43bb5a6", "tag": "5dfd861f-9d99-4555-bfe9-1c8d6b3f537e"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:15:31.687948 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb337179-c170-421e-920e-4ce748917acb service neutron] Pushing event updated for resources: {'Port': ['ID=5dfd861f-9d99-4555-bfe9-1c8d6b3f537e,revision_number=3']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:15:31.709053 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:15:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-16ad85de-91a3-4e59-ae17-0cbabc20cea4 x-openstack-request-id: req-16ad85de-91a3-4e59-ae17-0cbabc20cea4 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:15:31.709411 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b386bfda-4228-4be5-b718-1bd4a43bb5a6", "tag": "5dfd861f-9d99-4555-bfe9-1c8d6b3f537e", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:15:31.709650 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-16ad85de-91a3-4e59-ae17-0cbabc20cea4 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:15:31.710056 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b386bfda-4228-4be5-b718-1bd4a43bb5a6', 'tag': '5dfd861f-9d99-4555-bfe9-1c8d6b3f537e', 'status': 'completed', 'code': 200} Dec 24 05:15:31.723424 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-afdb74e0-949c-4fe4-bc03-e1a848ddaa50 req-86520b0d-3a0e-4a50-851e-5156b064e85e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=84a9183e-c79a-4f14-8b75-aebd4aef7ba8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0620880 Dec 24 05:15:31.769264 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-a42ff366-0a28-4cf5-a797-315abceb97fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:31.770934 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-a42ff366-0a28-4cf5-a797-315abceb97fa service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=fc4cefad8fef403e90ad695e2098ee7b&device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 1096 time: 0.0433762 Dec 24 05:15:31.822135 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-ae81c141-f76f-426e-8a44-e5f82f196788 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5dfd861f-9d99-4555-bfe9-1c8d6b3f537e HTTP/1.1" status: 200 len: 217 time: 0.0348670 Dec 24 05:15:31.875027 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-f7fdeb5a-73e8-4e59-b40e-798094b7820d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:31.876376 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-f7fdeb5a-73e8-4e59-b40e-798094b7820d service neutron] 10.222.0.46 "GET /v2.0/subnets?id=314909f7-3ba5-49d4-a94f-2ebca4c9a707 HTTP/1.1" status: 200 len: 850 time: 0.0469866 Dec 24 05:15:31.924102 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-7e759362-4354-4b41-b94f-b7d2a3ce20be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:31.925723 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-7e759362-4354-4b41-b94f-b7d2a3ce20be service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=075b69cb-c546-4fa5-aa29-49a5b85c94b1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0420699 Dec 24 05:15:32.023583 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-0527d1a2-dc1a-4c9a-b0b2-c323936ad701 service neutron] 10.222.0.46 "GET /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0901694 Dec 24 05:15:32.125219 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ed297dc1-9a4e-4b6b-9a03-a7b957e05d31 req-a2d1dffa-06f4-4469-a39b-a46bb8f83def service neutron] 10.222.0.46 "GET /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0944574 Dec 24 05:15:32.269284 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8342fb50-e7bf-4da3-9d4f-412abf596d34 req-2ff9d982-85e4-4220-8a01-88efd8418ac8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:32.270812 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8342fb50-e7bf-4da3-9d4f-412abf596d34 req-2ff9d982-85e4-4220-8a01-88efd8418ac8 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=fc4cefad8fef403e90ad695e2098ee7b&device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 1096 time: 0.0470107 Dec 24 05:15:32.377152 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8342fb50-e7bf-4da3-9d4f-412abf596d34 req-ab82a12a-c55f-4ef0-8dca-db0d3d5c7b46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:32.378541 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8342fb50-e7bf-4da3-9d4f-412abf596d34 req-ab82a12a-c55f-4ef0-8dca-db0d3d5c7b46 service neutron] 10.222.0.46 "GET /v2.0/networks?id=075b69cb-c546-4fa5-aa29-49a5b85c94b1 HTTP/1.1" status: 200 len: 912 time: 0.1001458 Dec 24 05:15:32.420469 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8342fb50-e7bf-4da3-9d4f-412abf596d34 req-d19d3730-54f5-44f1-8853-c36bdb55e277 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5dfd861f-9d99-4555-bfe9-1c8d6b3f537e HTTP/1.1" status: 200 len: 217 time: 0.0341239 Dec 24 05:15:32.479203 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8342fb50-e7bf-4da3-9d4f-412abf596d34 req-fdb39a60-a95d-4857-8cbe-da20c8ed1b63 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:32.480707 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8342fb50-e7bf-4da3-9d4f-412abf596d34 req-fdb39a60-a95d-4857-8cbe-da20c8ed1b63 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=314909f7-3ba5-49d4-a94f-2ebca4c9a707 HTTP/1.1" status: 200 len: 850 time: 0.0530810 Dec 24 05:15:32.527929 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8342fb50-e7bf-4da3-9d4f-412abf596d34 req-2ad641de-5b8d-40bf-a9d6-4de476597243 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:32.529411 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8342fb50-e7bf-4da3-9d4f-412abf596d34 req-2ad641de-5b8d-40bf-a9d6-4de476597243 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=075b69cb-c546-4fa5-aa29-49a5b85c94b1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0412323 Dec 24 05:15:32.621669 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8342fb50-e7bf-4da3-9d4f-412abf596d34 req-75c476ce-cd51-43c2-8d54-bc5b8c0e7ae8 service neutron] 10.222.0.46 "GET /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0846791 Dec 24 05:15:32.724979 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8342fb50-e7bf-4da3-9d4f-412abf596d34 req-06369f23-3481-4774-88b4-828d5efe9098 service neutron] 10.222.0.46 "GET /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0939205 Dec 24 05:15:32.844877 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bb24fd8-43f0-47c4-a80c-46cf01b5953a req-9612281b-4452-4538-ae3a-b6b6fb5c0a00 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:32.846369 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6bb24fd8-43f0-47c4-a80c-46cf01b5953a req-9612281b-4452-4538-ae3a-b6b6fb5c0a00 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 943 time: 0.0524323 Dec 24 05:15:32.910389 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6bb24fd8-43f0-47c4-a80c-46cf01b5953a req-a5693ef7-5e71-41ca-a016-ee7bed494daa tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=84a9183e-c79a-4f14-8b75-aebd4aef7ba8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0550272 Dec 24 05:15:34.041932 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c149c265-d16d-4b5a-bd25-7d6688f229b7 req-baf4cae2-f5ae-495d-b6df-3d9f73c04ca2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:34.044273 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c149c265-d16d-4b5a-bd25-7d6688f229b7 req-baf4cae2-f5ae-495d-b6df-3d9f73c04ca2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 943 time: 0.0596368 Dec 24 05:15:34.093416 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c149c265-d16d-4b5a-bd25-7d6688f229b7 req-bed96d5b-e5a2-4c7c-ad74-582784b9d59e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=84a9183e-c79a-4f14-8b75-aebd4aef7ba8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427775 Dec 24 05:15:35.219810 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6657bf0-9a20-4a70-bd72-09e41004c732 req-0533a517-13d7-4039-a919-ceca01871e44 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:35.221345 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c6657bf0-9a20-4a70-bd72-09e41004c732 req-0533a517-13d7-4039-a919-ceca01871e44 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 943 time: 0.0501318 Dec 24 05:15:35.270552 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c6657bf0-9a20-4a70-bd72-09e41004c732 req-498e4034-63c2-48f2-b60f-c90bb99b92d3 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=84a9183e-c79a-4f14-8b75-aebd4aef7ba8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405195 Dec 24 05:15:36.406956 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dda870f6-1b10-43ed-8037-f51a61992ff2 req-458c5cd4-68f9-406a-a57c-db6949fff72b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:36.408444 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-dda870f6-1b10-43ed-8037-f51a61992ff2 req-458c5cd4-68f9-406a-a57c-db6949fff72b tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 943 time: 0.0555670 Dec 24 05:15:36.458968 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-dda870f6-1b10-43ed-8037-f51a61992ff2 req-5b4704da-da56-4fe3-adbb-b24fe6832e3c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=84a9183e-c79a-4f14-8b75-aebd4aef7ba8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412138 Dec 24 05:15:36.542246 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 05:15:36.643170 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=5dfd861f-9d99-4555-bfe9-1c8d6b3f537e,segment=NetworkSegment(58060104-31c9-4b9f-ad66-9f4a4de56096),segment_id=58060104-31c9-4b9f-ad66-9f4a4de56096)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:15:36.654288 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': '5dfd861f-9d99-4555-bfe9-1c8d6b3f537e', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'port_id': '5dfd861f-9d99-4555-bfe9-1c8d6b3f537e', 'mac_address': 'fa:16:3e:24:0e:06', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 128, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 05:15:36.690536 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:36.710530 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:15:36.731311 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=5dfd861f-9d99-4555-bfe9-1c8d6b3f537e,segment=NetworkSegment(58060104-31c9-4b9f-ad66-9f4a4de56096),segment_id=58060104-31c9-4b9f-ad66-9f4a4de56096)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:15:36.737914 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:36.788560 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=5dfd861f-9d99-4555-bfe9-1c8d6b3f537e,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:15:36.796039 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:36.796383 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:36.796749 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:36.797081 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:36.797403 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:36.797724 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:36.798041 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:36.798389 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:36.798731 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:36.799114 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:36.799441 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:36.799774 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:36.800083 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:15:37.188171 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['5dfd861f-9d99-4555-bfe9-1c8d6b3f537e'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:15:37.587005 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4bae98e-877e-4020-9553-b7ff9f971e47 req-dc681cbb-1749-4874-8094-2b31dfaa2c3a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:37.588451 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c4bae98e-877e-4020-9553-b7ff9f971e47 req-dc681cbb-1749-4874-8094-2b31dfaa2c3a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 944 time: 0.0550861 Dec 24 05:15:37.643602 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c4bae98e-877e-4020-9553-b7ff9f971e47 req-d814dbcb-d3b6-43df-a325-a2052c12a759 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=84a9183e-c79a-4f14-8b75-aebd4aef7ba8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0490234 Dec 24 05:15:38.573612 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:15:38.633517 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning for port 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e completed by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 24 05:15:38.637716 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:15:38.638122 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:38.717170 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:38.741813 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b386bfda-4228-4be5-b718-1bd4a43bb5a6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5dfd861f-9d99-4555-bfe9-1c8d6b3f537e'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:15:38.744202 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1a586e91-4dd6-4807-ae15-e89d1203a28a" -d '{"events": [{"server_uuid": "b386bfda-4228-4be5-b718-1bd4a43bb5a6", "name": "network-vif-plugged", "status": "completed", "tag": "5dfd861f-9d99-4555-bfe9-1c8d6b3f537e"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:15:38.757045 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=5dfd861f-9d99-4555-bfe9-1c8d6b3f537e,segment=NetworkSegment(58060104-31c9-4b9f-ad66-9f4a4de56096),segment_id=58060104-31c9-4b9f-ad66-9f4a4de56096)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:15:38.762146 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:38.769682 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b69ba77-c5d5-4caa-85e6-6cbe10592f0a req-fdde1569-0886-4d74-af74-88cb7c608d2e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:38.771220 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0b69ba77-c5d5-4caa-85e6-6cbe10592f0a req-fdde1569-0886-4d74-af74-88cb7c608d2e tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 944 time: 0.0530748 Dec 24 05:15:38.790135 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:15:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f8b303a1-84fd-420d-910f-91eaf54fe77f x-openstack-request-id: req-f8b303a1-84fd-420d-910f-91eaf54fe77f {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:15:38.790428 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b386bfda-4228-4be5-b718-1bd4a43bb5a6", "name": "network-vif-plugged", "status": "completed", "tag": "5dfd861f-9d99-4555-bfe9-1c8d6b3f537e", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:15:38.790668 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-f8b303a1-84fd-420d-910f-91eaf54fe77f {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:15:38.791026 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b386bfda-4228-4be5-b718-1bd4a43bb5a6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5dfd861f-9d99-4555-bfe9-1c8d6b3f537e', 'code': 200} Dec 24 05:15:38.817235 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=5dfd861f-9d99-4555-bfe9-1c8d6b3f537e,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:15:38.819999 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0b69ba77-c5d5-4caa-85e6-6cbe10592f0a req-ef5d84a5-50e9-44cb-9415-f596b3006e5d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=84a9183e-c79a-4f14-8b75-aebd4aef7ba8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414836 Dec 24 05:15:39.000786 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7596a36-d463-4602-ac19-671bae45b156 req-81e0a58d-2061-45f3-bc24-d843e247d70d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:39.002271 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a7596a36-d463-4602-ac19-671bae45b156 req-81e0a58d-2061-45f3-bc24-d843e247d70d service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 1098 time: 0.0394690 Dec 24 05:15:39.057236 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a7596a36-d463-4602-ac19-671bae45b156 req-a269cbce-5cb0-4ab5-91a7-be632080bdc1 service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=84a9183e-c79a-4f14-8b75-aebd4aef7ba8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0480688 Dec 24 05:15:39.962848 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31a9156b-6564-4074-bef9-6786a9c9dc61 req-0721a983-0fb7-4856-ad20-7707ef6d35d7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:39.964341 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-31a9156b-6564-4074-bef9-6786a9c9dc61 req-0721a983-0fb7-4856-ad20-7707ef6d35d7 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 945 time: 0.0609069 Dec 24 05:15:40.013277 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-31a9156b-6564-4074-bef9-6786a9c9dc61 req-6fa7d3fb-7806-46a1-9b9e-4c7b83b4767a tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=84a9183e-c79a-4f14-8b75-aebd4aef7ba8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425897 Dec 24 05:15:41.157160 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e15cc35d-e494-48aa-8ac0-ed096ee3cc60 req-3adbf97d-3131-4c21-9905-8a75534bcccf tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:41.158717 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e15cc35d-e494-48aa-8ac0-ed096ee3cc60 req-3adbf97d-3131-4c21-9905-8a75534bcccf tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 945 time: 0.0681796 Dec 24 05:15:41.206888 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e15cc35d-e494-48aa-8ac0-ed096ee3cc60 req-05d84f55-9c54-4d49-9bbb-43080202899f tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=84a9183e-c79a-4f14-8b75-aebd4aef7ba8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420599 Dec 24 05:15:41.328164 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2414a613-783e-4f52-babe-8a79ac2e4b64 req-adcc8c9f-443f-490b-bdba-73d754b15924 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:41.329702 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-2414a613-783e-4f52-babe-8a79ac2e4b64 req-adcc8c9f-443f-490b-bdba-73d754b15924 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 945 time: 0.0592468 Dec 24 05:15:41.338611 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 35096) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:15:41.343727 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-ee9877ed-a307-4b9c-97e4-6c652647e043 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Request body: {'floatingip': {'port_id': '5dfd861f-9d99-4555-bfe9-1c8d6b3f537e'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:15:41.388174 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ee9877ed-a307-4b9c-97e4-6c652647e043 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for floatingip, before_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:41.844904 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ee9877ed-a307-4b9c-97e4-6c652647e043 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:41.850651 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ee9877ed-a307-4b9c-97e4-6c652647e043 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-545804'] for floatingip, after_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:41.947226 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.db.l3_db [None req-ee9877ed-a307-4b9c-97e4-6c652647e043 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Floating IP 2b58567d-79bf-4746-b112-f6010f1f85de associated. External IP: 172.27.1.168, port: 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e. Dec 24 05:15:42.177090 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ee9877ed-a307-4b9c-97e4-6c652647e043 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Router 3e033806-af20-4ee4-8d0e-05f57044dfa3 has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102477) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:15:42.285796 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ee9877ed-a307-4b9c-97e4-6c652647e043 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102477) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:15:42.290920 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ee9877ed-a307-4b9c-97e4-6c652647e043 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for floatingip, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:42.295492 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29e412be-1d67-4531-929a-cd7e76dbe47c None None] Sync routers for ids ['3e033806-af20-4ee4-8d0e-05f57044dfa3'] in dv-cinder-816443-2-iscsi {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:15:42.305592 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29e412be-1d67-4531-929a-cd7e76dbe47c None None] Routers {'3e033806-af20-4ee4-8d0e-05f57044dfa3'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:15:42.306177 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-29e412be-1d67-4531-929a-cd7e76dbe47c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:15:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['3e033806-af20-4ee4-8d0e-05f57044dfa3'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:15:42.323680 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-ee9877ed-a307-4b9c-97e4-6c652647e043 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "PUT /v2.0/floatingips/2b58567d-79bf-4746-b112-f6010f1f85de HTTP/1.1" status: 200 len: 991 time: 0.9814973 Dec 24 05:15:42.323680 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b386bfda-4228-4be5-b718-1bd4a43bb5a6', 'tag': '5dfd861f-9d99-4555-bfe9-1c8d6b3f537e'}] {{(pid=102477) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:15:42.324208 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d3e3d7a262849d185e72ba84ca6adca9bb1fee52649b04b101352e7e29a99ca8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ce5798a4-b0da-438b-99af-49a13b140c4e" -d '{"events": [{"name": "network-changed", "server_uuid": "b386bfda-4228-4be5-b718-1bd4a43bb5a6", "tag": "5dfd861f-9d99-4555-bfe9-1c8d6b3f537e"}]}' {{(pid=102477) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:15:42.363470 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:15:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a7e81089-eec2-4199-af72-8faf4df1b673 x-openstack-request-id: req-a7e81089-eec2-4199-af72-8faf4df1b673 {{(pid=102477) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:15:42.364081 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b386bfda-4228-4be5-b718-1bd4a43bb5a6", "tag": "5dfd861f-9d99-4555-bfe9-1c8d6b3f537e", "status": "completed", "code": 200}]} {{(pid=102477) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:15:42.364081 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-a7e81089-eec2-4199-af72-8faf4df1b673 {{(pid=102477) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:15:42.364563 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b386bfda-4228-4be5-b718-1bd4a43bb5a6', 'tag': '5dfd861f-9d99-4555-bfe9-1c8d6b3f537e', 'status': 'completed', 'code': 200} Dec 24 05:15:42.423539 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-29e412be-1d67-4531-929a-cd7e76dbe47c None None] Set router 3e033806-af20-4ee4-8d0e-05f57044dfa3 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:15:42.459043 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce5798a4-b0da-438b-99af-49a13b140c4e req-49ad0317-ea70-43f0-956d-aea3d0fed21b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:42.460179 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ce5798a4-b0da-438b-99af-49a13b140c4e req-49ad0317-ea70-43f0-956d-aea3d0fed21b service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=fc4cefad8fef403e90ad695e2098ee7b&device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 1098 time: 0.0428820 Dec 24 05:15:42.553591 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce5798a4-b0da-438b-99af-49a13b140c4e req-ae2cb2c5-82bf-490b-8964-b420f604b8ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:42.555096 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ce5798a4-b0da-438b-99af-49a13b140c4e req-ae2cb2c5-82bf-490b-8964-b420f604b8ed service neutron] 10.222.0.46 "GET /v2.0/networks?id=075b69cb-c546-4fa5-aa29-49a5b85c94b1 HTTP/1.1" status: 200 len: 912 time: 0.0866678 Dec 24 05:15:42.621870 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ce5798a4-b0da-438b-99af-49a13b140c4e req-53cb42ce-c3d6-44a5-9dda-2fef97ef599f service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5dfd861f-9d99-4555-bfe9-1c8d6b3f537e HTTP/1.1" status: 200 len: 999 time: 0.0582678 Dec 24 05:15:42.645911 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-29e412be-1d67-4531-929a-cd7e76dbe47c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'name': 'tempest-AttachVolumeTestJSON-1934153865-router', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:46Z', 'revision_number': 4, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'gw_port': {'id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:28:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 591, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': '2b58567d-79bf-4746-b112-f6010f1f85de', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'floating_ip_address': '172.27.1.168', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'port_id': '5dfd861f-9d99-4555-bfe9-1c8d6b3f537e', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 610, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'mac_address': 'fa:16:3e:24:0e:06', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b386bfda-4228-4be5-b718-1bd4a43bb5a6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:15:22Z', 'updated_at': '2021-12-24T05:15:41Z', 'revision_number': 1, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f59ad02b-7d9d-4dc6-8574-27886cacfc47', 'name': '', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'mac_address': 'fa:16:3e:a2:f9:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_interface', 'standard_attr_id': 592, 'fixed_ips': [{'subnet_id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:46Z', 'updated_at': '2021-12-24T05:10:49Z', 'revision_number': 5, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'subnets': [{'id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:15:42.671755 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29e412be-1d67-4531-929a-cd7e76dbe47c None None] Checking router: 3e033806-af20-4ee4-8d0e-05f57044dfa3 for host: dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:15:42.674394 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce5798a4-b0da-438b-99af-49a13b140c4e req-9ee4f6b1-c442-4e14-a14b-7b0ceba03602 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:42.675871 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ce5798a4-b0da-438b-99af-49a13b140c4e req-9ee4f6b1-c442-4e14-a14b-7b0ceba03602 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=314909f7-3ba5-49d4-a94f-2ebca4c9a707 HTTP/1.1" status: 200 len: 850 time: 0.0475681 Dec 24 05:15:42.680346 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29e412be-1d67-4531-929a-cd7e76dbe47c None None] Routers {'3e033806-af20-4ee4-8d0e-05f57044dfa3'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:15:42.680959 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-29e412be-1d67-4531-929a-cd7e76dbe47c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:15:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['3e033806-af20-4ee4-8d0e-05f57044dfa3'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:15:42.722609 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce5798a4-b0da-438b-99af-49a13b140c4e req-44c88b8b-1e8e-40f3-a5f2-8e1c5bd8e24e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:15:42.724052 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ce5798a4-b0da-438b-99af-49a13b140c4e req-44c88b8b-1e8e-40f3-a5f2-8e1c5bd8e24e service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=075b69cb-c546-4fa5-aa29-49a5b85c94b1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0412290 Dec 24 05:15:42.784234 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-29e412be-1d67-4531-929a-cd7e76dbe47c None None] Set router 3e033806-af20-4ee4-8d0e-05f57044dfa3 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:15:42.816814 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ce5798a4-b0da-438b-99af-49a13b140c4e req-3598add6-cd36-4e83-a764-fba39bb537b6 service neutron] 10.222.0.46 "GET /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844700 Dec 24 05:15:42.910064 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ce5798a4-b0da-438b-99af-49a13b140c4e req-9c8f0855-deb3-4380-857e-3ce5686cc7c8 service neutron] 10.222.0.46 "GET /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0859222 Dec 24 05:15:43.007652 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-29e412be-1d67-4531-929a-cd7e76dbe47c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'name': 'tempest-AttachVolumeTestJSON-1934153865-router', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:46Z', 'revision_number': 4, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'gw_port': {'id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:28:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 591, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': '2b58567d-79bf-4746-b112-f6010f1f85de', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'floating_ip_address': '172.27.1.168', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'port_id': '5dfd861f-9d99-4555-bfe9-1c8d6b3f537e', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 610, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'mac_address': 'fa:16:3e:24:0e:06', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b386bfda-4228-4be5-b718-1bd4a43bb5a6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:15:22Z', 'updated_at': '2021-12-24T05:15:41Z', 'revision_number': 1, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f59ad02b-7d9d-4dc6-8574-27886cacfc47', 'name': '', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'mac_address': 'fa:16:3e:a2:f9:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_interface', 'standard_attr_id': 592, 'fixed_ips': [{'subnet_id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:46Z', 'updated_at': '2021-12-24T05:10:49Z', 'revision_number': 5, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'subnets': [{'id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:15:43.036778 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29e412be-1d67-4531-929a-cd7e76dbe47c None None] The sync data for ids ['3e033806-af20-4ee4-8d0e-05f57044dfa3'] in dv-cinder-816443-2-iscsi is: [{'id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'name': 'tempest-AttachVolumeTestJSON-1934153865-router', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:46Z', 'revision_number': 4, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'gw_port': {'id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:28:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 591, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': '2b58567d-79bf-4746-b112-f6010f1f85de', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'floating_ip_address': '172.27.1.168', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'port_id': '5dfd861f-9d99-4555-bfe9-1c8d6b3f537e', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 610, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'mac_address': 'fa:16:3e:24:0e:06', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b386bfda-4228-4be5-b718-1bd4a43bb5a6', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:15:22Z', 'updated_at': '2021-12-24T05:15:41Z', 'revision_number': 1, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f59ad02b-7d9d-4dc6-8574-27886cacfc47', 'name': '', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'mac_address': 'fa:16:3e:a2:f9:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_interface', 'standard_attr_id': 592, 'fixed_ips': [{'subnet_id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:46Z', 'updated_at': '2021-12-24T05:10:49Z', 'revision_number': 5, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'subnets': [{'id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:15:43.231561 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dae7763f-199f-4f00-994d-313b5153e818 None None] New status for floating IP 2b58567d-79bf-4746-b112-f6010f1f85de: ACTIVE {{(pid=102478) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 24 05:15:50.558410 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:53.225468 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-046270af-a3c4-4450-9454-8a4c729f6ae2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:55.310670 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-64676046-8d06-4f4b-a2e2-ad604881dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:56.554668 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:57.993291 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:15:58.590110 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:16:06.468580 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:16:20.562827 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:16:23.226366 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-98a05386-33f2-4135-9e0f-9478c0f2c875 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:16:25.312338 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e38a9fb0-b26a-4525-b254-9bbed930e9de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:16:26.556755 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:16:28.005672 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:16:28.591196 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:16:34.236291 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a23771c3-aec0-43f9-890d-d060ec2fc376 req-39a03c83-edb4-4eb4-9b9d-2968016c9a2e service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0426037 Dec 24 05:16:34.349140 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a23771c3-aec0-43f9-890d-d060ec2fc376 req-937534ab-74f4-4273-b41c-22ac7d41e601 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:16:34.350550 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a23771c3-aec0-43f9-890d-d060ec2fc376 req-937534ab-74f4-4273-b41c-22ac7d41e601 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=fc4cefad8fef403e90ad695e2098ee7b&device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 1098 time: 0.0528641 Dec 24 05:16:34.456767 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a23771c3-aec0-43f9-890d-d060ec2fc376 req-2c049c38-8574-4753-8204-4f48ab4cc291 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:16:34.458585 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a23771c3-aec0-43f9-890d-d060ec2fc376 req-2c049c38-8574-4753-8204-4f48ab4cc291 service neutron] 10.222.0.46 "GET /v2.0/networks?id=075b69cb-c546-4fa5-aa29-49a5b85c94b1 HTTP/1.1" status: 200 len: 912 time: 0.0871449 Dec 24 05:16:34.534039 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a23771c3-aec0-43f9-890d-d060ec2fc376 req-ff50077e-bb66-4a9f-83af-f3798331f11d service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5dfd861f-9d99-4555-bfe9-1c8d6b3f537e HTTP/1.1" status: 200 len: 1001 time: 0.0674250 Dec 24 05:16:34.591947 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a23771c3-aec0-43f9-890d-d060ec2fc376 req-3a516da5-dfc0-40b5-a35b-6e158acb51bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:16:34.594090 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a23771c3-aec0-43f9-890d-d060ec2fc376 req-3a516da5-dfc0-40b5-a35b-6e158acb51bb service neutron] 10.222.0.46 "GET /v2.0/subnets?id=314909f7-3ba5-49d4-a94f-2ebca4c9a707 HTTP/1.1" status: 200 len: 850 time: 0.0518417 Dec 24 05:16:34.652093 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a23771c3-aec0-43f9-890d-d060ec2fc376 req-1f254ca2-6946-4406-b23d-c0c57685fae8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:16:34.653586 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a23771c3-aec0-43f9-890d-d060ec2fc376 req-1f254ca2-6946-4406-b23d-c0c57685fae8 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=075b69cb-c546-4fa5-aa29-49a5b85c94b1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0505025 Dec 24 05:16:34.758110 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a23771c3-aec0-43f9-890d-d060ec2fc376 req-9bc81baa-5bb9-4e67-8c59-9c2711ae7a9f service neutron] 10.222.0.46 "GET /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0971377 Dec 24 05:16:34.848658 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a23771c3-aec0-43f9-890d-d060ec2fc376 req-a54311bd-1d68-48bc-9081-fe9c64513581 service neutron] 10.222.0.46 "GET /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829866 Dec 24 05:16:43.472394 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:16:50.566475 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:16:53.229598 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b26dddf7-1c3c-4fb6-a2c2-d1bf6ca0b860 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:16:55.312449 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8cb1dc18-5e1e-40a4-ab29-bb9906136696 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:16:56.556275 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:16:58.004218 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:16:58.590896 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:18.521471 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c9bdad5-a781-42fa-92e1-3ebbeb96bfdd req-b78c9bae-d67d-4dec-bb40-da3f3efc9ac5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:17:18.523015 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3c9bdad5-a781-42fa-92e1-3ebbeb96bfdd req-b78c9bae-d67d-4dec-bb40-da3f3efc9ac5 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 945 time: 0.0551963 Dec 24 05:17:18.576629 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3c9bdad5-a781-42fa-92e1-3ebbeb96bfdd req-30260e56-9f62-4bf7-8048-0b0fe5397574 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=84a9183e-c79a-4f14-8b75-aebd4aef7ba8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474625 Dec 24 05:17:19.708616 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-032bf5e6-8e03-49f0-b3dc-a6d5661f4e44 req-49f54819-f1df-40d9-910b-223c79e8a912 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:17:19.710067 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-032bf5e6-8e03-49f0-b3dc-a6d5661f4e44 req-49f54819-f1df-40d9-910b-223c79e8a912 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 945 time: 0.0497561 Dec 24 05:17:19.762610 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-032bf5e6-8e03-49f0-b3dc-a6d5661f4e44 req-ba2773d7-ce7f-4b12-9580-11ffa80c749c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=84a9183e-c79a-4f14-8b75-aebd4aef7ba8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447714 Dec 24 05:17:20.477182 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:17:20.563218 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f454788-d131-4df9-927d-acd323fffb03 req-56395a17-4627-4c0a-8316-b44fb645114c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:17:20.564918 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6f454788-d131-4df9-927d-acd323fffb03 req-56395a17-4627-4c0a-8316-b44fb645114c tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.46 "GET /v2.0/ports?device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 945 time: 0.0509036 Dec 24 05:17:20.566133 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:20.658224 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-6f454788-d131-4df9-927d-acd323fffb03 req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Deleting port 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:17:20.658466 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6f454788-d131-4df9-927d-acd323fffb03 req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:20.755019 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-6f454788-d131-4df9-927d-acd323fffb03 req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] For port 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=5dfd861f-9d99-4555-bfe9-1c8d6b3f537e,segment=NetworkSegment(58060104-31c9-4b9f-ad66-9f4a4de56096),segment_id=58060104-31c9-4b9f-ad66-9f4a4de56096)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:17:20.755761 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6f454788-d131-4df9-927d-acd323fffb03 req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:20.880565 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a56d59d8-b411-4f5d-b367-55caa06e6103 req-affb0f6b-8c22-4816-8de9-f5da75fcd6e2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:17:20.882031 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a56d59d8-b411-4f5d-b367-55caa06e6103 req-affb0f6b-8c22-4816-8de9-f5da75fcd6e2 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 945 time: 0.0511653 Dec 24 05:17:20.931186 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a56d59d8-b411-4f5d-b367-55caa06e6103 req-4867f2a5-09e0-44d8-8f39-ddf411aae880 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups?id=84a9183e-c79a-4f14-8b75-aebd4aef7ba8&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427620 Dec 24 05:17:20.937466 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6f454788-d131-4df9-927d-acd323fffb03 req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:20.937830 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6f454788-d131-4df9-927d-acd323fffb03 req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-545804'] for floatingip, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:20.938140 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.l3_db [req-6f454788-d131-4df9-927d-acd323fffb03 req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Floating IP 2b58567d-79bf-4746-b112-f6010f1f85de disassociated. External IP: 172.27.1.168, port: 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e. Dec 24 05:17:20.938479 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-6f454788-d131-4df9-927d-acd323fffb03 req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling delete_port for 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e owned by compute:nova {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:17:21.083528 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6f454788-d131-4df9-927d-acd323fffb03 req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:21.109742 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Pushing event deleted for resources: {'Port': ['ID=5dfd861f-9d99-4555-bfe9-1c8d6b3f537e,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:21.122989 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:21.122989 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:21.122989 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:21.123272 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:21.123542 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:21.123870 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:21.124190 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:21.124515 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:21.124840 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:21.125188 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:21.125508 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:21.125822 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:21.126141 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:21.240673 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [req-6f454788-d131-4df9-927d-acd323fffb03 req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Router 3e033806-af20-4ee4-8d0e-05f57044dfa3 has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102476) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:17:21.632950 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-6f454788-d131-4df9-927d-acd323fffb03 req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:17:21.643315 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c878f30-9d49-48c8-a311-9da6c9edea97 None None] Sync routers for ids ['3e033806-af20-4ee4-8d0e-05f57044dfa3'] in dv-cinder-816443-2-iscsi {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:17:21.654035 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c878f30-9d49-48c8-a311-9da6c9edea97 None None] Routers {'3e033806-af20-4ee4-8d0e-05f57044dfa3'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:17:21.654624 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-1c878f30-9d49-48c8-a311-9da6c9edea97 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:16:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['3e033806-af20-4ee4-8d0e-05f57044dfa3'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:17:21.671554 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-6f454788-d131-4df9-927d-acd323fffb03 req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] No DVR routers for this DVR port 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e on host hv-cinder-81644 {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:17:21.674335 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-6f454788-d131-4df9-927d-acd323fffb03 req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:21.677864 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-6f454788-d131-4df9-927d-acd323fffb03 req-2fab20ad-6455-4402-b291-b9e91a110f78 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.46 "DELETE /v2.0/ports/5dfd861f-9d99-4555-bfe9-1c8d6b3f537e HTTP/1.1" status: 204 len: 173 time: 1.1066480 Dec 24 05:17:21.678352 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b386bfda-4228-4be5-b718-1bd4a43bb5a6', 'name': 'network-vif-deleted', 'tag': '5dfd861f-9d99-4555-bfe9-1c8d6b3f537e'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:17:21.680592 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ba18baab-4b4e-4e2f-9768-06699147b33d" -d '{"events": [{"server_uuid": "b386bfda-4228-4be5-b718-1bd4a43bb5a6", "name": "network-vif-deleted", "tag": "5dfd861f-9d99-4555-bfe9-1c8d6b3f537e"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:17:21.764589 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-1c878f30-9d49-48c8-a311-9da6c9edea97 None None] Set router 3e033806-af20-4ee4-8d0e-05f57044dfa3 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:17:21.793314 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:17:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-31c3d2ba-2026-4fb5-a65a-8c19e74f69f4 x-openstack-request-id: req-31c3d2ba-2026-4fb5-a65a-8c19e74f69f4 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:17:21.793831 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b386bfda-4228-4be5-b718-1bd4a43bb5a6", "name": "network-vif-deleted", "tag": "5dfd861f-9d99-4555-bfe9-1c8d6b3f537e", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:17:21.793831 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-31c3d2ba-2026-4fb5-a65a-8c19e74f69f4 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:17:21.794234 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b386bfda-4228-4be5-b718-1bd4a43bb5a6', 'name': 'network-vif-deleted', 'tag': '5dfd861f-9d99-4555-bfe9-1c8d6b3f537e', 'status': 'completed', 'code': 200} Dec 24 05:17:22.034576 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-311fa660-22d0-436d-8e4b-d0d06bcddaa9 req-6b671082-6862-4d36-8a8f-36094c38003d tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/ports?device_id=b386bfda-4228-4be5-b718-1bd4a43bb5a6 HTTP/1.1" status: 200 len: 210 time: 0.0258667 Dec 24 05:17:22.061355 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-1c878f30-9d49-48c8-a311-9da6c9edea97 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'name': 'tempest-AttachVolumeTestJSON-1934153865-router', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:46Z', 'revision_number': 4, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'gw_port': {'id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:28:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 591, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': 'f59ad02b-7d9d-4dc6-8574-27886cacfc47', 'name': '', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'mac_address': 'fa:16:3e:a2:f9:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_interface', 'standard_attr_id': 592, 'fixed_ips': [{'subnet_id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:46Z', 'updated_at': '2021-12-24T05:10:49Z', 'revision_number': 5, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'subnets': [{'id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:17:22.087847 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c878f30-9d49-48c8-a311-9da6c9edea97 None None] Checking router: 3e033806-af20-4ee4-8d0e-05f57044dfa3 for host: dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:17:22.096031 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c878f30-9d49-48c8-a311-9da6c9edea97 None None] Routers {'3e033806-af20-4ee4-8d0e-05f57044dfa3'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:17:22.096652 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-1c878f30-9d49-48c8-a311-9da6c9edea97 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:16:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['3e033806-af20-4ee4-8d0e-05f57044dfa3'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:17:22.201020 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-1c878f30-9d49-48c8-a311-9da6c9edea97 None None] Set router 3e033806-af20-4ee4-8d0e-05f57044dfa3 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:17:22.397233 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-1c878f30-9d49-48c8-a311-9da6c9edea97 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'name': 'tempest-AttachVolumeTestJSON-1934153865-router', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:46Z', 'revision_number': 4, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'gw_port': {'id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:28:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 591, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': 'f59ad02b-7d9d-4dc6-8574-27886cacfc47', 'name': '', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'mac_address': 'fa:16:3e:a2:f9:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_interface', 'standard_attr_id': 592, 'fixed_ips': [{'subnet_id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:46Z', 'updated_at': '2021-12-24T05:10:49Z', 'revision_number': 5, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'subnets': [{'id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:17:22.431497 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c878f30-9d49-48c8-a311-9da6c9edea97 None None] The sync data for ids ['3e033806-af20-4ee4-8d0e-05f57044dfa3'] in dv-cinder-816443-2-iscsi is: [{'id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'name': 'tempest-AttachVolumeTestJSON-1934153865-router', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:46Z', 'revision_number': 4, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'gw_port': {'id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:28:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 591, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': 'f59ad02b-7d9d-4dc6-8574-27886cacfc47', 'name': '', 'network_id': '075b69cb-c546-4fa5-aa29-49a5b85c94b1', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'mac_address': 'fa:16:3e:a2:f9:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_interface', 'standard_attr_id': 592, 'fixed_ips': [{'subnet_id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:46Z', 'updated_at': '2021-12-24T05:10:49Z', 'revision_number': 5, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'subnets': [{'id': '314909f7-3ba5-49d4-a94f-2ebca4c9a707', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:17:22.648904 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb0726a3-4efa-4312-ace8-290214985afc None None] New status for floating IP 2b58567d-79bf-4746-b112-f6010f1f85de: DOWN {{(pid=102478) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 24 05:17:23.129642 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 35378) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:23.184556 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c6a84536-a098-4642-a06b-0efe18190620 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:23.209879 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c6a84536-a098-4642-a06b-0efe18190620 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:23.224629 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-32172e71-e9cc-4edc-8a65-ca9f0c23fc25 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:23.262730 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c6a84536-a098-4642-a06b-0efe18190620 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:23.265364 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c6a84536-a098-4642-a06b-0efe18190620 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:23.266513 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-c6a84536-a098-4642-a06b-0efe18190620 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "DELETE /v2.0/security-groups/84a9183e-c79a-4f14-8b75-aebd4aef7ba8 HTTP/1.1" status: 204 len: 168 time: 0.1358831 Dec 24 05:17:23.269725 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 35380) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:23.275954 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6a84536-a098-4642-a06b-0efe18190620 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=84a9183e-c79a-4f14-8b75-aebd4aef7ba8,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:23.283027 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a84536-a098-4642-a06b-0efe18190620 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:23.283308 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.api.v2.resource [None req-8e4b7799-0e86-4df6-b2c9-956712aa2bdf tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] show failed (client error): The resource could not be found. Dec 24 05:17:23.283460 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a84536-a098-4642-a06b-0efe18190620 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:23.283706 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a84536-a098-4642-a06b-0efe18190620 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:23.284043 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a84536-a098-4642-a06b-0efe18190620 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:23.284281 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-8e4b7799-0e86-4df6-b2c9-956712aa2bdf tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "GET /v2.0/security-groups/84a9183e-c79a-4f14-8b75-aebd4aef7ba8 HTTP/1.1" status: 404 len: 347 time: 0.0135489 Dec 24 05:17:23.284485 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a84536-a098-4642-a06b-0efe18190620 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:23.284714 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a84536-a098-4642-a06b-0efe18190620 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:23.285037 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a84536-a098-4642-a06b-0efe18190620 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:23.285360 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a84536-a098-4642-a06b-0efe18190620 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:23.285681 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a84536-a098-4642-a06b-0efe18190620 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:23.286002 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a84536-a098-4642-a06b-0efe18190620 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:23.286320 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a84536-a098-4642-a06b-0efe18190620 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:23.286634 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a84536-a098-4642-a06b-0efe18190620 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:23.286948 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6a84536-a098-4642-a06b-0efe18190620 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:23.287158 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 35382) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:23.360081 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [req-a6afb449-6d9a-401b-b762-27300b29c53b req-89f33b57-c3d8-4006-8406-9cc84b4e994c service neutron] (102476) timed out ('10.222.0.46', 62344) {{(pid=102476) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 24 05:17:23.408433 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-c51c694d-2115-4c98-ac1e-4bf227975961 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Deleting port 31df7585-2560-489b-8b06-2ffd3a2a2887 {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:17:23.408724 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c51c694d-2115-4c98-ac1e-4bf227975961 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:23.486469 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c51c694d-2115-4c98-ac1e-4bf227975961 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:23.486745 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c51c694d-2115-4c98-ac1e-4bf227975961 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:23.498565 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-c51c694d-2115-4c98-ac1e-4bf227975961 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Calling delete_port for 31df7585-2560-489b-8b06-2ffd3a2a2887 owned by network:floatingip {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:17:23.652262 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c51c694d-2115-4c98-ac1e-4bf227975961 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:23.676315 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c51c694d-2115-4c98-ac1e-4bf227975961 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Pushing event deleted for resources: {'Port': ['ID=31df7585-2560-489b-8b06-2ffd3a2a2887,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:23.737003 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c51c694d-2115-4c98-ac1e-4bf227975961 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks [] for floatingip, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:23.739496 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c51c694d-2115-4c98-ac1e-4bf227975961 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for floatingip, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:23.740663 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-c51c694d-2115-4c98-ac1e-4bf227975961 tempest-AttachVolumeTestJSON-1436547220 tempest-AttachVolumeTestJSON-1436547220-project] 10.222.0.43 "DELETE /v2.0/floatingips/2b58567d-79bf-4746-b112-f6010f1f85de HTTP/1.1" status: 204 len: 168 time: 0.4525630 Dec 24 05:17:25.109876 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:17:25.131876 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] No Port match for: 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:17:25.132218 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 5dfd861f-9d99-4555-bfe9-1c8d6b3f537e not bound to the agent host hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:17:25.306408 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-723d6143-f668-4b69-9b72-c5ab588ac8bd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:26.552894 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:27.334373 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 35410) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:27.790843 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7e188835-8b0d-415a-9880-e89808e0f44c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-548364'] for router_interface, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:28.004325 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:28.055531 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-7e188835-8b0d-415a-9880-e89808e0f44c admin admin] Deleting port f59ad02b-7d9d-4dc6-8574-27886cacfc47 {{(pid=102477) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:17:28.055899 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7e188835-8b0d-415a-9880-e89808e0f44c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:28.134072 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.db [None req-7e188835-8b0d-415a-9880-e89808e0f44c admin admin] For port f59ad02b-7d9d-4dc6-8574-27886cacfc47, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=f59ad02b-7d9d-4dc6-8574-27886cacfc47,segment=NetworkSegment(58060104-31c9-4b9f-ad66-9f4a4de56096),segment_id=58060104-31c9-4b9f-ad66-9f4a4de56096)] {{(pid=102477) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:17:28.134462 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7e188835-8b0d-415a-9880-e89808e0f44c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:28.150293 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-7e188835-8b0d-415a-9880-e89808e0f44c admin admin] Calling delete_port for f59ad02b-7d9d-4dc6-8574-27886cacfc47 owned by network:router_interface {{(pid=102477) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:17:28.337013 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7e188835-8b0d-415a-9880-e89808e0f44c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:28.360093 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e188835-8b0d-415a-9880-e89808e0f44c admin admin] Pushing event deleted for resources: {'Port': ['ID=f59ad02b-7d9d-4dc6-8574-27886cacfc47,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:28.587892 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:28.764536 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7e188835-8b0d-415a-9880-e89808e0f44c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-627465', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-548448'] for router_interface, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:28.990248 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7e188835-8b0d-415a-9880-e89808e0f44c admin admin] Router 3e033806-af20-4ee4-8d0e-05f57044dfa3 has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102477) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:17:29.098071 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7e188835-8b0d-415a-9880-e89808e0f44c admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102477) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:17:29.103461 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-7e188835-8b0d-415a-9880-e89808e0f44c admin admin] 10.222.0.43 "PUT /v2.0/routers/3e033806-af20-4ee4-8d0e-05f57044dfa3/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7680740 Dec 24 05:17:29.106616 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 35414) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:29.107393 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4249e01-f236-4488-bed3-fab78b639822 None None] Sync routers for ids ['3e033806-af20-4ee4-8d0e-05f57044dfa3'] in dv-cinder-816443-2-iscsi {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:17:29.121706 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4249e01-f236-4488-bed3-fab78b639822 None None] Routers {'3e033806-af20-4ee4-8d0e-05f57044dfa3'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:17:29.122241 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-f4249e01-f236-4488-bed3-fab78b639822 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:17:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['3e033806-af20-4ee4-8d0e-05f57044dfa3'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:17:29.217822 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-014a0dc1-5747-415e-811a-54b6b259f60b admin admin] Publish callbacks [] for router, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:29.232937 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-f4249e01-f236-4488-bed3-fab78b639822 None None] Set router 3e033806-af20-4ee4-8d0e-05f57044dfa3 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:17:29.318224 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-014a0dc1-5747-415e-811a-54b6b259f60b admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:29.375976 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-014a0dc1-5747-415e-811a-54b6b259f60b admin admin] Deleting port 69bfb4cb-d5e2-40de-abc0-2609f75b29ca {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:17:29.376221 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-014a0dc1-5747-415e-811a-54b6b259f60b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:29.415347 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-f4249e01-f236-4488-bed3-fab78b639822 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'name': 'tempest-AttachVolumeTestJSON-1934153865-router', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:17:28Z', 'revision_number': 5, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'gw_port': {'id': '69bfb4cb-d5e2-40de-abc0-2609f75b29ca', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:28:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 591, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:10:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:17:29.445613 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4249e01-f236-4488-bed3-fab78b639822 None None] Checking router: 3e033806-af20-4ee4-8d0e-05f57044dfa3 for host: dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:17:29.454869 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [None req-014a0dc1-5747-415e-811a-54b6b259f60b admin admin] For port 69bfb4cb-d5e2-40de-abc0-2609f75b29ca, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=69bfb4cb-d5e2-40de-abc0-2609f75b29ca,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:17:29.455078 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4249e01-f236-4488-bed3-fab78b639822 None None] Routers {'3e033806-af20-4ee4-8d0e-05f57044dfa3'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:17:29.455184 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-014a0dc1-5747-415e-811a-54b6b259f60b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:29.455482 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-f4249e01-f236-4488-bed3-fab78b639822 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:17:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['3e033806-af20-4ee4-8d0e-05f57044dfa3'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:17:29.467311 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-014a0dc1-5747-415e-811a-54b6b259f60b admin admin] Calling delete_port for 69bfb4cb-d5e2-40de-abc0-2609f75b29ca owned by network:router_gateway {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:17:29.540158 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-f4249e01-f236-4488-bed3-fab78b639822 None None] Set router 3e033806-af20-4ee4-8d0e-05f57044dfa3 gateway port host: None {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:17:29.592567 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-f4249e01-f236-4488-bed3-fab78b639822 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'name': 'tempest-AttachVolumeTestJSON-1934153865-router', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:17:29Z', 'revision_number': 6, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'gw_port_host': None}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:17:29.621949 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f4249e01-f236-4488-bed3-fab78b639822 None None] The sync data for ids ['3e033806-af20-4ee4-8d0e-05f57044dfa3'] in dv-cinder-816443-2-iscsi is: [{'id': '3e033806-af20-4ee4-8d0e-05f57044dfa3', 'name': 'tempest-AttachVolumeTestJSON-1934153865-router', 'tenant_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:10:44Z', 'updated_at': '2021-12-24T05:17:29Z', 'revision_number': 6, 'project_id': 'fc4cefad8fef403e90ad695e2098ee7b', 'gw_port_host': None}] {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:17:29.638085 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-014a0dc1-5747-415e-811a-54b6b259f60b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:29.666465 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-014a0dc1-5747-415e-811a-54b6b259f60b admin admin] Pushing event deleted for resources: {'Port': ['ID=69bfb4cb-d5e2-40de-abc0-2609f75b29ca,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:29.728597 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-014a0dc1-5747-415e-811a-54b6b259f60b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-545986'] for router_gateway, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:29.814037 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-014a0dc1-5747-415e-811a-54b6b259f60b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-546088', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2070312'] for router, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:29.816341 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-014a0dc1-5747-415e-811a-54b6b259f60b admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:29.863375 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-014a0dc1-5747-415e-811a-54b6b259f60b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-546081'] for router, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:29.864207 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-014a0dc1-5747-415e-811a-54b6b259f60b admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3e033806-af20-4ee4-8d0e-05f57044dfa3 {{(pid=102476) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 24 05:17:29.870371 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-014a0dc1-5747-415e-811a-54b6b259f60b admin admin] Publish callbacks [] for router, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:29.871896 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-014a0dc1-5747-415e-811a-54b6b259f60b admin admin] 10.222.0.43 "DELETE /v2.0/routers/3e033806-af20-4ee4-8d0e-05f57044dfa3 HTTP/1.1" status: 204 len: 168 time: 0.7643335 Dec 24 05:17:29.874797 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 35416) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:29.923421 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_v2 [None req-6f47cf1a-da3e-4590-9807-8655e7415d05 admin admin] Deleting subnet 314909f7-3ba5-49d4-a94f-2ebca4c9a707 {{(pid=102476) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Dec 24 05:17:29.926696 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6f47cf1a-da3e-4590-9807-8655e7415d05 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:29.965804 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6f47cf1a-da3e-4590-9807-8655e7415d05 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-32509714'] for subnet, precommit_delete_associations {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:30.048191 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6f47cf1a-da3e-4590-9807-8655e7415d05 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3590439'] for subnet, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:30.103846 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6f47cf1a-da3e-4590-9807-8655e7415d05 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3590440', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-32528482', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-32970397'] for subnet, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:30.128155 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f47cf1a-da3e-4590-9807-8655e7415d05 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=314909f7-3ba5-49d4-a94f-2ebca4c9a707,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:30.132150 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6f47cf1a-da3e-4590-9807-8655e7415d05 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:30.135352 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-6f47cf1a-da3e-4590-9807-8655e7415d05 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/314909f7-3ba5-49d4-a94f-2ebca4c9a707 HTTP/1.1" status: 204 len: 168 time: 0.2593303 Dec 24 05:17:30.138403 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 35418) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:30.141192 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e5d9ca2-77b3-4df0-b34d-1f90fe6b7478 None None] Network 075b69cb-c546-4fa5-aa29-49a5b85c94b1 requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:17:30.208638 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1ebc3e4f-7f4f-4287-88c1-280ad0cfd8bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3741433'] for network, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:30.262916 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-1ebc3e4f-7f4f-4287-88c1-280ad0cfd8bb admin admin] Deleting port 10ca479f-d446-4321-95f5-b3659a965554 {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:17:30.263257 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1ebc3e4f-7f4f-4287-88c1-280ad0cfd8bb admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:30.330221 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [None req-1ebc3e4f-7f4f-4287-88c1-280ad0cfd8bb admin admin] For port 10ca479f-d446-4321-95f5-b3659a965554, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=10ca479f-d446-4321-95f5-b3659a965554,segment=NetworkSegment(58060104-31c9-4b9f-ad66-9f4a4de56096),segment_id=58060104-31c9-4b9f-ad66-9f4a4de56096)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:17:30.330551 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1ebc3e4f-7f4f-4287-88c1-280ad0cfd8bb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:30.347223 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-1ebc3e4f-7f4f-4287-88c1-280ad0cfd8bb admin admin] Calling delete_port for 10ca479f-d446-4321-95f5-b3659a965554 owned by network:dhcp {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:17:30.364736 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d317f6ff-ad08-453c-a13e-264801ae5e18 None None] DHCP port deletion for 075b69cb-c546-4fa5-aa29-49a5b85c94b1 request from dv-cinder-816443-2-iscsi {{(pid=102478) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 24 05:17:30.424663 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device f59ad02b-7d9d-4dc6-8574-27886cacfc47 no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:17:30.428050 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-d317f6ff-ad08-453c-a13e-264801ae5e18 None None] Deleting port 10ca479f-d446-4321-95f5-b3659a965554 {{(pid=102478) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:17:30.428425 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-d317f6ff-ad08-453c-a13e-264801ae5e18 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:30.437236 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1ebc3e4f-7f4f-4287-88c1-280ad0cfd8bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:30.456156 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: f59ad02b-7d9d-4dc6-8574-27886cacfc47 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:17:30.456505 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device f59ad02b-7d9d-4dc6-8574-27886cacfc47 not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:17:30.456965 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 10ca479f-d446-4321-95f5-b3659a965554 no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:17:30.463318 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ebc3e4f-7f4f-4287-88c1-280ad0cfd8bb admin admin] Pushing event deleted for resources: {'Port': ['ID=10ca479f-d446-4321-95f5-b3659a965554,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:30.469433 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ebc3e4f-7f4f-4287-88c1-280ad0cfd8bb admin admin] No DVR routers for this DVR port 10ca479f-d446-4321-95f5-b3659a965554 on host dv-cinder-816443-2-iscsi {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:17:30.488956 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: 10ca479f-d446-4321-95f5-b3659a965554 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:17:30.489328 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 10ca479f-d446-4321-95f5-b3659a965554 not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:17:30.489754 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 69bfb4cb-d5e2-40de-abc0-2609f75b29ca no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:17:30.536590 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: 69bfb4cb-d5e2-40de-abc0-2609f75b29ca {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:17:30.536937 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 69bfb4cb-d5e2-40de-abc0-2609f75b29ca not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:17:30.547533 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1ebc3e4f-7f4f-4287-88c1-280ad0cfd8bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3595960', 'neutron.services.segments.db._delete_segments_for_network-8750577966942'] for network, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:30.549904 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-d317f6ff-ad08-453c-a13e-264801ae5e18 None None] For port 10ca479f-d446-4321-95f5-b3659a965554, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=10ca479f-d446-4321-95f5-b3659a965554,segment=NetworkSegment(58060104-31c9-4b9f-ad66-9f4a4de56096),segment_id=58060104-31c9-4b9f-ad66-9f4a4de56096)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:17:30.550285 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-d317f6ff-ad08-453c-a13e-264801ae5e18 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:30.563896 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-d317f6ff-ad08-453c-a13e-264801ae5e18 None None] Calling delete_port for 10ca479f-d446-4321-95f5-b3659a965554 owned by network:dhcp {{(pid=102478) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:17:30.571635 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-1ebc3e4f-7f4f-4287-88c1-280ad0cfd8bb admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['075b69cb-c546-4fa5-aa29-49a5b85c94b1']}} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:17:30.584698 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-1ebc3e4f-7f4f-4287-88c1-280ad0cfd8bb admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '58060104-31c9-4b9f-ad66-9f4a4de56096') {'for_net_delete': True} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:17:30.584996 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-1ebc3e4f-7f4f-4287-88c1-280ad0cfd8bb admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '58060104-31c9-4b9f-ad66-9f4a4de56096') {} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:17:30.595353 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1ebc3e4f-7f4f-4287-88c1-280ad0cfd8bb admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750577970535', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-32509733'] for segment, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:30.609877 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1ebc3e4f-7f4f-4287-88c1-280ad0cfd8bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:30.616463 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1ebc3e4f-7f4f-4287-88c1-280ad0cfd8bb admin admin] Releasing vlan 128 on physical network physnet1 to pool {{(pid=102476) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 24 05:17:30.616900 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1ebc3e4f-7f4f-4287-88c1-280ad0cfd8bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-32528320'] for segment, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: Traceback (most recent call last): Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: timer() Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: cb(*args, **kw) Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: return func(*args, **kwargs) Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: self._notify() Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: self.callback(batched_events) Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: event.method(event) Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 24 05:17:30.618698 dv-cinder-816443-2-iscsi neutron-server[102476]: aggregate_uuid = self.p_client.list_aggregates( Dec 24 05:17:30.622669 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 24 05:17:30.622669 dv-cinder-816443-2-iscsi neutron-server[102476]: return f(self, *a, **k) Dec 24 05:17:30.622669 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 24 05:17:30.622669 dv-cinder-816443-2-iscsi neutron-server[102476]: return self._get(url).json() Dec 24 05:17:30.622669 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 24 05:17:30.622669 dv-cinder-816443-2-iscsi neutron-server[102476]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 24 05:17:30.622669 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 24 05:17:30.622669 dv-cinder-816443-2-iscsi neutron-server[102476]: return self.request(url, 'GET', **kwargs) Dec 24 05:17:30.622669 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 24 05:17:30.622669 dv-cinder-816443-2-iscsi neutron-server[102476]: base_url = self.get_endpoint(auth, allow=allow, Dec 24 05:17:30.622669 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 24 05:17:30.622669 dv-cinder-816443-2-iscsi neutron-server[102476]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 24 05:17:30.622669 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 24 05:17:30.622669 dv-cinder-816443-2-iscsi neutron-server[102476]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 24 05:17:30.622669 dv-cinder-816443-2-iscsi neutron-server[102476]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 24 05:17:30.682263 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1ebc3e4f-7f4f-4287-88c1-280ad0cfd8bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3595937', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-546046'] for network, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:30.686873 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1ebc3e4f-7f4f-4287-88c1-280ad0cfd8bb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:30.690252 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-d317f6ff-ad08-453c-a13e-264801ae5e18 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010'] for port, after_delete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:30.690408 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-1ebc3e4f-7f4f-4287-88c1-280ad0cfd8bb admin admin] 10.222.0.43 "DELETE /v2.0/networks/075b69cb-c546-4fa5-aa29-49a5b85c94b1 HTTP/1.1" status: 204 len: 168 time: 0.5510297 Dec 24 05:17:30.705640 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ebc3e4f-7f4f-4287-88c1-280ad0cfd8bb admin admin] Pushing event deleted for resources: {'Network': ['ID=075b69cb-c546-4fa5-aa29-49a5b85c94b1,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:30.714813 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-d317f6ff-ad08-453c-a13e-264801ae5e18 None None] Network 075b69cb-c546-4fa5-aa29-49a5b85c94b1 is not hosted by any dhcp agent {{(pid=102478) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 24 05:17:30.715546 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d317f6ff-ad08-453c-a13e-264801ae5e18 None None] No DVR routers for this DVR port 10ca479f-d446-4321-95f5-b3659a965554 on host dv-cinder-816443-2-iscsi {{(pid=102478) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:17:30.717397 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d317f6ff-ad08-453c-a13e-264801ae5e18 None None] Pushing event deleted for resources: {'Port': ['ID=10ca479f-d446-4321-95f5-b3659a965554,revision_number=None']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:30.727512 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d317f6ff-ad08-453c-a13e-264801ae5e18 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:30.727817 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d317f6ff-ad08-453c-a13e-264801ae5e18 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:30.728166 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d317f6ff-ad08-453c-a13e-264801ae5e18 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:30.728506 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d317f6ff-ad08-453c-a13e-264801ae5e18 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:30.728865 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d317f6ff-ad08-453c-a13e-264801ae5e18 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:30.729198 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d317f6ff-ad08-453c-a13e-264801ae5e18 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:30.729564 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d317f6ff-ad08-453c-a13e-264801ae5e18 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:30.729837 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d317f6ff-ad08-453c-a13e-264801ae5e18 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:30.730162 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d317f6ff-ad08-453c-a13e-264801ae5e18 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:30.730688 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d317f6ff-ad08-453c-a13e-264801ae5e18 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:30.731211 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d317f6ff-ad08-453c-a13e-264801ae5e18 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:30.731701 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d317f6ff-ad08-453c-a13e-264801ae5e18 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:30.732113 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d317f6ff-ad08-453c-a13e-264801ae5e18 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:17:30.809133 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 35422) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:30.853134 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-c81c5f76-2d17-4c07-8803-c10496a6a21e admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=fc4cefad8fef403e90ad695e2098ee7b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0428052 Dec 24 05:17:30.856011 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 35424) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:30.913164 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e96f4e19-b9fa-4f7e-9f45-b40b9d9db689 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:30.937325 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e96f4e19-b9fa-4f7e-9f45-b40b9d9db689 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:30.994435 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e96f4e19-b9fa-4f7e-9f45-b40b9d9db689 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:30.997373 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e96f4e19-b9fa-4f7e-9f45-b40b9d9db689 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:30.998535 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-e96f4e19-b9fa-4f7e-9f45-b40b9d9db689 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/705cd6f0-1c41-443a-b2ba-d2a461b9b791 HTTP/1.1" status: 204 len: 168 time: 0.1415410 Dec 24 05:17:31.006108 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e96f4e19-b9fa-4f7e-9f45-b40b9d9db689 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=705cd6f0-1c41-443a-b2ba-d2a461b9b791,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:34.126493 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 35562) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:34.243349 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-923d5d71-ec22-4511-a4e6-1be1f93cecb6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:34.324062 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-923d5d71-ec22-4511-a4e6-1be1f93cecb6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:34.330341 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-923d5d71-ec22-4511-a4e6-1be1f93cecb6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:34.368186 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-923d5d71-ec22-4511-a4e6-1be1f93cecb6 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=1f098ab1221e4a3cb8cf5c28d901b7a2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2406104 Dec 24 05:17:34.369110 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-923d5d71-ec22-4511-a4e6-1be1f93cecb6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=74bbdf34-b9c2-493e-b4fe-df0864d96561,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:34.371889 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 35568) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:34.421347 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-bd930453-bf1e-4e73-b099-2f4da22e47cd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:34.447703 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-bd930453-bf1e-4e73-b099-2f4da22e47cd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:34.506709 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-bd930453-bf1e-4e73-b099-2f4da22e47cd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:34.510579 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-bd930453-bf1e-4e73-b099-2f4da22e47cd admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:34.512114 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-bd930453-bf1e-4e73-b099-2f4da22e47cd admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/74bbdf34-b9c2-493e-b4fe-df0864d96561 HTTP/1.1" status: 204 len: 168 time: 0.1389227 Dec 24 05:17:34.520245 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd930453-bf1e-4e73-b099-2f4da22e47cd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=74bbdf34-b9c2-493e-b4fe-df0864d96561,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:34.816062 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 35574) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:34.829622 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1e950b74-3089-4f29-965e-026bbb520510 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:34.910537 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1e950b74-3089-4f29-965e-026bbb520510 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:34.915921 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-1e950b74-3089-4f29-965e-026bbb520510 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:34.953978 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e950b74-3089-4f29-965e-026bbb520510 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ccde7640-08f4-47c7-a51c-67ac56682d25,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:34.958595 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-1e950b74-3089-4f29-965e-026bbb520510 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=9a48d0c1b04e4b89bef3a50b3fab90a1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1415048 Dec 24 05:17:34.961378 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 35576) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:35.009951 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d05ffe7c-983c-4296-99da-dac1807fbb83 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:35.035611 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d05ffe7c-983c-4296-99da-dac1807fbb83 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:35.086672 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d05ffe7c-983c-4296-99da-dac1807fbb83 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:35.090961 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d05ffe7c-983c-4296-99da-dac1807fbb83 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:35.092488 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-d05ffe7c-983c-4296-99da-dac1807fbb83 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/ccde7640-08f4-47c7-a51c-67ac56682d25 HTTP/1.1" status: 204 len: 168 time: 0.1302483 Dec 24 05:17:35.100136 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d05ffe7c-983c-4296-99da-dac1807fbb83 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ccde7640-08f4-47c7-a51c-67ac56682d25,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:36.853714 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 35624) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:36.981436 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c1fc2cda-b9a7-4c7b-b30c-86ce6a6d72b2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:37.056503 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c1fc2cda-b9a7-4c7b-b30c-86ce6a6d72b2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:37.063080 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-c1fc2cda-b9a7-4c7b-b30c-86ce6a6d72b2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:37.101641 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-c1fc2cda-b9a7-4c7b-b30c-86ce6a6d72b2 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=77168be0d2c04f47863d6738c328073a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2468011 Dec 24 05:17:37.102580 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1fc2cda-b9a7-4c7b-b30c-86ce6a6d72b2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8e073a49-583b-469d-83be-e6d812cce020,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:37.104514 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 35628) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:37.156008 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-48f617fc-9ea6-45dd-b37e-8575f39096c1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:37.177854 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-48f617fc-9ea6-45dd-b37e-8575f39096c1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:37.229815 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-48f617fc-9ea6-45dd-b37e-8575f39096c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:37.232475 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-48f617fc-9ea6-45dd-b37e-8575f39096c1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:37.233863 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-48f617fc-9ea6-45dd-b37e-8575f39096c1 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/8e073a49-583b-469d-83be-e6d812cce020 HTTP/1.1" status: 204 len: 168 time: 0.1282442 Dec 24 05:17:37.241539 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48f617fc-9ea6-45dd-b37e-8575f39096c1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8e073a49-583b-469d-83be-e6d812cce020,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:37.505735 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 35638) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:37.519292 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2fbbe57a-be29-4fb7-a4f6-32cd602440f4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:37.596038 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2fbbe57a-be29-4fb7-a4f6-32cd602440f4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:37.601770 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-2fbbe57a-be29-4fb7-a4f6-32cd602440f4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:37.643202 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-2fbbe57a-be29-4fb7-a4f6-32cd602440f4 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=dc66a71184a046de8979ce1141af917f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1363778 Dec 24 05:17:37.644331 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fbbe57a-be29-4fb7-a4f6-32cd602440f4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=55f65446-f35f-4627-977d-342b465d4c08,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:37.646085 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 35640) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:37.696245 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-bab799d1-1b99-4bc5-8d32-afd6cc3233d7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:37.717976 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-bab799d1-1b99-4bc5-8d32-afd6cc3233d7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:37.763391 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-bab799d1-1b99-4bc5-8d32-afd6cc3233d7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:37.766226 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-bab799d1-1b99-4bc5-8d32-afd6cc3233d7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:37.767415 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-bab799d1-1b99-4bc5-8d32-afd6cc3233d7 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/55f65446-f35f-4627-977d-342b465d4c08 HTTP/1.1" status: 204 len: 168 time: 0.1203246 Dec 24 05:17:37.775937 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bab799d1-1b99-4bc5-8d32-afd6cc3233d7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=55f65446-f35f-4627-977d-342b465d4c08,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:43.680765 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 35722) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:43.791927 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eacc48ed-8a2d-4e20-a8c4-efd707eb9893 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:43.863531 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eacc48ed-8a2d-4e20-a8c4-efd707eb9893 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:43.869066 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-eacc48ed-8a2d-4e20-a8c4-efd707eb9893 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:43.905932 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-eacc48ed-8a2d-4e20-a8c4-efd707eb9893 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=62d30c1be9f249f998edafec03da852c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2241142 Dec 24 05:17:43.906762 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eacc48ed-8a2d-4e20-a8c4-efd707eb9893 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e317cb0e-f4b7-47a2-8fe2-49ca11dd79f0,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:43.908927 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 35726) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:43.959190 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-bc521240-8e37-4f25-807d-b257601d615d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:43.981251 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-bc521240-8e37-4f25-807d-b257601d615d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:44.033764 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-bc521240-8e37-4f25-807d-b257601d615d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:44.036369 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-bc521240-8e37-4f25-807d-b257601d615d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:44.037560 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-bc521240-8e37-4f25-807d-b257601d615d admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/e317cb0e-f4b7-47a2-8fe2-49ca11dd79f0 HTTP/1.1" status: 204 len: 168 time: 0.1275258 Dec 24 05:17:44.045190 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc521240-8e37-4f25-807d-b257601d615d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e317cb0e-f4b7-47a2-8fe2-49ca11dd79f0,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:44.325089 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 35732) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:44.340947 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c4dcd34b-6f70-415b-a849-757f2b332320 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:44.416612 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c4dcd34b-6f70-415b-a849-757f2b332320 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:44.422649 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c4dcd34b-6f70-415b-a849-757f2b332320 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:44.461004 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-c4dcd34b-6f70-415b-a849-757f2b332320 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=06dc08d53859420fa5324867741cd739&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1348162 Dec 24 05:17:44.461863 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4dcd34b-6f70-415b-a849-757f2b332320 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=51c5748e-cf1f-4384-ad89-fcace42514a1,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:44.464308 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 35734) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:44.517991 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-528dca66-e4a2-408c-b444-270e39174e71 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:44.539871 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-528dca66-e4a2-408c-b444-270e39174e71 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:44.586773 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-528dca66-e4a2-408c-b444-270e39174e71 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:44.589531 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-528dca66-e4a2-408c-b444-270e39174e71 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:44.590689 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-528dca66-e4a2-408c-b444-270e39174e71 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/51c5748e-cf1f-4384-ad89-fcace42514a1 HTTP/1.1" status: 204 len: 168 time: 0.1254549 Dec 24 05:17:44.598585 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-528dca66-e4a2-408c-b444-270e39174e71 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=51c5748e-cf1f-4384-ad89-fcace42514a1,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:50.591416 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:53.225571 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-38b73d74-d4d1-4bc0-8f36-4c97171d93a5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:55.316554 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-404719e9-2e98-4a48-bbd3-51c5745e096f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:55.976834 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 35826) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:56.086079 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-acb92070-4a2d-4fcc-82f1-d7dc373f74fd admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:56.161912 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-acb92070-4a2d-4fcc-82f1-d7dc373f74fd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:56.168170 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-acb92070-4a2d-4fcc-82f1-d7dc373f74fd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:56.205485 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-acb92070-4a2d-4fcc-82f1-d7dc373f74fd admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=237dd84788ec4f20bef7b8c0b631642c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2275941 Dec 24 05:17:56.206288 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acb92070-4a2d-4fcc-82f1-d7dc373f74fd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a678c857-1318-4727-b2d7-e321d3027239,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:56.208729 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 35830) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:56.257362 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ecb03306-ac1a-4761-824e-2b077ab71035 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:56.280928 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ecb03306-ac1a-4761-824e-2b077ab71035 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:56.327608 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ecb03306-ac1a-4761-824e-2b077ab71035 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:56.330231 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ecb03306-ac1a-4761-824e-2b077ab71035 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:56.331397 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-ecb03306-ac1a-4761-824e-2b077ab71035 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/a678c857-1318-4727-b2d7-e321d3027239 HTTP/1.1" status: 204 len: 168 time: 0.1216357 Dec 24 05:17:56.339784 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecb03306-ac1a-4761-824e-2b077ab71035 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a678c857-1318-4727-b2d7-e321d3027239,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:56.556214 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:56.607260 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 35836) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:56.621040 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7b7b67c3-5ff4-4853-9206-c56732b270f1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:56.701252 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7b7b67c3-5ff4-4853-9206-c56732b270f1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:56.706135 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-7b7b67c3-5ff4-4853-9206-c56732b270f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:56.744054 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-7b7b67c3-5ff4-4853-9206-c56732b270f1 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=90162a1c765845638300e9591546af62&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1355417 Dec 24 05:17:56.745225 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b7b67c3-5ff4-4853-9206-c56732b270f1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5972f265-1e59-40a9-80bd-f3f0f2fc2cff,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:56.747020 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 35838) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:17:56.798349 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-455dc7f2-7237-4277-a018-58ae17a3a2a1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:56.820228 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-455dc7f2-7237-4277-a018-58ae17a3a2a1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:56.869461 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-455dc7f2-7237-4277-a018-58ae17a3a2a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:56.872010 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-455dc7f2-7237-4277-a018-58ae17a3a2a1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:56.873191 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-455dc7f2-7237-4277-a018-58ae17a3a2a1 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/5972f265-1e59-40a9-80bd-f3f0f2fc2cff HTTP/1.1" status: 204 len: 168 time: 0.1251988 Dec 24 05:17:56.880511 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-455dc7f2-7237-4277-a018-58ae17a3a2a1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5972f265-1e59-40a9-80bd-f3f0f2fc2cff,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:17:57.476501 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:17:58.007528 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:17:58.588145 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:07.829780 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 35944) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:18:07.933923 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e7ef121c-157a-4560-b64e-9eda4a109cc7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:08.014556 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e7ef121c-157a-4560-b64e-9eda4a109cc7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:08.021068 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e7ef121c-157a-4560-b64e-9eda4a109cc7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:08.066534 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-e7ef121c-157a-4560-b64e-9eda4a109cc7 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=9657c044b88d4f1f910024face749e22&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2356472 Dec 24 05:18:08.067737 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7ef121c-157a-4560-b64e-9eda4a109cc7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b976da66-9cff-4feb-9377-2990adf3cf71,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:08.069528 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 35948) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:18:08.117945 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7a454996-c58d-42c4-892a-22a8ac0e8875 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:08.139500 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7a454996-c58d-42c4-892a-22a8ac0e8875 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:08.187756 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7a454996-c58d-42c4-892a-22a8ac0e8875 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:08.190229 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-7a454996-c58d-42c4-892a-22a8ac0e8875 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:08.191369 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-7a454996-c58d-42c4-892a-22a8ac0e8875 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/b976da66-9cff-4feb-9377-2990adf3cf71 HTTP/1.1" status: 204 len: 168 time: 0.1208792 Dec 24 05:18:08.198985 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a454996-c58d-42c4-892a-22a8ac0e8875 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b976da66-9cff-4feb-9377-2990adf3cf71,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:08.476974 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 35954) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:18:08.490846 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-3438d2cb-84c5-48fa-ab62-20fe200c2f0a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:08.569474 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-3438d2cb-84c5-48fa-ab62-20fe200c2f0a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:08.575079 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-3438d2cb-84c5-48fa-ab62-20fe200c2f0a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:08.615680 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-3438d2cb-84c5-48fa-ab62-20fe200c2f0a admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=32c59258ed57480183a664a176a0c671&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1376164 Dec 24 05:18:08.616505 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3438d2cb-84c5-48fa-ab62-20fe200c2f0a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dad1e261-9e5e-4378-9820-38a94a4adfdd,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:08.618862 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 35956) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:18:08.672697 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1014782e-1033-4a9c-a265-0642be15a6e5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:08.693956 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1014782e-1033-4a9c-a265-0642be15a6e5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:08.750363 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1014782e-1033-4a9c-a265-0642be15a6e5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:08.753116 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1014782e-1033-4a9c-a265-0642be15a6e5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:08.754281 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-1014782e-1033-4a9c-a265-0642be15a6e5 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/dad1e261-9e5e-4378-9820-38a94a4adfdd HTTP/1.1" status: 204 len: 168 time: 0.1341174 Dec 24 05:18:08.761980 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1014782e-1033-4a9c-a265-0642be15a6e5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dad1e261-9e5e-4378-9820-38a94a4adfdd,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:12.449139 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 36000) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:18:12.556025 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e158ea76-1a80-4c58-a2a3-5691ec3ec53b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:12.631358 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e158ea76-1a80-4c58-a2a3-5691ec3ec53b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:12.637762 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-e158ea76-1a80-4c58-a2a3-5691ec3ec53b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:12.682094 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e158ea76-1a80-4c58-a2a3-5691ec3ec53b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=052a6e16-aff7-4b1f-93c5-a328c63b72b7,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:12.687769 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-e158ea76-1a80-4c58-a2a3-5691ec3ec53b admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=9ff67dce1e4d4f438e71cc722eddcb7d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2376423 Dec 24 05:18:12.690754 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 36004) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:18:12.742780 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-19bc5424-3ea0-4e36-b1db-ff3354de1b0e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:12.763951 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-19bc5424-3ea0-4e36-b1db-ff3354de1b0e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:12.818011 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-19bc5424-3ea0-4e36-b1db-ff3354de1b0e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:12.820741 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-19bc5424-3ea0-4e36-b1db-ff3354de1b0e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:12.821921 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-19bc5424-3ea0-4e36-b1db-ff3354de1b0e admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/052a6e16-aff7-4b1f-93c5-a328c63b72b7 HTTP/1.1" status: 204 len: 168 time: 0.1302221 Dec 24 05:18:12.829845 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19bc5424-3ea0-4e36-b1db-ff3354de1b0e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=052a6e16-aff7-4b1f-93c5-a328c63b72b7,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:13.466706 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 36026) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:18:13.588162 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-8af242e3-a028-4f59-8316-1224e024be96 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1513497678-network', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:18:13.614962 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8af242e3-a028-4f59-8316-1224e024be96 admin admin] Made reservation on behalf of 274c3c6f555f48ad93189e73c71c5ffe for: {'network': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:18:13.617295 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-8af242e3-a028-4f59-8316-1224e024be96 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for network, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:13.628509 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-8af242e3-a028-4f59-8316-1224e024be96 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:13.703081 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-8af242e3-a028-4f59-8316-1224e024be96 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:13.708934 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-8af242e3-a028-4f59-8316-1224e024be96 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:13.730853 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8af242e3-a028-4f59-8316-1224e024be96 admin admin] vlan segment allocate from pool success with {'vlan_id': 121, 'physical_network': 'physnet1'} {{(pid=102476) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 24 05:18:13.744298 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8af242e3-a028-4f59-8316-1224e024be96 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6bc58421-6994-4803-b407-9231f83d7d34,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:13.749590 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-8af242e3-a028-4f59-8316-1224e024be96 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:13.749937 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.segments_db [None req-8af242e3-a028-4f59-8316-1224e024be96 admin admin] Added segment 752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5 of type vlan for network 568053f6-6cfe-408d-be45-92751af5d67f Dec 24 05:18:13.790146 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-8af242e3-a028-4f59-8316-1224e024be96 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750577486812'] for network, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:13.816417 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-8af242e3-a028-4f59-8316-1224e024be96 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for network, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:13.817362 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8af242e3-a028-4f59-8316-1224e024be96 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:18:13.818062 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-8af242e3-a028-4f59-8316-1224e024be96 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:13.852005 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-8af242e3-a028-4f59-8316-1224e024be96 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.3841927 Dec 24 05:18:13.855040 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 36030) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:18:13.860018 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-d9d651cd-a49a-4708-bb08-00f783470194 admin admin] Request body: {'subnet': {'network_id': '568053f6-6cfe-408d-be45-92751af5d67f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1513497678-subnet', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'ip_version': 4}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:18:13.885005 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d9d651cd-a49a-4708-bb08-00f783470194 admin admin] Made reservation on behalf of 274c3c6f555f48ad93189e73c71c5ffe for: {'subnet': 1} {{(pid=102477) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:18:13.885596 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8af242e3-a028-4f59-8316-1224e024be96 admin admin] Pushing event updated for resources: {'Network': ['ID=568053f6-6cfe-408d-be45-92751af5d67f,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:13.887449 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d9d651cd-a49a-4708-bb08-00f783470194 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-29853115'] for subnet, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:13.895627 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Network 568053f6-6cfe-408d-be45-92751af5d67f details requested by agent ovs-agent-dv-cinder-816443-2-iscsi with host dv-cinder-816443-2-iscsi {{(pid=102478) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 24 05:18:14.051870 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d9d651cd-a49a-4708-bb08-00f783470194 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-29535722', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-29853097'] for subnet, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:14.106045 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9d651cd-a49a-4708-bb08-00f783470194 admin admin] Pushing event updated for resources: {'Subnet': ['ID=0d93f37f-9870-4f45-a3dd-a7bfdf196cf7,revision_number=0']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:14.114763 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d9d651cd-a49a-4708-bb08-00f783470194 admin admin] Checking segment: {'id': '752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102477) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:18:14.115122 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d9d651cd-a49a-4708-bb08-00f783470194 admin admin] Network hostable DHCP agents. Network: 568053f6-6cfe-408d-be45-92751af5d67f, hostable agents: ['01bc2530-0600-4d1b-b486-2fd9d63a2d51'], hosted agents: [] {{(pid=102477) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 24 05:18:14.139495 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d9d651cd-a49a-4708-bb08-00f783470194 admin admin] Network 568053f6-6cfe-408d-be45-92751af5d67f is scheduled to be hosted by DHCP agent 01bc2530-0600-4d1b-b486-2fd9d63a2d51 with binding_index 1 {{(pid=102477) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 24 05:18:14.152872 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-d9d651cd-a49a-4708-bb08-00f783470194 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816443-2-iscsi, 568053f6-6cfe-408d-be45-92751af5d67f) {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:18:14.157652 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9d651cd-a49a-4708-bb08-00f783470194 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:18:14.158868 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d9d651cd-a49a-4708-bb08-00f783470194 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:14.162018 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-934e35e6-a7df-4009-8b4a-7861e1bbf2dd None None] Network 568053f6-6cfe-408d-be45-92751af5d67f requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:18:14.176130 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-d9d651cd-a49a-4708-bb08-00f783470194 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3199635 Dec 24 05:18:14.178969 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 36032) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:18:14.183206 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-d2feb588-ce73-4ea6-b60f-e52e8423c564 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1513497678-router', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:18:14.209833 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d2feb588-ce73-4ea6-b60f-e52e8423c564 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-546186', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2070334'] for router, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:14.210927 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d2feb588-ce73-4ea6-b60f-e52e8423c564 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-546302', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-549497', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-553463', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2070311'] for router, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:14.267698 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eeba0ccf-d924-4bc3-9221-2ef43970a6e5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpd2866d45-53d6-5577-9724-7d7a303c375f-568053f6-6cfe-408d-be45-92751af5d67f', 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f', 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'fixed_ips': [{'subnet_id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7'}]}} from dv-cinder-816443-2-iscsi. {{(pid=102478) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 24 05:18:14.268591 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-eeba0ccf-d924-4bc3-9221-2ef43970a6e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:14.269086 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d2feb588-ce73-4ea6-b60f-e52e8423c564 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:14.399631 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.db_base_plugin_common [None req-eeba0ccf-d924-4bc3-9221-2ef43970a6e5 None None] Allocated IP 172.20.0.2 (568053f6-6cfe-408d-be45-92751af5d67f/0d93f37f-9870-4f45-a3dd-a7bfdf196cf7/46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489) {{(pid=102478) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:18:14.404593 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d2feb588-ce73-4ea6-b60f-e52e8423c564 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:14.540047 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-eeba0ccf-d924-4bc3-9221-2ef43970a6e5 None None] Publish callbacks [] for port, precommit_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:14.547286 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-eeba0ccf-d924-4bc3-9221-2ef43970a6e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001'] for port, after_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:14.591428 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eeba0ccf-d924-4bc3-9221-2ef43970a6e5 None None] Network 568053f6-6cfe-408d-be45-92751af5d67f is already hosted by enough agents. {{(pid=102478) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:18:14.595962 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.scheduler.base_scheduler [None req-eeba0ccf-d924-4bc3-9221-2ef43970a6e5 None None] Resources bound (agent type, host, resource id): {{(pid=102478) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:18:14.599384 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eeba0ccf-d924-4bc3-9221-2ef43970a6e5 None None] Received port after_create {{(pid=102478) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:18:14.604591 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eeba0ccf-d924-4bc3-9221-2ef43970a6e5 None None] Pushing event updated for resources: {'Port': ['ID=46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489,revision_number=1']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:14.604805 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d2feb588-ce73-4ea6-b60f-e52e8423c564 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:14.626056 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d2feb588-ce73-4ea6-b60f-e52e8423c564 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:14.659893 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-eeba0ccf-d924-4bc3-9221-2ef43970a6e5 None None] Attempting to bind port 46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489 on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:18:14.660174 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-eeba0ccf-d924-4bc3-9221-2ef43970a6e5 None None] Attempting to bind port 46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489 by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': '752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f'}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:18:14.660563 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eeba0ccf-d924-4bc3-9221-2ef43970a6e5 None None] Attempting to bind port 46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489 on network 568053f6-6cfe-408d-be45-92751af5d67f {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:18:14.665530 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eeba0ccf-d924-4bc3-9221-2ef43970a6e5 None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 17, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:18:14.665906 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eeba0ccf-d924-4bc3-9221-2ef43970a6e5 None None] Checking segment: {'id': '752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102478) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:18:14.666308 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-eeba0ccf-d924-4bc3-9221-2ef43970a6e5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:14.666698 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eeba0ccf-d924-4bc3-9221-2ef43970a6e5 None None] Bound using segment: {'id': '752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f'} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:18:14.667166 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-eeba0ccf-d924-4bc3-9221-2ef43970a6e5 None None] Bound port: 46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f'}}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:18:14.667654 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-eeba0ccf-d924-4bc3-9221-2ef43970a6e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:14.733047 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-eeba0ccf-d924-4bc3-9221-2ef43970a6e5 None None] For port 46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102478) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:18:14.735165 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.db_base_plugin_common [None req-d2feb588-ce73-4ea6-b60f-e52e8423c564 admin admin] Allocated IP 172.27.1.29 (9b4e4b31-551f-45a9-b26a-cb44ee20a17d/f277b899-8779-420e-8a8d-bfcd5eb7f012/dfc571f6-d53d-4920-be50-bf7e0c29ff2e) {{(pid=102477) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:18:14.736328 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-eeba0ccf-d924-4bc3-9221-2ef43970a6e5 None None] For port 46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489,segment=NetworkSegment(752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5),segment_id=752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5)] {{(pid=102478) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:18:14.741090 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-eeba0ccf-d924-4bc3-9221-2ef43970a6e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:14.803367 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eeba0ccf-d924-4bc3-9221-2ef43970a6e5 None None] Pushing event updated for resources: {'Port': ['ID=46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489,revision_number=2']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:14.840619 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d2feb588-ce73-4ea6-b60f-e52e8423c564 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:14.879367 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d2feb588-ce73-4ea6-b60f-e52e8423c564 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:14.930396 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d2feb588-ce73-4ea6-b60f-e52e8423c564 admin admin] Network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d is already hosted by enough agents. {{(pid=102477) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:18:14.930396 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-d2feb588-ce73-4ea6-b60f-e52e8423c564 admin admin] Resources bound (agent type, host, resource id): {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:18:14.937786 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2feb588-ce73-4ea6-b60f-e52e8423c564 admin admin] Received port after_create {{(pid=102477) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:18:14.964605 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2feb588-ce73-4ea6-b60f-e52e8423c564 admin admin] Pushing event updated for resources: {'Port': ['ID=dfc571f6-d53d-4920-be50-bf7e0c29ff2e,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:15.192381 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d2feb588-ce73-4ea6-b60f-e52e8423c564 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:15.406174 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d2feb588-ce73-4ea6-b60f-e52e8423c564 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-546295', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-545958'] for router, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:15.699502 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-965f826a-e02b-45a7-8e51-6ed750886489 None None] Network 568053f6-6cfe-408d-be45-92751af5d67f requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:18:15.786141 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d2feb588-ce73-4ea6-b60f-e52e8423c564 admin admin] Router 4540c62c-8273-49c3-be97-477e91b60f59 is scheduled to L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 with binding_index 1 {{(pid=102477) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 24 05:18:15.812698 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-11ed94d6-6efc-46ea-9add-c583aa0353f8 None None] Provisioning complete for port 46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:18:15.813053 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-11ed94d6-6efc-46ea-9add-c583aa0353f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:15.888870 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d2feb588-ce73-4ea6-b60f-e52e8423c564 admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102477) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:18:15.898338 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-11ed94d6-6efc-46ea-9add-c583aa0353f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:15.903055 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] Sync routers for ids ['4540c62c-8273-49c3-be97-477e91b60f59'] in dv-cinder-816443-2-iscsi {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:18:15.908308 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-d2feb588-ce73-4ea6-b60f-e52e8423c564 admin admin] Publish callbacks [] for router, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:15.912428 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 36034) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:18:15.913087 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-d2feb588-ce73-4ea6-b60f-e52e8423c564 admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 1.7324879 Dec 24 05:18:15.939019 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] Routers {'4540c62c-8273-49c3-be97-477e91b60f59'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:18:15.939708 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:17:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['4540c62c-8273-49c3-be97-477e91b60f59'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:18:15.983038 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-11ed94d6-6efc-46ea-9add-c583aa0353f8 None None] For port 46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489,segment=NetworkSegment(752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5),segment_id=752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:18:15.992629 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-11ed94d6-6efc-46ea-9add-c583aa0353f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:16.079706 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11ed94d6-6efc-46ea-9add-c583aa0353f8 None None] Pushing event updated for resources: {'Port': ['ID=46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489,revision_number=3']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:16.091350 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] Set router 4540c62c-8273-49c3-be97-477e91b60f59 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:18:16.176311 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-fe7e6918-3380-4302-87dc-99c3b84597dd None None] Provisioning complete for port 46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:18:16.176712 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-fe7e6918-3380-4302-87dc-99c3b84597dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:16.344442 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-98c312cf-8670-4fd5-a65a-34e86970b184 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:16.363077 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:18:16.496552 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:18:16.496922 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:16.498216 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [None req-98c312cf-8670-4fd5-a65a-34e86970b184 admin admin] Allocated IP 172.20.0.1 (568053f6-6cfe-408d-be45-92751af5d67f/0d93f37f-9870-4f45-a3dd-a7bfdf196cf7/4e2d29fc-c33c-4d30-8150-d0a0a014a682) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:18:16.549801 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4540c62c-8273-49c3-be97-477e91b60f59', 'name': 'tempest-TestShelveInstance-1513497678-router', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:15Z', 'revision_number': 3, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'gw_port': {'id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:88:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:14Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:18:16.578424 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] Checking router: 4540c62c-8273-49c3-be97-477e91b60f59 for host: dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:18:16.578773 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] Updating router 4540c62c-8273-49c3-be97-477e91b60f59 port dfc571f6-d53d-4920-be50-bf7e0c29ff2e binding host dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 24 05:18:16.599446 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-98c312cf-8670-4fd5-a65a-34e86970b184 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:16.632242 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:16.635117 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-98c312cf-8670-4fd5-a65a-34e86970b184 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:16.679930 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-98c312cf-8670-4fd5-a65a-34e86970b184 admin admin] Network 568053f6-6cfe-408d-be45-92751af5d67f is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:18:16.682821 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-98c312cf-8670-4fd5-a65a-34e86970b184 admin admin] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:18:16.687021 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98c312cf-8670-4fd5-a65a-34e86970b184 admin admin] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:18:16.690007 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98c312cf-8670-4fd5-a65a-34e86970b184 admin admin] Pushing event updated for resources: {'Port': ['ID=4e2d29fc-c33c-4d30-8150-d0a0a014a682,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:16.728511 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-98c312cf-8670-4fd5-a65a-34e86970b184 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-545913'] for router_interface, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:16.868102 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-98c312cf-8670-4fd5-a65a-34e86970b184 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:16.901849 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] Publish callbacks [] for port, precommit_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:16.908445 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:16.967624 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d08ecf60-2769-4c4f-8a97-8c1dee5ae525 None None] Pushing event updated for resources: {'Port': ['ID=dfc571f6-d53d-4920-be50-bf7e0c29ff2e,revision_number=2']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:16.976945 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-02965c61-eb7f-4f2f-a0c5-5efdbfcc0eeb None None] Provisioning complete for port 4e2d29fc-c33c-4d30-8150-d0a0a014a682 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:18:16.977253 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-02965c61-eb7f-4f2f-a0c5-5efdbfcc0eeb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:16.980654 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] Attempting to bind port dfc571f6-d53d-4920-be50-bf7e0c29ff2e on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:18:16.981022 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] Attempting to bind port dfc571f6-d53d-4920-be50-bf7e0c29ff2e by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:18:16.981384 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] Attempting to bind port dfc571f6-d53d-4920-be50-bf7e0c29ff2e on network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:18:17.013844 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 17, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:18:17.014194 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] Checking segment: {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102478) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:18:17.014612 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:17.015001 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] Bound using segment: {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:18:17.015447 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] Bound port: dfc571f6-d53d-4920-be50-bf7e0c29ff2e, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:18:17.015847 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:17.038835 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-98c312cf-8670-4fd5-a65a-34e86970b184 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:17.044933 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-98c312cf-8670-4fd5-a65a-34e86970b184 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:17.046456 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-02965c61-eb7f-4f2f-a0c5-5efdbfcc0eeb None None] Port 4e2d29fc-c33c-4d30-8150-d0a0a014a682 cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 05:18:17.072934 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] For port dfc571f6-d53d-4920-be50-bf7e0c29ff2e, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102478) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:18:17.076380 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] For port dfc571f6-d53d-4920-be50-bf7e0c29ff2e, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=dfc571f6-d53d-4920-be50-bf7e0c29ff2e,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102478) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:18:17.084954 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:17.112076 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98c312cf-8670-4fd5-a65a-34e86970b184 admin admin] Pushing event updated for resources: {'Port': ['ID=4e2d29fc-c33c-4d30-8150-d0a0a014a682,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:17.114575 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-98c312cf-8670-4fd5-a65a-34e86970b184 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-627486', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-548585'] for router_interface, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:17.147412 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] Routers {'4540c62c-8273-49c3-be97-477e91b60f59'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:18:17.148132 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:17:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['4540c62c-8273-49c3-be97-477e91b60f59'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:18:17.184333 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d08ecf60-2769-4c4f-8a97-8c1dee5ae525 None None] Pushing event updated for resources: {'Port': ['ID=dfc571f6-d53d-4920-be50-bf7e0c29ff2e,revision_number=3']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:17.223268 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-98c312cf-8670-4fd5-a65a-34e86970b184 admin admin] Network 568053f6-6cfe-408d-be45-92751af5d67f is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:18:17.224803 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-98c312cf-8670-4fd5-a65a-34e86970b184 admin admin] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:18:17.263891 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] Set router 4540c62c-8273-49c3-be97-477e91b60f59 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:18:17.352451 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-98c312cf-8670-4fd5-a65a-34e86970b184 admin admin] Router 4540c62c-8273-49c3-be97-477e91b60f59 has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102476) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:18:17.467217 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-98c312cf-8670-4fd5-a65a-34e86970b184 admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:18:17.481972 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-98c312cf-8670-4fd5-a65a-34e86970b184 admin admin] 10.222.0.43 "PUT /v2.0/routers/4540c62c-8273-49c3-be97-477e91b60f59/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5593376 Dec 24 05:18:17.482095 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-85d505c6-721c-4718-adcd-c840a12f98ac None None] Provisioning complete for port 4e2d29fc-c33c-4d30-8150-d0a0a014a682 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:18:17.482095 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-85d505c6-721c-4718-adcd-c840a12f98ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:17.509007 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4540c62c-8273-49c3-be97-477e91b60f59', 'name': 'tempest-TestShelveInstance-1513497678-router', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:16Z', 'revision_number': 4, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'gw_port': {'id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:88:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '4e2d29fc-c33c-4d30-8150-d0a0a014a682', 'name': '', 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'mac_address': 'fa:16:3e:66:ed:ce', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:16Z', 'updated_at': '2021-12-24T05:18:16Z', 'revision_number': 2, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'subnets': [{'id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:18:17.538609 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9c30c495-bdb3-4e8e-bcda-ce24da7d5373 None None] The sync data for ids ['4540c62c-8273-49c3-be97-477e91b60f59'] in dv-cinder-816443-2-iscsi is: [{'id': '4540c62c-8273-49c3-be97-477e91b60f59', 'name': 'tempest-TestShelveInstance-1513497678-router', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:16Z', 'revision_number': 4, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'gw_port': {'id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:88:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '4e2d29fc-c33c-4d30-8150-d0a0a014a682', 'name': '', 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'mac_address': 'fa:16:3e:66:ed:ce', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:16Z', 'updated_at': '2021-12-24T05:18:16Z', 'revision_number': 2, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'subnets': [{'id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:18:17.540130 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-85d505c6-721c-4718-adcd-c840a12f98ac None None] Port 4e2d29fc-c33c-4d30-8150-d0a0a014a682 cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 05:18:17.983302 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 36050) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:18:17.988240 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-96190cd6-2167-4111-bc4b-878174773ff0 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1766906089-network', 'tenant_id': '905e5afd4e554da8aa686e9236199822'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:18:18.012463 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-96190cd6-2167-4111-bc4b-878174773ff0 admin admin] Made reservation on behalf of 905e5afd4e554da8aa686e9236199822 for: {'network': 1} {{(pid=102477) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:18:18.014837 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-96190cd6-2167-4111-bc4b-878174773ff0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for network, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:18.026957 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-96190cd6-2167-4111-bc4b-878174773ff0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:18.106816 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-96190cd6-2167-4111-bc4b-878174773ff0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:18.111397 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-96190cd6-2167-4111-bc4b-878174773ff0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:18.145693 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-96190cd6-2167-4111-bc4b-878174773ff0 admin admin] vlan segment allocate from pool success with {'vlan_id': 116, 'physical_network': 'physnet1'} {{(pid=102477) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 24 05:18:18.154625 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96190cd6-2167-4111-bc4b-878174773ff0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ceed43b3-5676-4acd-99c9-5e2ede3dcbab,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:18.165082 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-96190cd6-2167-4111-bc4b-878174773ff0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:18.165433 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.db.segments_db [None req-96190cd6-2167-4111-bc4b-878174773ff0 admin admin] Added segment 3ef2ef73-c5aa-47a0-8142-1f727875c8dd of type vlan for network 1aa8f896-bce9-42d4-9fed-ab613f3c849d Dec 24 05:18:18.224780 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-96190cd6-2167-4111-bc4b-878174773ff0 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8750577486812'] for network, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:18.251835 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-96190cd6-2167-4111-bc4b-878174773ff0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456'] for network, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:18.255391 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-96190cd6-2167-4111-bc4b-878174773ff0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:18:18.256232 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-96190cd6-2167-4111-bc4b-878174773ff0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:18.260371 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device dfc571f6-d53d-4920-be50-bf7e0c29ff2e up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:18:18.322527 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port dfc571f6-d53d-4920-be50-bf7e0c29ff2e triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:18:18.322908 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:18.329769 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-96190cd6-2167-4111-bc4b-878174773ff0 admin admin] 10.222.0.43 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.3450539 Dec 24 05:18:18.330770 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96190cd6-2167-4111-bc4b-878174773ff0 admin admin] Pushing event updated for resources: {'Network': ['ID=1aa8f896-bce9-42d4-9fed-ab613f3c849d,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:18.332448 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 36052) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:18:18.338024 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-5582e46c-a91f-433d-9d7c-78b5c55e4598 admin admin] Request body: {'subnet': {'network_id': '1aa8f896-bce9-42d4-9fed-ab613f3c849d', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1766906089-subnet', 'tenant_id': '905e5afd4e554da8aa686e9236199822', 'ip_version': 4}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:18:18.349534 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Network 1aa8f896-bce9-42d4-9fed-ab613f3c849d details requested by agent ovs-agent-dv-cinder-816443-2-iscsi with host dv-cinder-816443-2-iscsi {{(pid=102478) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 24 05:18:18.365844 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5582e46c-a91f-433d-9d7c-78b5c55e4598 admin admin] Made reservation on behalf of 905e5afd4e554da8aa686e9236199822 for: {'subnet': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:18:18.368854 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-5582e46c-a91f-433d-9d7c-78b5c55e4598 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-32970422'] for subnet, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:18.473556 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:18.496093 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] For port dfc571f6-d53d-4920-be50-bf7e0c29ff2e, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=dfc571f6-d53d-4920-be50-bf7e0c29ff2e,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:18:18.500963 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:18.554392 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-5582e46c-a91f-433d-9d7c-78b5c55e4598 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-32528573', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-32970404'] for subnet, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:18.561523 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Pushing event updated for resources: {'Port': ['ID=dfc571f6-d53d-4920-be50-bf7e0c29ff2e,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:18.616016 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5582e46c-a91f-433d-9d7c-78b5c55e4598 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ff102b47-664d-4cd0-a913-67c8b37fa995,revision_number=0']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:18.625437 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5582e46c-a91f-433d-9d7c-78b5c55e4598 admin admin] Checking segment: {'id': '3ef2ef73-c5aa-47a0-8142-1f727875c8dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '1aa8f896-bce9-42d4-9fed-ab613f3c849d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:18:18.625863 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5582e46c-a91f-433d-9d7c-78b5c55e4598 admin admin] Network hostable DHCP agents. Network: 1aa8f896-bce9-42d4-9fed-ab613f3c849d, hostable agents: ['01bc2530-0600-4d1b-b486-2fd9d63a2d51'], hosted agents: [] {{(pid=102476) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 24 05:18:18.644592 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5582e46c-a91f-433d-9d7c-78b5c55e4598 admin admin] Network 1aa8f896-bce9-42d4-9fed-ab613f3c849d is scheduled to be hosted by DHCP agent 01bc2530-0600-4d1b-b486-2fd9d63a2d51 with binding_index 1 {{(pid=102476) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 24 05:18:18.654018 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-5582e46c-a91f-433d-9d7c-78b5c55e4598 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816443-2-iscsi, 1aa8f896-bce9-42d4-9fed-ab613f3c849d) {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:18:18.658260 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5582e46c-a91f-433d-9d7c-78b5c55e4598 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:18:18.658850 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-5582e46c-a91f-433d-9d7c-78b5c55e4598 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:18.666442 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-239d64db-ab0a-4535-a783-9cb412946e98 None None] Network 1aa8f896-bce9-42d4-9fed-ab613f3c849d requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:18:18.676196 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-5582e46c-a91f-433d-9d7c-78b5c55e4598 admin admin] 10.222.0.43 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3419371 Dec 24 05:18:18.678651 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 36054) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:18:18.683568 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-49b0b67c-9102-4f00-9713-3ffd57d2021d admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1766906089-router', 'tenant_id': '905e5afd4e554da8aa686e9236199822', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:18:18.706973 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-49b0b67c-9102-4f00-9713-3ffd57d2021d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-546186', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2070334'] for router, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:18.709151 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-49b0b67c-9102-4f00-9713-3ffd57d2021d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-546302', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-549497', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-553463', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2070311'] for router, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:18.766509 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-49b0b67c-9102-4f00-9713-3ffd57d2021d admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:18.790203 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fab55734-5775-4612-9f7f-1c57aa2f34b0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpd2866d45-53d6-5577-9724-7d7a303c375f-1aa8f896-bce9-42d4-9fed-ab613f3c849d', 'network_id': '1aa8f896-bce9-42d4-9fed-ab613f3c849d', 'project_id': '905e5afd4e554da8aa686e9236199822', 'fixed_ips': [{'subnet_id': 'ff102b47-664d-4cd0-a913-67c8b37fa995'}]}} from dv-cinder-816443-2-iscsi. {{(pid=102478) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 24 05:18:18.791106 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-fab55734-5775-4612-9f7f-1c57aa2f34b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:18.925786 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.db_base_plugin_common [None req-fab55734-5775-4612-9f7f-1c57aa2f34b0 None None] Allocated IP 172.20.0.2 (1aa8f896-bce9-42d4-9fed-ab613f3c849d/ff102b47-664d-4cd0-a913-67c8b37fa995/58b0d62e-b026-4bd6-8b85-7faeb9c52285) {{(pid=102478) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:18:19.083702 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-fab55734-5775-4612-9f7f-1c57aa2f34b0 None None] Publish callbacks [] for port, precommit_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:19.090727 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-fab55734-5775-4612-9f7f-1c57aa2f34b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001'] for port, after_create {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:19.135612 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fab55734-5775-4612-9f7f-1c57aa2f34b0 None None] Network 1aa8f896-bce9-42d4-9fed-ab613f3c849d is already hosted by enough agents. {{(pid=102478) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:18:19.138853 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.scheduler.base_scheduler [None req-fab55734-5775-4612-9f7f-1c57aa2f34b0 None None] Resources bound (agent type, host, resource id): {{(pid=102478) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:18:19.141481 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fab55734-5775-4612-9f7f-1c57aa2f34b0 None None] Received port after_create {{(pid=102478) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:18:19.155784 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fab55734-5775-4612-9f7f-1c57aa2f34b0 None None] Pushing event updated for resources: {'Port': ['ID=58b0d62e-b026-4bd6-8b85-7faeb9c52285,revision_number=1']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:19.197217 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-49b0b67c-9102-4f00-9713-3ffd57d2021d admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:19.209767 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-fab55734-5775-4612-9f7f-1c57aa2f34b0 None None] Attempting to bind port 58b0d62e-b026-4bd6-8b85-7faeb9c52285 on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:18:19.210307 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-fab55734-5775-4612-9f7f-1c57aa2f34b0 None None] Attempting to bind port 58b0d62e-b026-4bd6-8b85-7faeb9c52285 by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': '3ef2ef73-c5aa-47a0-8142-1f727875c8dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '1aa8f896-bce9-42d4-9fed-ab613f3c849d'}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:18:19.210677 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fab55734-5775-4612-9f7f-1c57aa2f34b0 None None] Attempting to bind port 58b0d62e-b026-4bd6-8b85-7faeb9c52285 on network 1aa8f896-bce9-42d4-9fed-ab613f3c849d {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:18:19.217132 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fab55734-5775-4612-9f7f-1c57aa2f34b0 None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 17, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:18:19.217497 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fab55734-5775-4612-9f7f-1c57aa2f34b0 None None] Checking segment: {'id': '3ef2ef73-c5aa-47a0-8142-1f727875c8dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '1aa8f896-bce9-42d4-9fed-ab613f3c849d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102478) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:18:19.217901 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-fab55734-5775-4612-9f7f-1c57aa2f34b0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:19.218293 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fab55734-5775-4612-9f7f-1c57aa2f34b0 None None] Bound using segment: {'id': '3ef2ef73-c5aa-47a0-8142-1f727875c8dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '1aa8f896-bce9-42d4-9fed-ab613f3c849d'} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:18:19.218767 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-fab55734-5775-4612-9f7f-1c57aa2f34b0 None None] Bound port: 58b0d62e-b026-4bd6-8b85-7faeb9c52285, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3ef2ef73-c5aa-47a0-8142-1f727875c8dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '1aa8f896-bce9-42d4-9fed-ab613f3c849d'}}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:18:19.219146 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-fab55734-5775-4612-9f7f-1c57aa2f34b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:19.283833 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-fab55734-5775-4612-9f7f-1c57aa2f34b0 None None] For port 58b0d62e-b026-4bd6-8b85-7faeb9c52285, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102478) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:18:19.287792 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-fab55734-5775-4612-9f7f-1c57aa2f34b0 None None] For port 58b0d62e-b026-4bd6-8b85-7faeb9c52285, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=58b0d62e-b026-4bd6-8b85-7faeb9c52285,segment=NetworkSegment(3ef2ef73-c5aa-47a0-8142-1f727875c8dd),segment_id=3ef2ef73-c5aa-47a0-8142-1f727875c8dd)] {{(pid=102478) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:18:19.292754 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-fab55734-5775-4612-9f7f-1c57aa2f34b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:19.359222 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fab55734-5775-4612-9f7f-1c57aa2f34b0 None None] Pushing event updated for resources: {'Port': ['ID=58b0d62e-b026-4bd6-8b85-7faeb9c52285,revision_number=2']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:19.400037 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-49b0b67c-9102-4f00-9713-3ffd57d2021d admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:19.420519 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-49b0b67c-9102-4f00-9713-3ffd57d2021d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:19.550179 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [None req-49b0b67c-9102-4f00-9713-3ffd57d2021d admin admin] Allocated IP 172.27.1.144 (9b4e4b31-551f-45a9-b26a-cb44ee20a17d/f277b899-8779-420e-8a8d-bfcd5eb7f012/d6978734-b7c5-4b75-aefa-c920ccba2639) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:18:19.566827 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] Sync routers for ids ['4540c62c-8273-49c3-be97-477e91b60f59'] in dv-cinder-816443-2-iscsi {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:18:19.578414 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] Routers {'4540c62c-8273-49c3-be97-477e91b60f59'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:18:19.579109 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:17:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['4540c62c-8273-49c3-be97-477e91b60f59'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:18:19.675663 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-49b0b67c-9102-4f00-9713-3ffd57d2021d admin admin] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:19.713463 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-49b0b67c-9102-4f00-9713-3ffd57d2021d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:19.754117 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-49b0b67c-9102-4f00-9713-3ffd57d2021d admin admin] Network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:18:19.758637 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-49b0b67c-9102-4f00-9713-3ffd57d2021d admin admin] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:18:19.763295 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49b0b67c-9102-4f00-9713-3ffd57d2021d admin admin] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:18:19.766348 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49b0b67c-9102-4f00-9713-3ffd57d2021d admin admin] Pushing event updated for resources: {'Port': ['ID=d6978734-b7c5-4b75-aefa-c920ccba2639,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:19.789483 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] Set router 4540c62c-8273-49c3-be97-477e91b60f59 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:18:19.996645 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4540c62c-8273-49c3-be97-477e91b60f59', 'name': 'tempest-TestShelveInstance-1513497678-router', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:16Z', 'revision_number': 4, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'gw_port': {'id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:88:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '4e2d29fc-c33c-4d30-8150-d0a0a014a682', 'name': '', 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'mac_address': 'fa:16:3e:66:ed:ce', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:16Z', 'updated_at': '2021-12-24T05:18:16Z', 'revision_number': 2, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'subnets': [{'id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:18:20.015459 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-49b0b67c-9102-4f00-9713-3ffd57d2021d admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:20.029603 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] Checking router: 4540c62c-8273-49c3-be97-477e91b60f59 for host: dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:18:20.029930 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] Updating router 4540c62c-8273-49c3-be97-477e91b60f59 port 4e2d29fc-c33c-4d30-8150-d0a0a014a682 binding host dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 24 05:18:20.060790 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:20.236902 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-49b0b67c-9102-4f00-9713-3ffd57d2021d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-546295', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-545958'] for router, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:20.326411 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af7da054-af04-46bc-9c31-de9b875af8c7 None None] Network 1aa8f896-bce9-42d4-9fed-ab613f3c849d requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:18:20.328519 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 58b0d62e-b026-4bd6-8b85-7faeb9c52285 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:18:20.384943 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] Publish callbacks [] for port, precommit_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:20.391252 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:20.418788 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-49b0b67c-9102-4f00-9713-3ffd57d2021d admin admin] Router 87b3737e-7166-4758-b8b4-aa00f9989409 is scheduled to L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 with binding_index 1 {{(pid=102476) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 24 05:18:20.428789 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-be78b133-d2fd-4e9e-975f-241da9b36a6d None None] Provisioning complete for port 58b0d62e-b026-4bd6-8b85-7faeb9c52285 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:18:20.429020 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-be78b133-d2fd-4e9e-975f-241da9b36a6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:20.484183 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14bee8f6-ef18-4dc0-8d5b-450aa6cc8fa7 None None] Pushing event updated for resources: {'Port': ['ID=4e2d29fc-c33c-4d30-8150-d0a0a014a682,revision_number=3']} {{(pid=102479) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:20.498753 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bee8f6-ef18-4dc0-8d5b-450aa6cc8fa7 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:20.499387 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bee8f6-ef18-4dc0-8d5b-450aa6cc8fa7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:20.499902 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bee8f6-ef18-4dc0-8d5b-450aa6cc8fa7 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:20.500398 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bee8f6-ef18-4dc0-8d5b-450aa6cc8fa7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:20.500941 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bee8f6-ef18-4dc0-8d5b-450aa6cc8fa7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:20.501446 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bee8f6-ef18-4dc0-8d5b-450aa6cc8fa7 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:20.501931 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bee8f6-ef18-4dc0-8d5b-450aa6cc8fa7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:20.502415 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bee8f6-ef18-4dc0-8d5b-450aa6cc8fa7 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:20.502897 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bee8f6-ef18-4dc0-8d5b-450aa6cc8fa7 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:20.503410 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bee8f6-ef18-4dc0-8d5b-450aa6cc8fa7 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:20.503893 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bee8f6-ef18-4dc0-8d5b-450aa6cc8fa7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:20.504381 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bee8f6-ef18-4dc0-8d5b-450aa6cc8fa7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:20.504885 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14bee8f6-ef18-4dc0-8d5b-450aa6cc8fa7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102479) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:20.513452 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] Attempting to bind port 4e2d29fc-c33c-4d30-8150-d0a0a014a682 on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:18:20.514169 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] Attempting to bind port 4e2d29fc-c33c-4d30-8150-d0a0a014a682 by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': '752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f'}] {{(pid=102479) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:18:20.514726 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] Attempting to bind port 4e2d29fc-c33c-4d30-8150-d0a0a014a682 on network 568053f6-6cfe-408d-be45-92751af5d67f {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:18:20.517404 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 58b0d62e-b026-4bd6-8b85-7faeb9c52285 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:18:20.518051 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:20.520995 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 17, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:18:20.521372 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] Checking segment: {'id': '752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102479) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:18:20.521979 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:20.522592 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] Bound using segment: {'id': '752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f'} {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:18:20.523300 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] Bound port: 4e2d29fc-c33c-4d30-8150-d0a0a014a682, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f'}}] {{(pid=102479) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:18:20.524006 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:20.579470 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-49b0b67c-9102-4f00-9713-3ffd57d2021d admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:18:20.617829 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-49b0b67c-9102-4f00-9713-3ffd57d2021d admin admin] Publish callbacks [] for router, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:20.618811 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-49b0b67c-9102-4f00-9713-3ffd57d2021d admin admin] 10.222.0.43 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 1.9392109 Dec 24 05:18:20.626352 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 36056) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:18:20.631090 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] Sync routers for ids ['87b3737e-7166-4758-b8b4-aa00f9989409'] in dv-cinder-816443-2-iscsi {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:18:20.631628 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.db [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] For port 4e2d29fc-c33c-4d30-8150-d0a0a014a682, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102479) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:18:20.636670 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.db [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] For port 4e2d29fc-c33c-4d30-8150-d0a0a014a682, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=4e2d29fc-c33c-4d30-8150-d0a0a014a682,segment=NetworkSegment(752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5),segment_id=752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5)] {{(pid=102479) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:18:20.646029 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:20.674763 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:20.683325 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-be78b133-d2fd-4e9e-975f-241da9b36a6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:20.687496 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] Routers {'87b3737e-7166-4758-b8b4-aa00f9989409'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:18:20.688099 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:17:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['87b3737e-7166-4758-b8b4-aa00f9989409'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:18:20.726827 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14bee8f6-ef18-4dc0-8d5b-450aa6cc8fa7 None None] Pushing event updated for resources: {'Port': ['ID=4e2d29fc-c33c-4d30-8150-d0a0a014a682,revision_number=4']} {{(pid=102479) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:20.742139 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] Routers {'4540c62c-8273-49c3-be97-477e91b60f59'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:18:20.743221 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:17:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['4540c62c-8273-49c3-be97-477e91b60f59'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:18:20.889206 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] Set router 4540c62c-8273-49c3-be97-477e91b60f59 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:18:20.983334 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-be78b133-d2fd-4e9e-975f-241da9b36a6d None None] For port 58b0d62e-b026-4bd6-8b85-7faeb9c52285, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=58b0d62e-b026-4bd6-8b85-7faeb9c52285,segment=NetworkSegment(3ef2ef73-c5aa-47a0-8142-1f727875c8dd),segment_id=3ef2ef73-c5aa-47a0-8142-1f727875c8dd)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:18:20.993449 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:21.038739 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-be78b133-d2fd-4e9e-975f-241da9b36a6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:21.114348 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4540c62c-8273-49c3-be97-477e91b60f59', 'name': 'tempest-TestShelveInstance-1513497678-router', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:16Z', 'revision_number': 4, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'gw_port': {'id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:88:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '4e2d29fc-c33c-4d30-8150-d0a0a014a682', 'name': '', 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'mac_address': 'fa:16:3e:66:ed:ce', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:16Z', 'updated_at': '2021-12-24T05:18:20Z', 'revision_number': 4, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'subnets': [{'id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:18:21.118732 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] Set router 87b3737e-7166-4758-b8b4-aa00f9989409 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:18:21.142908 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c7d7647-b4ab-43d2-8b63-c9f1a165a828 None None] The sync data for ids ['4540c62c-8273-49c3-be97-477e91b60f59'] in dv-cinder-816443-2-iscsi is: [{'id': '4540c62c-8273-49c3-be97-477e91b60f59', 'name': 'tempest-TestShelveInstance-1513497678-router', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:16Z', 'revision_number': 4, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'gw_port': {'id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:88:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '4e2d29fc-c33c-4d30-8150-d0a0a014a682', 'name': '', 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'mac_address': 'fa:16:3e:66:ed:ce', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:16Z', 'updated_at': '2021-12-24T05:18:20Z', 'revision_number': 4, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'subnets': [{'id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:18:21.172828 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:21.173579 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.db.api [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102478) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 24 05:18:21.173931 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG oslo_db.api [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 24 05:18:21.207399 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be78b133-d2fd-4e9e-975f-241da9b36a6d None None] Pushing event updated for resources: {'Port': ['ID=58b0d62e-b026-4bd6-8b85-7faeb9c52285,revision_number=3']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:21.226178 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-ed70f50b-bef5-47f6-8514-5180ebd764fb None None] Provisioning complete for port 58b0d62e-b026-4bd6-8b85-7faeb9c52285 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:18:21.226544 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-ed70f50b-bef5-47f6-8514-5180ebd764fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:21.350124 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Allocated IP 172.20.0.1 (1aa8f896-bce9-42d4-9fed-ab613f3c849d/ff102b47-664d-4cd0-a913-67c8b37fa995/7d1d24df-2ff5-4879-aa4d-464654d25167) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:18:21.409576 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87b3737e-7166-4758-b8b4-aa00f9989409', 'name': 'tempest-TestShelveInstance-1766906089-router', 'tenant_id': '905e5afd4e554da8aa686e9236199822', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.144'}], 'enable_snat': True}, 'gw_port_id': 'd6978734-b7c5-4b75-aefa-c920ccba2639', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:18:18Z', 'updated_at': '2021-12-24T05:18:19Z', 'revision_number': 3, 'project_id': '905e5afd4e554da8aa686e9236199822', 'gw_port': {'id': 'd6978734-b7c5-4b75-aefa-c920ccba2639', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:2e:86', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87b3737e-7166-4758-b8b4-aa00f9989409', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:19Z', 'updated_at': '2021-12-24T05:18:19Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:18:21.411411 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-ed70f50b-bef5-47f6-8514-5180ebd764fb None None] Provisioning complete for port 4e2d29fc-c33c-4d30-8150-d0a0a014a682 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:18:21.411783 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-ed70f50b-bef5-47f6-8514-5180ebd764fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:21.457184 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] Checking router: 87b3737e-7166-4758-b8b4-aa00f9989409 for host: dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:18:21.457461 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] Updating router 87b3737e-7166-4758-b8b4-aa00f9989409 port d6978734-b7c5-4b75-aefa-c920ccba2639 binding host dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 24 05:18:21.460547 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:21.497541 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:21.498683 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:21.539276 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Network 1aa8f896-bce9-42d4-9fed-ab613f3c849d is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:18:21.544620 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:18:21.548347 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:18:21.554202 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Pushing event updated for resources: {'Port': ['ID=7d1d24df-2ff5-4879-aa4d-464654d25167,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:21.581757 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:21.582183 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:21.582981 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:21.583384 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:21.583779 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:21.584175 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:21.584651 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:21.584977 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:21.585365 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:21.585754 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:21.586141 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:21.586536 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:21.586921 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:21.610088 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-545913'] for router_interface, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:21.643398 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-ed70f50b-bef5-47f6-8514-5180ebd764fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:21.750010 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:21.761707 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-ed70f50b-bef5-47f6-8514-5180ebd764fb None None] For port 4e2d29fc-c33c-4d30-8150-d0a0a014a682, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=4e2d29fc-c33c-4d30-8150-d0a0a014a682,segment=NetworkSegment(752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5),segment_id=752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:18:21.773691 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-ed70f50b-bef5-47f6-8514-5180ebd764fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:21.784910 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device dfc571f6-d53d-4920-be50-bf7e0c29ff2e up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:18:21.894504 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed70f50b-bef5-47f6-8514-5180ebd764fb None None] Pushing event updated for resources: {'Port': ['ID=4e2d29fc-c33c-4d30-8150-d0a0a014a682,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:21.938798 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:21.944081 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:21.945591 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-bc44ad48-cbe8-48d1-9a1b-96c51dc99e40 None None] Provisioning complete for port 7d1d24df-2ff5-4879-aa4d-464654d25167 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:18:21.945959 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-bc44ad48-cbe8-48d1-9a1b-96c51dc99e40 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:21.981225 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port dfc571f6-d53d-4920-be50-bf7e0c29ff2e triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:18:21.981609 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:22.013077 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] Publish callbacks [] for port, precommit_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:22.014973 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Pushing event updated for resources: {'Port': ['ID=7d1d24df-2ff5-4879-aa4d-464654d25167,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:22.017428 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-627486', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-548585'] for router_interface, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:22.028754 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:22.035967 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-bc44ad48-cbe8-48d1-9a1b-96c51dc99e40 None None] Port 7d1d24df-2ff5-4879-aa4d-464654d25167 cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 05:18:22.092297 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] Attempting to bind port d6978734-b7c5-4b75-aefa-c920ccba2639 on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:18:22.092705 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] Attempting to bind port d6978734-b7c5-4b75-aefa-c920ccba2639 by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:18:22.093071 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] Attempting to bind port d6978734-b7c5-4b75-aefa-c920ccba2639 on network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:18:22.104555 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9ed8e0d-2106-494f-b1c6-0d08a0f84707 None None] Pushing event updated for resources: {'Port': ['ID=d6978734-b7c5-4b75-aefa-c920ccba2639,revision_number=2']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:22.108293 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 17, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:18:22.108699 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] Checking segment: {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102478) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:18:22.109103 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:22.109227 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Network 1aa8f896-bce9-42d4-9fed-ab613f3c849d is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:18:22.109488 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] Bound using segment: {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'} {{(pid=102478) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:18:22.109962 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.managers [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] Bound port: d6978734-b7c5-4b75-aefa-c920ccba2639, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '826ebba6-2eef-449f-97d0-d8ba20232e56', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d'}}] {{(pid=102478) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:18:22.110345 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:22.110791 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:18:22.198762 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] For port d6978734-b7c5-4b75-aefa-c920ccba2639, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102478) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:18:22.202908 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] For port d6978734-b7c5-4b75-aefa-c920ccba2639, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=d6978734-b7c5-4b75-aefa-c920ccba2639,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102478) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:18:22.210488 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:22.253246 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Router 87b3737e-7166-4758-b8b4-aa00f9989409 has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102476) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:18:22.280643 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9ed8e0d-2106-494f-b1c6-0d08a0f84707 None None] Pushing event updated for resources: {'Port': ['ID=d6978734-b7c5-4b75-aefa-c920ccba2639,revision_number=3']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:22.283870 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] Routers {'87b3737e-7166-4758-b8b4-aa00f9989409'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:18:22.284581 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:17:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['87b3737e-7166-4758-b8b4-aa00f9989409'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:18:22.329752 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 58b0d62e-b026-4bd6-8b85-7faeb9c52285 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:18:22.395947 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:18:22.401574 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-0fe09525-81f9-43a4-956f-17b3a55f797e admin admin] 10.222.0.43 "PUT /v2.0/routers/87b3737e-7166-4758-b8b4-aa00f9989409/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7730014 Dec 24 05:18:22.425889 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-7288c55d-febc-4ff3-8794-37f4d4b81fe6 None None] Provisioning complete for port 7d1d24df-2ff5-4879-aa4d-464654d25167 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:18:22.426459 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-7288c55d-febc-4ff3-8794-37f4d4b81fe6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:22.469322 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] Set router 87b3737e-7166-4758-b8b4-aa00f9989409 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:18:22.645282 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-7288c55d-febc-4ff3-8794-37f4d4b81fe6 None None] Port 7d1d24df-2ff5-4879-aa4d-464654d25167 cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 05:18:22.648327 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 58b0d62e-b026-4bd6-8b85-7faeb9c52285 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:18:22.648650 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:22.836788 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 4e2d29fc-c33c-4d30-8150-d0a0a014a682 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:18:22.869164 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 36064) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:18:22.874311 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-13185871-d009-477e-93b6-e2b1d82bc2fe tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1149674809', 'description': 'tempest-secgroup-smoke-1149674809 description', 'project_id': '274c3c6f555f48ad93189e73c71c5ffe'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:18:22.899102 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-13185871-d009-477e-93b6-e2b1d82bc2fe tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for security_group, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:22.906263 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87b3737e-7166-4758-b8b4-aa00f9989409', 'name': 'tempest-TestShelveInstance-1766906089-router', 'tenant_id': '905e5afd4e554da8aa686e9236199822', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.144'}], 'enable_snat': True}, 'gw_port_id': 'd6978734-b7c5-4b75-aefa-c920ccba2639', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:18:18Z', 'updated_at': '2021-12-24T05:18:21Z', 'revision_number': 4, 'project_id': '905e5afd4e554da8aa686e9236199822', 'gw_port': {'id': 'd6978734-b7c5-4b75-aefa-c920ccba2639', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:2e:86', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87b3737e-7166-4758-b8b4-aa00f9989409', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:19Z', 'updated_at': '2021-12-24T05:18:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '7d1d24df-2ff5-4879-aa4d-464654d25167', 'name': '', 'network_id': '1aa8f896-bce9-42d4-9fed-ab613f3c849d', 'tenant_id': '905e5afd4e554da8aa686e9236199822', 'mac_address': 'fa:16:3e:00:6d:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87b3737e-7166-4758-b8b4-aa00f9989409', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': 'ff102b47-664d-4cd0-a913-67c8b37fa995', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:21Z', 'updated_at': '2021-12-24T05:18:21Z', 'revision_number': 2, 'project_id': '905e5afd4e554da8aa686e9236199822', 'subnets': [{'id': 'ff102b47-664d-4cd0-a913-67c8b37fa995', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:18:22.907904 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 4e2d29fc-c33c-4d30-8150-d0a0a014a682 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:18:22.908267 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:22.948855 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c64701f6-c097-4c1e-9b3e-e02f51af1104 None None] The sync data for ids ['87b3737e-7166-4758-b8b4-aa00f9989409'] in dv-cinder-816443-2-iscsi is: [{'id': '87b3737e-7166-4758-b8b4-aa00f9989409', 'name': 'tempest-TestShelveInstance-1766906089-router', 'tenant_id': '905e5afd4e554da8aa686e9236199822', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.144'}], 'enable_snat': True}, 'gw_port_id': 'd6978734-b7c5-4b75-aefa-c920ccba2639', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:18:18Z', 'updated_at': '2021-12-24T05:18:21Z', 'revision_number': 4, 'project_id': '905e5afd4e554da8aa686e9236199822', 'gw_port': {'id': 'd6978734-b7c5-4b75-aefa-c920ccba2639', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:2e:86', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87b3737e-7166-4758-b8b4-aa00f9989409', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:19Z', 'updated_at': '2021-12-24T05:18:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '7d1d24df-2ff5-4879-aa4d-464654d25167', 'name': '', 'network_id': '1aa8f896-bce9-42d4-9fed-ab613f3c849d', 'tenant_id': '905e5afd4e554da8aa686e9236199822', 'mac_address': 'fa:16:3e:00:6d:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87b3737e-7166-4758-b8b4-aa00f9989409', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': 'ff102b47-664d-4cd0-a913-67c8b37fa995', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:21Z', 'updated_at': '2021-12-24T05:18:21Z', 'revision_number': 2, 'project_id': '905e5afd4e554da8aa686e9236199822', 'subnets': [{'id': 'ff102b47-664d-4cd0-a913-67c8b37fa995', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:18:22.968475 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-13185871-d009-477e-93b6-e2b1d82bc2fe tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for security_group, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:22.974384 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-13185871-d009-477e-93b6-e2b1d82bc2fe tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.007420 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13185871-d009-477e-93b6-e2b1d82bc2fe tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c7dba9cf-1323-4832-9e0e-1333add8e816,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:23.018952 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-13185871-d009-477e-93b6-e2b1d82bc2fe tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.020219 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-13185871-d009-477e-93b6-e2b1d82bc2fe tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.1500304 Dec 24 05:18:23.023451 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 36066) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:18:23.030145 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-48272c07-d67e-49d2-ab65-9a5271dc4641 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Request body: {'security_group_rule': {'security_group_id': 'c7dba9cf-1323-4832-9e0e-1333add8e816', 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:18:23.060045 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-48272c07-d67e-49d2-ab65-9a5271dc4641 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.118778 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-48272c07-d67e-49d2-ab65-9a5271dc4641 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.132969 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-48272c07-d67e-49d2-ab65-9a5271dc4641 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.157517 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48272c07-d67e-49d2-ab65-9a5271dc4641 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d5a37b49-3be9-4446-b42f-c4d5cb80b6c3,revision_number=0']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:23.166018 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-48272c07-d67e-49d2-ab65-9a5271dc4641 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.167303 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-48272c07-d67e-49d2-ab65-9a5271dc4641 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1419580 Dec 24 05:18:23.170395 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 36068) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:18:23.175059 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-c6dc4607-08e3-47c2-a47b-d29953b118b4 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Request body: {'security_group_rule': {'security_group_id': 'c7dba9cf-1323-4832-9e0e-1333add8e816', 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:18:23.212322 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c6dc4607-08e3-47c2-a47b-d29953b118b4 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.227758 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-9d01288e-3b6b-420b-b69c-7616f72fbbae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.272670 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c6dc4607-08e3-47c2-a47b-d29953b118b4 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.277615 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c6dc4607-08e3-47c2-a47b-d29953b118b4 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.299226 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6dc4607-08e3-47c2-a47b-d29953b118b4 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=37f7376f-8edb-48d8-9e8f-b7a1103e761e,revision_number=0']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:23.304989 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-c6dc4607-08e3-47c2-a47b-d29953b118b4 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.308924 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-c6dc4607-08e3-47c2-a47b-d29953b118b4 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1350045 Dec 24 05:18:23.309117 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 36070) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:18:23.313748 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-314f3827-a715-48df-aa23-0eb80589dda6 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Request body: {'security_group_rule': {'security_group_id': 'c7dba9cf-1323-4832-9e0e-1333add8e816', 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:18:23.342959 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-314f3827-a715-48df-aa23-0eb80589dda6 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.403561 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-314f3827-a715-48df-aa23-0eb80589dda6 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.408824 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-314f3827-a715-48df-aa23-0eb80589dda6 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.427436 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-314f3827-a715-48df-aa23-0eb80589dda6 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b5581dc1-81d7-466e-84fa-2aacd04aa304,revision_number=0']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:23.435984 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-314f3827-a715-48df-aa23-0eb80589dda6 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.439682 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-314f3827-a715-48df-aa23-0eb80589dda6 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1271219 Dec 24 05:18:23.440136 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 36072) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:18:23.445103 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-97fd8e55-ac01-40c5-b054-52ace687639a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Request body: {'security_group_rule': {'security_group_id': 'c7dba9cf-1323-4832-9e0e-1333add8e816', 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:18:23.475757 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-97fd8e55-ac01-40c5-b054-52ace687639a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.537846 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-97fd8e55-ac01-40c5-b054-52ace687639a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.543121 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-97fd8e55-ac01-40c5-b054-52ace687639a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.566973 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97fd8e55-ac01-40c5-b054-52ace687639a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9a0dd3cc-0c0a-4270-8ff8-6981fc56456f,revision_number=0']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:23.576909 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-97fd8e55-ac01-40c5-b054-52ace687639a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.578088 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-97fd8e55-ac01-40c5-b054-52ace687639a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1367192 Dec 24 05:18:23.579615 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97fd8e55-ac01-40c5-b054-52ace687639a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:23.579961 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97fd8e55-ac01-40c5-b054-52ace687639a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:23.580297 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97fd8e55-ac01-40c5-b054-52ace687639a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:23.580734 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97fd8e55-ac01-40c5-b054-52ace687639a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:23.581068 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97fd8e55-ac01-40c5-b054-52ace687639a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:23.581391 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97fd8e55-ac01-40c5-b054-52ace687639a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:23.581518 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 36074) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:18:23.581712 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97fd8e55-ac01-40c5-b054-52ace687639a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:23.582033 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97fd8e55-ac01-40c5-b054-52ace687639a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:23.582351 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97fd8e55-ac01-40c5-b054-52ace687639a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:23.583032 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97fd8e55-ac01-40c5-b054-52ace687639a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:23.583426 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97fd8e55-ac01-40c5-b054-52ace687639a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:23.583873 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97fd8e55-ac01-40c5-b054-52ace687639a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:23.584273 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97fd8e55-ac01-40c5-b054-52ace687639a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:23.586968 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-1b84e787-497d-4034-9923-399411283251 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Request body: {'security_group_rule': {'security_group_id': 'c7dba9cf-1323-4832-9e0e-1333add8e816', 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:18:23.615252 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.securitygroups_db [None req-1b84e787-497d-4034-9923-399411283251 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Project 274c3c6f555f48ad93189e73c71c5ffe added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 24 05:18:23.620114 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1b84e787-497d-4034-9923-399411283251 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.676774 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1b84e787-497d-4034-9923-399411283251 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.681423 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1b84e787-497d-4034-9923-399411283251 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.697723 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b84e787-497d-4034-9923-399411283251 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=80ed3a7a-d521-457d-9211-8567ebd3af67,revision_number=0']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:23.707986 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1b84e787-497d-4034-9923-399411283251 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.709217 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-1b84e787-497d-4034-9923-399411283251 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1265404 Dec 24 05:18:23.711960 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 36076) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:18:23.716370 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [None req-ae4cf09d-512b-4344-9c2f-82a29eb15e47 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Request body: {'security_group_rule': {'security_group_id': 'c7dba9cf-1323-4832-9e0e-1333add8e816', 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:18:23.740984 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.db.securitygroups_db [None req-ae4cf09d-512b-4344-9c2f-82a29eb15e47 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Project 274c3c6f555f48ad93189e73c71c5ffe added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 24 05:18:23.745567 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ae4cf09d-512b-4344-9c2f-82a29eb15e47 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.803441 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ae4cf09d-512b-4344-9c2f-82a29eb15e47 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.808940 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ae4cf09d-512b-4344-9c2f-82a29eb15e47 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-543449'] for security_group_rule, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.834428 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae4cf09d-512b-4344-9c2f-82a29eb15e47 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c1217b56-1bf1-43d2-8c28-2b53cb714fc9,revision_number=0']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:23.842399 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-ae4cf09d-512b-4344-9c2f-82a29eb15e47 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:23.843861 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-ae4cf09d-512b-4344-9c2f-82a29eb15e47 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1309762 Dec 24 05:18:24.300313 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device d6978734-b7c5-4b75-aefa-c920ccba2639 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:18:24.359425 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port d6978734-b7c5-4b75-aefa-c920ccba2639 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:18:24.359883 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:24.439675 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:24.463400 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] For port d6978734-b7c5-4b75-aefa-c920ccba2639, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=d6978734-b7c5-4b75-aefa-c920ccba2639,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:18:24.468556 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:24.518404 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Pushing event updated for resources: {'Port': ['ID=d6978734-b7c5-4b75-aefa-c920ccba2639,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:25.210719 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] Sync routers for ids ['87b3737e-7166-4758-b8b4-aa00f9989409'] in dv-cinder-816443-2-iscsi {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:18:25.222908 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] Routers {'87b3737e-7166-4758-b8b4-aa00f9989409'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:18:25.223524 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:17:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['87b3737e-7166-4758-b8b4-aa00f9989409'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:18:25.311218 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-4dc129b4-d907-4c36-8d5a-29c2645555e8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:25.344280 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] Set router 87b3737e-7166-4758-b8b4-aa00f9989409 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:18:25.641696 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87b3737e-7166-4758-b8b4-aa00f9989409', 'name': 'tempest-TestShelveInstance-1766906089-router', 'tenant_id': '905e5afd4e554da8aa686e9236199822', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.144'}], 'enable_snat': True}, 'gw_port_id': 'd6978734-b7c5-4b75-aefa-c920ccba2639', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:18:18Z', 'updated_at': '2021-12-24T05:18:21Z', 'revision_number': 4, 'project_id': '905e5afd4e554da8aa686e9236199822', 'gw_port': {'id': 'd6978734-b7c5-4b75-aefa-c920ccba2639', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:2e:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87b3737e-7166-4758-b8b4-aa00f9989409', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:19Z', 'updated_at': '2021-12-24T05:18:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '7d1d24df-2ff5-4879-aa4d-464654d25167', 'name': '', 'network_id': '1aa8f896-bce9-42d4-9fed-ab613f3c849d', 'tenant_id': '905e5afd4e554da8aa686e9236199822', 'mac_address': 'fa:16:3e:00:6d:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87b3737e-7166-4758-b8b4-aa00f9989409', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': 'ff102b47-664d-4cd0-a913-67c8b37fa995', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:21Z', 'updated_at': '2021-12-24T05:18:21Z', 'revision_number': 2, 'project_id': '905e5afd4e554da8aa686e9236199822', 'subnets': [{'id': 'ff102b47-664d-4cd0-a913-67c8b37fa995', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:18:25.667830 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] Checking router: 87b3737e-7166-4758-b8b4-aa00f9989409 for host: dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:18:25.668159 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] Updating router 87b3737e-7166-4758-b8b4-aa00f9989409 port 7d1d24df-2ff5-4879-aa4d-464654d25167 binding host dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 24 05:18:25.692921 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:25.971696 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] Publish callbacks [] for port, precommit_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:25.979135 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:26.045441 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c49dd2e4-032c-4ba6-a9a3-89c983101795 None None] Pushing event updated for resources: {'Port': ['ID=7d1d24df-2ff5-4879-aa4d-464654d25167,revision_number=3']} {{(pid=102479) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:26.076085 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] Attempting to bind port 7d1d24df-2ff5-4879-aa4d-464654d25167 on host dv-cinder-816443-2-iscsi for vnic_type normal with profile {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:18:26.076479 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] Attempting to bind port 7d1d24df-2ff5-4879-aa4d-464654d25167 by drivers openvswitch,hyperv on host dv-cinder-816443-2-iscsi at level 0 using segments [{'id': '3ef2ef73-c5aa-47a0-8142-1f727875c8dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '1aa8f896-bce9-42d4-9fed-ab613f3c849d'}] {{(pid=102479) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:18:26.076895 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] Attempting to bind port 7d1d24df-2ff5-4879-aa4d-464654d25167 on network 1aa8f896-bce9-42d4-9fed-ab613f3c849d {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:18:26.083115 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] Checking agent: {'id': '4d358dfb-5d74-4244-beeb-560f37ebdb57', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816443-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 51, 29), 'started_at': datetime.datetime(2021, 12, 24, 4, 51, 59), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 17, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816443-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:18:26.083493 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] Checking segment: {'id': '3ef2ef73-c5aa-47a0-8142-1f727875c8dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '1aa8f896-bce9-42d4-9fed-ab613f3c849d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102479) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:18:26.083889 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:26.084268 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] Bound using segment: {'id': '3ef2ef73-c5aa-47a0-8142-1f727875c8dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '1aa8f896-bce9-42d4-9fed-ab613f3c849d'} {{(pid=102479) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:18:26.084781 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.managers [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] Bound port: 7d1d24df-2ff5-4879-aa4d-464654d25167, host: dv-cinder-816443-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3ef2ef73-c5aa-47a0-8142-1f727875c8dd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '1aa8f896-bce9-42d4-9fed-ab613f3c849d'}}] {{(pid=102479) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:18:26.085167 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:26.152910 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.db [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] For port 7d1d24df-2ff5-4879-aa4d-464654d25167, host dv-cinder-816443-2-iscsi, cleared binding levels {{(pid=102479) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:18:26.156449 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.plugins.ml2.db [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] For port 7d1d24df-2ff5-4879-aa4d-464654d25167, host dv-cinder-816443-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=7d1d24df-2ff5-4879-aa4d-464654d25167,segment=NetworkSegment(3ef2ef73-c5aa-47a0-8142-1f727875c8dd),segment_id=3ef2ef73-c5aa-47a0-8142-1f727875c8dd)] {{(pid=102479) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:18:26.161600 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron_lib.callbacks.manager [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102479) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:26.219644 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c49dd2e4-032c-4ba6-a9a3-89c983101795 None None] Pushing event updated for resources: {'Port': ['ID=7d1d24df-2ff5-4879-aa4d-464654d25167,revision_number=4']} {{(pid=102479) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:26.222368 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] Routers {'87b3737e-7166-4758-b8b4-aa00f9989409'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:18:26.222918 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:18:25Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['87b3737e-7166-4758-b8b4-aa00f9989409'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:18:26.288498 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device d6978734-b7c5-4b75-aefa-c920ccba2639 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:18:26.320590 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-25611ce4-8c74-4ff2-84ab-4f1a9cc0bc34 None None] Provisioning complete for port 7d1d24df-2ff5-4879-aa4d-464654d25167 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:18:26.321712 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-25611ce4-8c74-4ff2-84ab-4f1a9cc0bc34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:26.340136 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] Set router 87b3737e-7166-4758-b8b4-aa00f9989409 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:18:26.413954 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port d6978734-b7c5-4b75-aefa-c920ccba2639 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:18:26.414331 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:26.453356 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-25611ce4-8c74-4ff2-84ab-4f1a9cc0bc34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:26.494988 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-25611ce4-8c74-4ff2-84ab-4f1a9cc0bc34 None None] For port 7d1d24df-2ff5-4879-aa4d-464654d25167, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=7d1d24df-2ff5-4879-aa4d-464654d25167,segment=NetworkSegment(3ef2ef73-c5aa-47a0-8142-1f727875c8dd),segment_id=3ef2ef73-c5aa-47a0-8142-1f727875c8dd)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:18:26.500385 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-25611ce4-8c74-4ff2-84ab-4f1a9cc0bc34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:26.554904 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87b3737e-7166-4758-b8b4-aa00f9989409', 'name': 'tempest-TestShelveInstance-1766906089-router', 'tenant_id': '905e5afd4e554da8aa686e9236199822', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.144'}], 'enable_snat': True}, 'gw_port_id': 'd6978734-b7c5-4b75-aefa-c920ccba2639', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:18:18Z', 'updated_at': '2021-12-24T05:18:21Z', 'revision_number': 4, 'project_id': '905e5afd4e554da8aa686e9236199822', 'gw_port': {'id': 'd6978734-b7c5-4b75-aefa-c920ccba2639', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:2e:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87b3737e-7166-4758-b8b4-aa00f9989409', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:19Z', 'updated_at': '2021-12-24T05:18:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '7d1d24df-2ff5-4879-aa4d-464654d25167', 'name': '', 'network_id': '1aa8f896-bce9-42d4-9fed-ab613f3c849d', 'tenant_id': '905e5afd4e554da8aa686e9236199822', 'mac_address': 'fa:16:3e:00:6d:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87b3737e-7166-4758-b8b4-aa00f9989409', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': 'ff102b47-664d-4cd0-a913-67c8b37fa995', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:21Z', 'updated_at': '2021-12-24T05:18:26Z', 'revision_number': 4, 'project_id': '905e5afd4e554da8aa686e9236199822', 'subnets': [{'id': 'ff102b47-664d-4cd0-a913-67c8b37fa995', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:18:26.582348 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:26.588586 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6a868d4-cb4e-484b-81b3-b8a0958f4886 None None] The sync data for ids ['87b3737e-7166-4758-b8b4-aa00f9989409'] in dv-cinder-816443-2-iscsi is: [{'id': '87b3737e-7166-4758-b8b4-aa00f9989409', 'name': 'tempest-TestShelveInstance-1766906089-router', 'tenant_id': '905e5afd4e554da8aa686e9236199822', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.144'}], 'enable_snat': True}, 'gw_port_id': 'd6978734-b7c5-4b75-aefa-c920ccba2639', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:18:18Z', 'updated_at': '2021-12-24T05:18:21Z', 'revision_number': 4, 'project_id': '905e5afd4e554da8aa686e9236199822', 'gw_port': {'id': 'd6978734-b7c5-4b75-aefa-c920ccba2639', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:2e:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87b3737e-7166-4758-b8b4-aa00f9989409', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:19Z', 'updated_at': '2021-12-24T05:18:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '7d1d24df-2ff5-4879-aa4d-464654d25167', 'name': '', 'network_id': '1aa8f896-bce9-42d4-9fed-ab613f3c849d', 'tenant_id': '905e5afd4e554da8aa686e9236199822', 'mac_address': 'fa:16:3e:00:6d:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '87b3737e-7166-4758-b8b4-aa00f9989409', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': 'ff102b47-664d-4cd0-a913-67c8b37fa995', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:21Z', 'updated_at': '2021-12-24T05:18:26Z', 'revision_number': 4, 'project_id': '905e5afd4e554da8aa686e9236199822', 'subnets': [{'id': 'ff102b47-664d-4cd0-a913-67c8b37fa995', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:18:26.592486 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25611ce4-8c74-4ff2-84ab-4f1a9cc0bc34 None None] Pushing event updated for resources: {'Port': ['ID=7d1d24df-2ff5-4879-aa4d-464654d25167,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:26.620376 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-d60e3985-c1c9-4430-8d77-3ea49247caab None None] Provisioning complete for port 7d1d24df-2ff5-4879-aa4d-464654d25167 triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:18:26.620930 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-d60e3985-c1c9-4430-8d77-3ea49247caab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:28.013059 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:28.283704 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 7d1d24df-2ff5-4879-aa4d-464654d25167 up at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:18:28.342327 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Provisioning complete for port 7d1d24df-2ff5-4879-aa4d-464654d25167 triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:18:28.342705 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:28.584771 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:34.477088 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:18:46.580096 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5c341b56-b600-41a9-848b-94ef8137d744 req-d98fb8fc-5c15-41c3-ac17-9c84eabbbb37 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1149674809&fields=id&tenant_id=274c3c6f555f48ad93189e73c71c5ffe HTTP/1.1" status: 200 len: 267 time: 0.0444210 Dec 24 05:18:46.690740 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c341b56-b600-41a9-848b-94ef8137d744 req-24a60ef6-7408-4522-b98f-f552588003b1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:18:46.692203 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5c341b56-b600-41a9-848b-94ef8137d744 req-24a60ef6-7408-4522-b98f-f552588003b1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/networks?id=568053f6-6cfe-408d-be45-92751af5d67f HTTP/1.1" status: 200 len: 809 time: 0.1021006 Dec 24 05:18:46.710256 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5c341b56-b600-41a9-848b-94ef8137d744 req-2ef8f2b9-e4c9-40c9-8489-5a670aab686c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/quotas/274c3c6f555f48ad93189e73c71c5ffe HTTP/1.1" status: 200 len: 375 time: 0.0097525 Dec 24 05:18:46.763733 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5c341b56-b600-41a9-848b-94ef8137d744 req-8f0188b5-4c3b-4526-ad67-e1f29a5aa663 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?tenant_id=274c3c6f555f48ad93189e73c71c5ffe&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0481780 Dec 24 05:18:46.860389 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5c341b56-b600-41a9-848b-94ef8137d744 req-cafa6f56-05dd-4290-9718-676a4e8e0a78 service neutron] 10.222.0.43 "GET /v2.0/networks/568053f6-6cfe-408d-be45-92751af5d67f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852034 Dec 24 05:18:46.950084 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-5c341b56-b600-41a9-848b-94ef8137d744 req-0f2453a5-ad8f-46c1-88c6-fa18b179c2cd service neutron] 10.222.0.43 "GET /v2.0/networks/568053f6-6cfe-408d-be45-92751af5d67f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0821919 Dec 24 05:18:47.276091 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-ef87eb1b-21c3-468c-92e4-5da6a7ab0d16 req-c4f41258-280a-40cc-a6a2-641db81c2b0b tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 210 time: 0.0271504 Dec 24 05:18:48.327528 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c341b56-b600-41a9-848b-94ef8137d744 req-83c70f35-b049-4f20-bb0f-946bab8ea583 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:18:48.329033 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5c341b56-b600-41a9-848b-94ef8137d744 req-83c70f35-b049-4f20-bb0f-946bab8ea583 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.46 "GET /v2.0/networks?id=568053f6-6cfe-408d-be45-92751af5d67f HTTP/1.1" status: 200 len: 809 time: 0.1092329 Dec 24 05:18:48.377328 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-4bc4c7f1-9ea1-463b-9efa-362b22edab93 req-1fed867b-6391-459e-ac79-8a036f34ee85 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 210 time: 0.0300698 Dec 24 05:18:48.399982 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5c341b56-b600-41a9-848b-94ef8137d744 req-3cab379b-5cae-4ce0-8d09-d6482ae79591 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.46 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=274c3c6f555f48ad93189e73c71c5ffe HTTP/1.1" status: 200 len: 380 time: 0.0555086 Dec 24 05:18:48.409465 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-5c341b56-b600-41a9-848b-94ef8137d744 req-033fd6c5-bd1b-4c53-bd00-f333786be395 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Request body: {'port': {'device_id': '48617155-accf-48c5-bb2c-877a4d09e9c2', 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f', 'admin_state_up': True, 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'security_groups': ['c7dba9cf-1323-4832-9e0e-1333add8e816']}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:18:48.532641 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5c341b56-b600-41a9-848b-94ef8137d744 req-033fd6c5-bd1b-4c53-bd00-f333786be395 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Made reservation on behalf of 274c3c6f555f48ad93189e73c71c5ffe for: {'port': 1} {{(pid=102476) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 24 05:18:48.537425 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-5c341b56-b600-41a9-848b-94ef8137d744 req-033fd6c5-bd1b-4c53-bd00-f333786be395 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:48.678108 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_common [req-5c341b56-b600-41a9-848b-94ef8137d744 req-033fd6c5-bd1b-4c53-bd00-f333786be395 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Allocated IP 172.20.0.5 (568053f6-6cfe-408d-be45-92751af5d67f/0d93f37f-9870-4f45-a3dd-a7bfdf196cf7/2d25cf5e-4220-4a61-99ac-a037fc92718b) {{(pid=102476) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:18:48.821316 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-5c341b56-b600-41a9-848b-94ef8137d744 req-033fd6c5-bd1b-4c53-bd00-f333786be395 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for port, precommit_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:48.859201 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-5c341b56-b600-41a9-848b-94ef8137d744 req-033fd6c5-bd1b-4c53-bd00-f333786be395 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_create {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:48.906357 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5c341b56-b600-41a9-848b-94ef8137d744 req-033fd6c5-bd1b-4c53-bd00-f333786be395 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Network 568053f6-6cfe-408d-be45-92751af5d67f is already hosted by enough agents. {{(pid=102476) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:18:48.909811 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.base_scheduler [req-5c341b56-b600-41a9-848b-94ef8137d744 req-033fd6c5-bd1b-4c53-bd00-f333786be395 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Resources bound (agent type, host, resource id): {{(pid=102476) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:18:48.913398 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-5c341b56-b600-41a9-848b-94ef8137d744 req-033fd6c5-bd1b-4c53-bd00-f333786be395 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Received port after_create {{(pid=102476) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:18:48.944314 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-033fd6c5-bd1b-4c53-bd00-f333786be395 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Pushing event updated for resources: {'Port': ['ID=2d25cf5e-4220-4a61-99ac-a037fc92718b,revision_number=1']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:48.975274 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c341b56-b600-41a9-848b-94ef8137d744 req-033fd6c5-bd1b-4c53-bd00-f333786be395 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:18:48.975905 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-5c341b56-b600-41a9-848b-94ef8137d744 req-033fd6c5-bd1b-4c53-bd00-f333786be395 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:49.003422 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5c341b56-b600-41a9-848b-94ef8137d744 req-033fd6c5-bd1b-4c53-bd00-f333786be395 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.46 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5973217 Dec 24 05:18:49.022569 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.v2.base [req-5c341b56-b600-41a9-848b-94ef8137d744 req-0231a821-3441-4a38-8c7f-e28fe2e7dc17 service neutron] Request body: {'port': {'device_id': '48617155-accf-48c5-bb2c-877a4d09e9c2', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81644'}} {{(pid=102476) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:18:49.076886 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-5c341b56-b600-41a9-848b-94ef8137d744 req-0231a821-3441-4a38-8c7f-e28fe2e7dc17 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:49.173139 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-2cfb2d13-6476-4ca2-80ba-caf8bc333399 None None] Provisioning complete for port 2d25cf5e-4220-4a61-99ac-a037fc92718b triggered by entity DHCP. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:18:49.173825 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-2cfb2d13-6476-4ca2-80ba-caf8bc333399 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:49.209740 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-2cfb2d13-6476-4ca2-80ba-caf8bc333399 None None] Port 2d25cf5e-4220-4a61-99ac-a037fc92718b cannot update to ACTIVE because it is not bound. {{(pid=102478) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 24 05:18:49.547593 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88806b17-f434-4e28-ba52-5128136076ac req-609daafb-d87a-4a2c-9f95-07339f847841 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:18:49.549080 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-88806b17-f434-4e28-ba52-5128136076ac req-609daafb-d87a-4a2c-9f95-07339f847841 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 931 time: 0.0809329 Dec 24 05:18:49.644292 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-88806b17-f434-4e28-ba52-5128136076ac req-e856cf74-9888-4ca3-8d1f-ac19bb74b6f5 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0690651 Dec 24 05:18:49.694340 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [req-5c341b56-b600-41a9-848b-94ef8137d744 req-0231a821-3441-4a38-8c7f-e28fe2e7dc17 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2d25cf5e-4220-4a61-99ac-a037fc92718b {{(pid=102476) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:18:49.701719 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-5c341b56-b600-41a9-848b-94ef8137d744 req-0231a821-3441-4a38-8c7f-e28fe2e7dc17 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:49.714699 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.provisioning_blocks [req-5c341b56-b600-41a9-848b-94ef8137d744 req-0231a821-3441-4a38-8c7f-e28fe2e7dc17 service neutron] Transition to ACTIVE for port object 2d25cf5e-4220-4a61-99ac-a037fc92718b will not be triggered until provisioned by entity L2. {{(pid=102476) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 24 05:18:49.722649 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-5c341b56-b600-41a9-848b-94ef8137d744 req-0231a821-3441-4a38-8c7f-e28fe2e7dc17 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:49.772291 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0231a821-3441-4a38-8c7f-e28fe2e7dc17 service neutron] Pushing event updated for resources: {'Port': ['ID=2d25cf5e-4220-4a61-99ac-a037fc92718b,revision_number=2']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:49.841809 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-5c341b56-b600-41a9-848b-94ef8137d744 req-0231a821-3441-4a38-8c7f-e28fe2e7dc17 service neutron] Attempting to bind port 2d25cf5e-4220-4a61-99ac-a037fc92718b on host hv-cinder-81644 for vnic_type normal with profile {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 24 05:18:49.842140 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-5c341b56-b600-41a9-848b-94ef8137d744 req-0231a821-3441-4a38-8c7f-e28fe2e7dc17 service neutron] Attempting to bind port 2d25cf5e-4220-4a61-99ac-a037fc92718b by drivers openvswitch,hyperv on host hv-cinder-81644 at level 0 using segments [{'id': '752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f'}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 24 05:18:49.842466 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c341b56-b600-41a9-848b-94ef8137d744 req-0231a821-3441-4a38-8c7f-e28fe2e7dc17 service neutron] Attempting to bind port 2d25cf5e-4220-4a61-99ac-a037fc92718b on network 568053f6-6cfe-408d-be45-92751af5d67f {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:18:49.846831 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c341b56-b600-41a9-848b-94ef8137d744 req-0231a821-3441-4a38-8c7f-e28fe2e7dc17 service neutron] Port 2d25cf5e-4220-4a61-99ac-a037fc92718b on network 568053f6-6cfe-408d-be45-92751af5d67f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81644 {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 24 05:18:49.847150 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c341b56-b600-41a9-848b-94ef8137d744 req-0231a821-3441-4a38-8c7f-e28fe2e7dc17 service neutron] Attempting to bind port 2d25cf5e-4220-4a61-99ac-a037fc92718b on network 568053f6-6cfe-408d-be45-92751af5d67f {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 24 05:18:49.852831 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c341b56-b600-41a9-848b-94ef8137d744 req-0231a821-3441-4a38-8c7f-e28fe2e7dc17 service neutron] Checking agent: {'id': '7a2ffd19-371f-4f7b-a239-eea3b5cfd55b', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81644', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'started_at': datetime.datetime(2021, 12, 24, 4, 57, 19), 'heartbeat_timestamp': datetime.datetime(2021, 12, 24, 5, 18, 21), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 24 05:18:49.853172 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c341b56-b600-41a9-848b-94ef8137d744 req-0231a821-3441-4a38-8c7f-e28fe2e7dc17 service neutron] Checking segment: {'id': '752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102476) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 24 05:18:49.853553 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c341b56-b600-41a9-848b-94ef8137d744 req-0231a821-3441-4a38-8c7f-e28fe2e7dc17 service neutron] Bound using segment: {'id': '752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f'} {{(pid=102476) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 24 05:18:49.853982 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.managers [req-5c341b56-b600-41a9-848b-94ef8137d744 req-0231a821-3441-4a38-8c7f-e28fe2e7dc17 service neutron] Bound port: 2d25cf5e-4220-4a61-99ac-a037fc92718b, host: hv-cinder-81644, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f'}}] {{(pid=102476) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 24 05:18:49.854334 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-5c341b56-b600-41a9-848b-94ef8137d744 req-0231a821-3441-4a38-8c7f-e28fe2e7dc17 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:49.919227 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-5c341b56-b600-41a9-848b-94ef8137d744 req-0231a821-3441-4a38-8c7f-e28fe2e7dc17 service neutron] For port 2d25cf5e-4220-4a61-99ac-a037fc92718b, host hv-cinder-81644, cleared binding levels {{(pid=102476) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 24 05:18:49.922213 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-5c341b56-b600-41a9-848b-94ef8137d744 req-0231a821-3441-4a38-8c7f-e28fe2e7dc17 service neutron] For port 2d25cf5e-4220-4a61-99ac-a037fc92718b, host hv-cinder-81644, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=2d25cf5e-4220-4a61-99ac-a037fc92718b,segment=NetworkSegment(752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5),segment_id=752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5)] {{(pid=102476) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 24 05:18:49.927925 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-5c341b56-b600-41a9-848b-94ef8137d744 req-0231a821-3441-4a38-8c7f-e28fe2e7dc17 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-32528424'] for port, after_update {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:49.973301 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c341b56-b600-41a9-848b-94ef8137d744 req-0231a821-3441-4a38-8c7f-e28fe2e7dc17 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:18:49.973968 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-5c341b56-b600-41a9-848b-94ef8137d744 req-0231a821-3441-4a38-8c7f-e28fe2e7dc17 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:49.975695 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5c341b56-b600-41a9-848b-94ef8137d744 req-0231a821-3441-4a38-8c7f-e28fe2e7dc17 service neutron] 10.222.0.46 "PUT /v2.0/ports/2d25cf5e-4220-4a61-99ac-a037fc92718b HTTP/1.1" status: 200 len: 1093 time: 0.9577570 Dec 24 05:18:49.976129 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '48617155-accf-48c5-bb2c-877a4d09e9c2', 'tag': '2d25cf5e-4220-4a61-99ac-a037fc92718b'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:18:49.978451 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aa02f4ad-85e2-4814-9b53-ed031844e522" -d '{"events": [{"name": "network-changed", "server_uuid": "48617155-accf-48c5-bb2c-877a4d09e9c2", "tag": "2d25cf5e-4220-4a61-99ac-a037fc92718b"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:18:50.003155 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0231a821-3441-4a38-8c7f-e28fe2e7dc17 service neutron] Pushing event updated for resources: {'Port': ['ID=2d25cf5e-4220-4a61-99ac-a037fc92718b,revision_number=3']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:50.028728 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:18:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-86513528-2360-4ac9-837f-0de327fa5904 x-openstack-request-id: req-86513528-2360-4ac9-837f-0de327fa5904 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:18:50.029028 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "48617155-accf-48c5-bb2c-877a4d09e9c2", "tag": "2d25cf5e-4220-4a61-99ac-a037fc92718b", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:18:50.029288 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-86513528-2360-4ac9-837f-0de327fa5904 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:18:50.029694 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '48617155-accf-48c5-bb2c-877a4d09e9c2', 'tag': '2d25cf5e-4220-4a61-99ac-a037fc92718b', 'status': 'completed', 'code': 200} Dec 24 05:18:50.098151 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c341b56-b600-41a9-848b-94ef8137d744 req-6188f5e2-8998-4d72-86b2-cddf30ca2b0d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:18:50.099734 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5c341b56-b600-41a9-848b-94ef8137d744 req-6188f5e2-8998-4d72-86b2-cddf30ca2b0d service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=274c3c6f555f48ad93189e73c71c5ffe&device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 1096 time: 0.0486202 Dec 24 05:18:50.149809 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5c341b56-b600-41a9-848b-94ef8137d744 req-5fff6733-189d-4f04-8c31-458425dd80a0 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=2d25cf5e-4220-4a61-99ac-a037fc92718b HTTP/1.1" status: 200 len: 217 time: 0.0350289 Dec 24 05:18:50.205130 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c341b56-b600-41a9-848b-94ef8137d744 req-73a53bd7-4281-4fd2-be27-ef2e57fa6be3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:18:50.206568 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5c341b56-b600-41a9-848b-94ef8137d744 req-73a53bd7-4281-4fd2-be27-ef2e57fa6be3 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=0d93f37f-9870-4f45-a3dd-a7bfdf196cf7 HTTP/1.1" status: 200 len: 848 time: 0.0501087 Dec 24 05:18:50.254702 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c341b56-b600-41a9-848b-94ef8137d744 req-fc0b2afb-5cb8-4f0c-b8a6-1aaebda3b69f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:18:50.256431 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5c341b56-b600-41a9-848b-94ef8137d744 req-fc0b2afb-5cb8-4f0c-b8a6-1aaebda3b69f service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=568053f6-6cfe-408d-be45-92751af5d67f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0426455 Dec 24 05:18:50.345801 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5c341b56-b600-41a9-848b-94ef8137d744 req-10a6fe69-0695-4f52-9afa-5faeccb66be5 service neutron] 10.222.0.46 "GET /v2.0/networks/568053f6-6cfe-408d-be45-92751af5d67f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0818660 Dec 24 05:18:50.437844 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5c341b56-b600-41a9-848b-94ef8137d744 req-a27d154d-7990-4e47-9cb4-170e67680eff service neutron] 10.222.0.46 "GET /v2.0/networks/568053f6-6cfe-408d-be45-92751af5d67f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0839257 Dec 24 05:18:50.572284 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa02f4ad-85e2-4814-9b53-ed031844e522 req-22310775-3082-4849-8941-1bc7ec2845a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:18:50.573856 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aa02f4ad-85e2-4814-9b53-ed031844e522 req-22310775-3082-4849-8941-1bc7ec2845a4 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=274c3c6f555f48ad93189e73c71c5ffe&device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 1096 time: 0.0424082 Dec 24 05:18:50.592611 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:50.672187 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa02f4ad-85e2-4814-9b53-ed031844e522 req-9dccead9-8a37-45dd-9d06-69e747298d9d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:18:50.673821 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aa02f4ad-85e2-4814-9b53-ed031844e522 req-9dccead9-8a37-45dd-9d06-69e747298d9d service neutron] 10.222.0.46 "GET /v2.0/networks?id=568053f6-6cfe-408d-be45-92751af5d67f HTTP/1.1" status: 200 len: 910 time: 0.0930626 Dec 24 05:18:50.724919 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aa02f4ad-85e2-4814-9b53-ed031844e522 req-64162ccb-3830-49ea-801c-1229fa8b27f4 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=2d25cf5e-4220-4a61-99ac-a037fc92718b HTTP/1.1" status: 200 len: 217 time: 0.0432639 Dec 24 05:18:50.794860 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa02f4ad-85e2-4814-9b53-ed031844e522 req-f2bb174b-63eb-4436-bd97-1f0b83c61f55 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:18:50.796300 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aa02f4ad-85e2-4814-9b53-ed031844e522 req-f2bb174b-63eb-4436-bd97-1f0b83c61f55 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=0d93f37f-9870-4f45-a3dd-a7bfdf196cf7 HTTP/1.1" status: 200 len: 848 time: 0.0535381 Dec 24 05:18:50.804710 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-773a7eb4-6301-4fb4-8bf7-5cd839a4d248 req-8f1cddcd-524d-444d-8554-0408dca8ed1d tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:18:50.806040 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-773a7eb4-6301-4fb4-8bf7-5cd839a4d248 req-8f1cddcd-524d-444d-8554-0408dca8ed1d tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 943 time: 0.0903530 Dec 24 05:18:50.874148 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa02f4ad-85e2-4814-9b53-ed031844e522 req-476b1b84-eed5-4506-a940-1e42a27f7d45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:18:50.875527 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aa02f4ad-85e2-4814-9b53-ed031844e522 req-476b1b84-eed5-4506-a940-1e42a27f7d45 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=568053f6-6cfe-408d-be45-92751af5d67f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0686655 Dec 24 05:18:50.879717 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-773a7eb4-6301-4fb4-8bf7-5cd839a4d248 req-b19fb1c8-dfab-4312-8128-1354ab89a9a1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0657928 Dec 24 05:18:50.968403 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aa02f4ad-85e2-4814-9b53-ed031844e522 req-3c93339b-cd7d-4f9a-a212-77c17902680a service neutron] 10.222.0.46 "GET /v2.0/networks/568053f6-6cfe-408d-be45-92751af5d67f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0845716 Dec 24 05:18:51.059397 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-aa02f4ad-85e2-4814-9b53-ed031844e522 req-02879942-1851-4e88-aa5d-96af411a73a0 service neutron] 10.222.0.46 "GET /v2.0/networks/568053f6-6cfe-408d-be45-92751af5d67f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0828347 Dec 24 05:18:52.008024 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59406af3-856c-4fbf-bd8c-4e7e157deb31 req-cdf5a749-aecf-4c99-ba4d-50d0475d999d tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:18:52.009519 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-59406af3-856c-4fbf-bd8c-4e7e157deb31 req-cdf5a749-aecf-4c99-ba4d-50d0475d999d tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 943 time: 0.0524549 Dec 24 05:18:52.058471 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-59406af3-856c-4fbf-bd8c-4e7e157deb31 req-fe147ae2-8db6-41a0-97d8-6cd0c7275df1 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429335 Dec 24 05:18:53.186272 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e934984-e4a8-4700-bfea-ce2bf2ce3c0a req-ee264bec-01e3-4832-abe9-69dea37322f9 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:18:53.187773 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2e934984-e4a8-4700-bfea-ce2bf2ce3c0a req-ee264bec-01e3-4832-abe9-69dea37322f9 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 943 time: 0.0500126 Dec 24 05:18:53.234167 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-59a2a861-885b-4177-9e91-3a1995673d9b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:53.249047 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-2e934984-e4a8-4700-bfea-ce2bf2ce3c0a req-46677cfc-cd83-4d90-8f3c-c468a12ab879 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0542071 Dec 24 05:18:54.375485 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afef3068-73bc-4bfd-a260-f53dcc069b9a req-15864364-056d-49d8-9152-a9a81dac7e93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:18:54.376987 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-afef3068-73bc-4bfd-a260-f53dcc069b9a req-15864364-056d-49d8-9152-a9a81dac7e93 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 943 time: 0.0492511 Dec 24 05:18:54.438110 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-afef3068-73bc-4bfd-a260-f53dcc069b9a req-a58dccd8-056d-45e9-8bb2-e9201452f3d2 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0550673 Dec 24 05:18:55.325953 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-861cb990-a602-41ee-b2c7-3fc02e1bcac7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:55.569996 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c21710f7-aebb-4410-9f72-aaf30eb5591f req-59590107-3d27-4ec2-8669-f54d07ab9b00 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:18:55.571681 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c21710f7-aebb-4410-9f72-aaf30eb5591f req-59590107-3d27-4ec2-8669-f54d07ab9b00 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 943 time: 0.0568655 Dec 24 05:18:55.622150 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c21710f7-aebb-4410-9f72-aaf30eb5591f req-080a5aa6-2a27-494e-a08e-9dc9552332fc tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436993 Dec 24 05:18:56.568304 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:56.750628 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f41cf361-8595-44b1-8765-d67abd8d0c97 req-e921d103-0241-40ab-ae44-85c518e03912 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:18:56.752096 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f41cf361-8595-44b1-8765-d67abd8d0c97 req-e921d103-0241-40ab-ae44-85c518e03912 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 943 time: 0.0566115 Dec 24 05:18:56.810077 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-f41cf361-8595-44b1-8765-d67abd8d0c97 req-ea7440a0-0e90-466a-8b7b-8a364988cdb6 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0498068 Dec 24 05:18:57.939217 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1175fbd8-142a-4fb9-ad3b-78031b580d69 req-6f0e2fd8-fef9-4a3a-8168-87d730ae8c9f tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:18:57.940718 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1175fbd8-142a-4fb9-ad3b-78031b580d69 req-6f0e2fd8-fef9-4a3a-8168-87d730ae8c9f tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 943 time: 0.0534804 Dec 24 05:18:57.995924 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1175fbd8-142a-4fb9-ad3b-78031b580d69 req-f0630847-2c0b-4d57-af40-fc3561a9eb9b tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460396 Dec 24 05:18:58.010940 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:58.584115 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:59.119961 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8f2fa56-e8d4-48dc-9ea7-6fe6a1e42efb req-a6da0668-48a1-4a54-9eab-3f9cba3f5ae9 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:18:59.121467 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c8f2fa56-e8d4-48dc-9ea7-6fe6a1e42efb req-a6da0668-48a1-4a54-9eab-3f9cba3f5ae9 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 943 time: 0.0534711 Dec 24 05:18:59.177184 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-c8f2fa56-e8d4-48dc-9ea7-6fe6a1e42efb req-6461e3c7-5b45-4518-95ec-afedfeb2de1f tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0472579 Dec 24 05:18:59.538541 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 2d25cf5e-4220-4a61-99ac-a037fc92718b details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 05:18:59.642000 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 2d25cf5e-4220-4a61-99ac-a037fc92718b, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=2d25cf5e-4220-4a61-99ac-a037fc92718b,segment=NetworkSegment(752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5),segment_id=752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:18:59.653185 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': '2d25cf5e-4220-4a61-99ac-a037fc92718b', 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f', 'port_id': '2d25cf5e-4220-4a61-99ac-a037fc92718b', 'mac_address': 'fa:16:3e:83:ec:4c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 121, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 05:18:59.690573 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:59.703122 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2d25cf5e-4220-4a61-99ac-a037fc92718b {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:18:59.727313 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 2d25cf5e-4220-4a61-99ac-a037fc92718b, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=2d25cf5e-4220-4a61-99ac-a037fc92718b,segment=NetworkSegment(752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5),segment_id=752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:18:59.734454 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:18:59.783810 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=2d25cf5e-4220-4a61-99ac-a037fc92718b,revision_number=4']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:18:59.792036 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:59.792384 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:59.792761 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:59.793099 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:59.793426 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:59.793754 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:59.794076 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:59.794398 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:59.794724 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:59.795045 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:59.795374 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:59.795684 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:18:59.795998 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:19:00.197288 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['2d25cf5e-4220-4a61-99ac-a037fc92718b'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:19:00.302822 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcda435d-8f6d-47a6-a4e7-2b9642b6bf78 req-49ae07f3-ca32-4307-8c22-4d3fd7060954 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:19:00.304293 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-fcda435d-8f6d-47a6-a4e7-2b9642b6bf78 req-49ae07f3-ca32-4307-8c22-4d3fd7060954 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 944 time: 0.0518570 Dec 24 05:19:00.355714 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-fcda435d-8f6d-47a6-a4e7-2b9642b6bf78 req-f3e52335-9dd5-4f48-b86d-d24c5023f489 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446687 Dec 24 05:19:01.473426 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab948f3a-18d3-4d43-8b80-1866ad2c5518 req-1f0eee0f-f8a3-479a-a05d-83eb51ab8f39 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:19:01.474910 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ab948f3a-18d3-4d43-8b80-1866ad2c5518 req-1f0eee0f-f8a3-479a-a05d-83eb51ab8f39 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 944 time: 0.0518286 Dec 24 05:19:01.530489 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ab948f3a-18d3-4d43-8b80-1866ad2c5518 req-6980815e-72cf-46ce-9181-8872cf7e61a4 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0492542 Dec 24 05:19:01.553428 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 2d25cf5e-4220-4a61-99ac-a037fc92718b up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:19:01.617192 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning for port 2d25cf5e-4220-4a61-99ac-a037fc92718b completed by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 24 05:19:01.621164 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port 2d25cf5e-4220-4a61-99ac-a037fc92718b triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:19:01.621576 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:19:01.709896 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:19:01.733002 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '48617155-accf-48c5-bb2c-877a4d09e9c2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2d25cf5e-4220-4a61-99ac-a037fc92718b'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:19:01.735260 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ffe9e98f-6604-4bc8-8b0c-d7fcf7ec1fca" -d '{"events": [{"server_uuid": "48617155-accf-48c5-bb2c-877a4d09e9c2", "name": "network-vif-plugged", "status": "completed", "tag": "2d25cf5e-4220-4a61-99ac-a037fc92718b"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:19:01.748289 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 2d25cf5e-4220-4a61-99ac-a037fc92718b, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=2d25cf5e-4220-4a61-99ac-a037fc92718b,segment=NetworkSegment(752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5),segment_id=752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:19:01.752957 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:19:01.802927 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=2d25cf5e-4220-4a61-99ac-a037fc92718b,revision_number=5']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:19:01.838768 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:19:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eb0448f8-3eb7-49d9-99b4-cd525b4cbb12 x-openstack-request-id: req-eb0448f8-3eb7-49d9-99b4-cd525b4cbb12 {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:19:01.839065 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "48617155-accf-48c5-bb2c-877a4d09e9c2", "name": "network-vif-plugged", "status": "completed", "tag": "2d25cf5e-4220-4a61-99ac-a037fc92718b", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:19:01.839317 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-eb0448f8-3eb7-49d9-99b4-cd525b4cbb12 {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:19:01.839712 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '48617155-accf-48c5-bb2c-877a4d09e9c2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2d25cf5e-4220-4a61-99ac-a037fc92718b', 'code': 200} Dec 24 05:19:02.098068 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5a1aa93-f30c-426c-9b85-ce4004883604 req-39a15352-a62b-4095-bbbc-f7832cf3467a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:19:02.099533 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b5a1aa93-f30c-426c-9b85-ce4004883604 req-39a15352-a62b-4095-bbbc-f7832cf3467a service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 1098 time: 0.0422599 Dec 24 05:19:02.147860 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-b5a1aa93-f30c-426c-9b85-ce4004883604 req-d97e3ce5-58ec-4b9a-a193-73bab1f60fe8 service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396006 Dec 24 05:19:02.670316 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b7d47a3-5332-407f-a47f-a9538c182ab2 req-e1809750-ccae-4cb3-b758-f0284166755d tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:19:02.671809 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6b7d47a3-5332-407f-a47f-a9538c182ab2 req-e1809750-ccae-4cb3-b758-f0284166755d tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 945 time: 0.0505261 Dec 24 05:19:02.721283 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-6b7d47a3-5332-407f-a47f-a9538c182ab2 req-50f83116-ac1c-4315-8562-e558aeba1659 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434849 Dec 24 05:19:03.852357 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e10e8a2b-c4f6-4909-927f-7641f135abbf req-d455506b-942c-409a-808e-11bac4986fcd tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:19:03.853885 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e10e8a2b-c4f6-4909-927f-7641f135abbf req-d455506b-942c-409a-808e-11bac4986fcd tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 945 time: 0.0538068 Dec 24 05:19:03.903090 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e10e8a2b-c4f6-4909-927f-7641f135abbf req-fc50576d-1597-47fb-bec0-dbe8371b4a90 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431967 Dec 24 05:19:04.023362 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-262232e5-4d67-4f66-a802-d77907a23501 req-4b116d14-ceb1-44d0-8c67-a3f80325d7ca tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:19:04.024788 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-262232e5-4d67-4f66-a802-d77907a23501 req-4b116d14-ceb1-44d0-8c67-a3f80325d7ca tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 945 time: 0.0527651 Dec 24 05:19:04.074238 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-262232e5-4d67-4f66-a802-d77907a23501 req-25c889b9-eaf1-4e9b-95ba-e061d32aabb0 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435071 Dec 24 05:19:04.106658 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 36252) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:19:04.250241 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b0b559b-20ef-4546-a387-cb1a21044f64 tempest-TestShelveInstance-179630902 tempest-TestShelveInstance-179630902-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:19:04.251777 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-7b0b559b-20ef-4546-a387-cb1a21044f64 tempest-TestShelveInstance-179630902 tempest-TestShelveInstance-179630902-project-admin] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 1093 time: 0.1440735 Dec 24 05:19:04.255034 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 36256) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:19:04.259746 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.v2.base [None req-167d1215-9d57-4cf8-8015-9bc2f414f3df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Request body: {'floatingip': {'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'port_id': '2d25cf5e-4220-4a61-99ac-a037fc92718b', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'fixed_ip_address': '172.20.0.5'}} {{(pid=102477) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 24 05:19:04.284676 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-167d1215-9d57-4cf8-8015-9bc2f414f3df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for floatingip, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:19:04.384216 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-167d1215-9d57-4cf8-8015-9bc2f414f3df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:19:04.488560 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.db_base_plugin_common [None req-167d1215-9d57-4cf8-8015-9bc2f414f3df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Allocated IP 172.27.1.32 (9b4e4b31-551f-45a9-b26a-cb44ee20a17d/f277b899-8779-420e-8a8d-bfcd5eb7f012/73c0bcb4-ac05-4c5f-a68c-2ce2e9989263) {{(pid=102477) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 24 05:19:04.593096 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-167d1215-9d57-4cf8-8015-9bc2f414f3df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for port, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:19:04.631646 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-167d1215-9d57-4cf8-8015-9bc2f414f3df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8750577499001', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:19:04.681019 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-167d1215-9d57-4cf8-8015-9bc2f414f3df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Network 9b4e4b31-551f-45a9-b26a-cb44ee20a17d is already hosted by enough agents. {{(pid=102477) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 24 05:19:04.684061 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.base_scheduler [None req-167d1215-9d57-4cf8-8015-9bc2f414f3df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Resources bound (agent type, host, resource id): {{(pid=102477) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 24 05:19:04.687606 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.l3_dvrscheduler_db [None req-167d1215-9d57-4cf8-8015-9bc2f414f3df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Received port after_create {{(pid=102477) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 24 05:19:04.693456 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-167d1215-9d57-4cf8-8015-9bc2f414f3df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Pushing event updated for resources: {'Port': ['ID=73c0bcb4-ac05-4c5f-a68c-2ce2e9989263,revision_number=1']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:19:05.057261 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-167d1215-9d57-4cf8-8015-9bc2f414f3df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:19:05.132890 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-167d1215-9d57-4cf8-8015-9bc2f414f3df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:19:05.292750 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-167d1215-9d57-4cf8-8015-9bc2f414f3df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for port, precommit_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:19:05.300283 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-167d1215-9d57-4cf8-8015-9bc2f414f3df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-29535615'] for port, after_update {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:19:05.370542 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-167d1215-9d57-4cf8-8015-9bc2f414f3df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Pushing event updated for resources: {'Port': ['ID=73c0bcb4-ac05-4c5f-a68c-2ce2e9989263,revision_number=2']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:19:05.382663 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-167d1215-9d57-4cf8-8015-9bc2f414f3df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-545804'] for floatingip, after_create {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:19:05.484778 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.db.l3_db [None req-167d1215-9d57-4cf8-8015-9bc2f414f3df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Floating IP 17c6402f-d109-491a-95d3-8628cb99f826 associated. External IP: 172.27.1.32, port: 2d25cf5e-4220-4a61-99ac-a037fc92718b. Dec 24 05:19:05.708339 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-167d1215-9d57-4cf8-8015-9bc2f414f3df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Router 4540c62c-8273-49c3-be97-477e91b60f59 has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102477) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:19:05.817754 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-167d1215-9d57-4cf8-8015-9bc2f414f3df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102477) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:19:05.827426 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8da826c-7563-4205-ba7e-9c1d8d9ff60a None None] Sync routers for ids ['4540c62c-8273-49c3-be97-477e91b60f59'] in dv-cinder-816443-2-iscsi {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:19:05.838011 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8da826c-7563-4205-ba7e-9c1d8d9ff60a None None] Routers {'4540c62c-8273-49c3-be97-477e91b60f59'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:19:05.838950 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-167d1215-9d57-4cf8-8015-9bc2f414f3df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for floatingip, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:19:05.839109 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-b8da826c-7563-4205-ba7e-9c1d8d9ff60a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:18:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['4540c62c-8273-49c3-be97-477e91b60f59'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:19:05.866299 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-167d1215-9d57-4cf8-8015-9bc2f414f3df tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.6102540 Dec 24 05:19:05.866885 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '48617155-accf-48c5-bb2c-877a4d09e9c2', 'tag': '2d25cf5e-4220-4a61-99ac-a037fc92718b'}] {{(pid=102477) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:19:05.869749 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d3e3d7a262849d185e72ba84ca6adca9bb1fee52649b04b101352e7e29a99ca8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-54ff828f-34d9-4a39-b1eb-2780c5e7676d" -d '{"events": [{"name": "network-changed", "server_uuid": "48617155-accf-48c5-bb2c-877a4d09e9c2", "tag": "2d25cf5e-4220-4a61-99ac-a037fc92718b"}]}' {{(pid=102477) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:19:05.909127 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:19:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fed97848-88a2-43a3-a458-88b79a387304 x-openstack-request-id: req-fed97848-88a2-43a3-a458-88b79a387304 {{(pid=102477) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:19:05.909417 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "48617155-accf-48c5-bb2c-877a4d09e9c2", "tag": "2d25cf5e-4220-4a61-99ac-a037fc92718b", "status": "completed", "code": 200}]} {{(pid=102477) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:19:05.909674 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-fed97848-88a2-43a3-a458-88b79a387304 {{(pid=102477) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:19:05.910072 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '48617155-accf-48c5-bb2c-877a4d09e9c2', 'tag': '2d25cf5e-4220-4a61-99ac-a037fc92718b', 'status': 'completed', 'code': 200} Dec 24 05:19:05.960611 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-b8da826c-7563-4205-ba7e-9c1d8d9ff60a None None] Set router 4540c62c-8273-49c3-be97-477e91b60f59 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:19:05.995416 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54ff828f-34d9-4a39-b1eb-2780c5e7676d req-675224b8-7fba-4657-bf66-8f705860928e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:19:05.996937 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-54ff828f-34d9-4a39-b1eb-2780c5e7676d req-675224b8-7fba-4657-bf66-8f705860928e service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=274c3c6f555f48ad93189e73c71c5ffe&device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 1098 time: 0.0403211 Dec 24 05:19:06.094839 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54ff828f-34d9-4a39-b1eb-2780c5e7676d req-818e0704-d7e6-4265-99b4-773931c1bc7c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:19:06.096295 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-54ff828f-34d9-4a39-b1eb-2780c5e7676d req-818e0704-d7e6-4265-99b4-773931c1bc7c service neutron] 10.222.0.46 "GET /v2.0/networks?id=568053f6-6cfe-408d-be45-92751af5d67f HTTP/1.1" status: 200 len: 910 time: 0.0895820 Dec 24 05:19:06.160790 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-54ff828f-34d9-4a39-b1eb-2780c5e7676d req-a751e822-ec27-49c4-9a81-7ab057adc79f service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=2d25cf5e-4220-4a61-99ac-a037fc92718b HTTP/1.1" status: 200 len: 998 time: 0.0566494 Dec 24 05:19:06.182450 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-b8da826c-7563-4205-ba7e-9c1d8d9ff60a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4540c62c-8273-49c3-be97-477e91b60f59', 'name': 'tempest-TestShelveInstance-1513497678-router', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:16Z', 'revision_number': 4, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'gw_port': {'id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:88:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': '17c6402f-d109-491a-95d3-8628cb99f826', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'floating_ip_address': '172.27.1.32', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'port_id': '2d25cf5e-4220-4a61-99ac-a037fc92718b', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f', 'mac_address': 'fa:16:3e:83:ec:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48617155-accf-48c5-bb2c-877a4d09e9c2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:19:04Z', 'updated_at': '2021-12-24T05:19:04Z', 'revision_number': 0, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4e2d29fc-c33c-4d30-8150-d0a0a014a682', 'name': '', 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'mac_address': 'fa:16:3e:66:ed:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:16Z', 'updated_at': '2021-12-24T05:18:21Z', 'revision_number': 5, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'subnets': [{'id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:19:06.208587 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8da826c-7563-4205-ba7e-9c1d8d9ff60a None None] Checking router: 4540c62c-8273-49c3-be97-477e91b60f59 for host: dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:19:06.210179 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54ff828f-34d9-4a39-b1eb-2780c5e7676d req-f6b2c245-f5e1-446b-a8c3-483973366cc2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:19:06.212294 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-54ff828f-34d9-4a39-b1eb-2780c5e7676d req-f6b2c245-f5e1-446b-a8c3-483973366cc2 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=0d93f37f-9870-4f45-a3dd-a7bfdf196cf7 HTTP/1.1" status: 200 len: 848 time: 0.0449121 Dec 24 05:19:06.219867 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8da826c-7563-4205-ba7e-9c1d8d9ff60a None None] Routers {'4540c62c-8273-49c3-be97-477e91b60f59'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:19:06.220509 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-b8da826c-7563-4205-ba7e-9c1d8d9ff60a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:18:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['4540c62c-8273-49c3-be97-477e91b60f59'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:19:06.266255 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54ff828f-34d9-4a39-b1eb-2780c5e7676d req-6e55d994-30bd-4c69-b048-d51f6e2b8b6b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:19:06.267750 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-54ff828f-34d9-4a39-b1eb-2780c5e7676d req-6e55d994-30bd-4c69-b048-d51f6e2b8b6b service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=568053f6-6cfe-408d-be45-92751af5d67f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0484319 Dec 24 05:19:06.339880 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-b8da826c-7563-4205-ba7e-9c1d8d9ff60a None None] Set router 4540c62c-8273-49c3-be97-477e91b60f59 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:19:06.374550 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-54ff828f-34d9-4a39-b1eb-2780c5e7676d req-4d776745-2069-4910-8bbb-e55628a8fab3 service neutron] 10.222.0.46 "GET /v2.0/networks/568053f6-6cfe-408d-be45-92751af5d67f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0995491 Dec 24 05:19:06.480827 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-54ff828f-34d9-4a39-b1eb-2780c5e7676d req-fd304001-7f3e-42e9-b6f4-327cfb28e7fd service neutron] 10.222.0.46 "GET /v2.0/networks/568053f6-6cfe-408d-be45-92751af5d67f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0988803 Dec 24 05:19:06.589089 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-b8da826c-7563-4205-ba7e-9c1d8d9ff60a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4540c62c-8273-49c3-be97-477e91b60f59', 'name': 'tempest-TestShelveInstance-1513497678-router', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:16Z', 'revision_number': 4, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'gw_port': {'id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:88:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': '17c6402f-d109-491a-95d3-8628cb99f826', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'floating_ip_address': '172.27.1.32', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'port_id': '2d25cf5e-4220-4a61-99ac-a037fc92718b', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f', 'mac_address': 'fa:16:3e:83:ec:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48617155-accf-48c5-bb2c-877a4d09e9c2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:19:04Z', 'updated_at': '2021-12-24T05:19:04Z', 'revision_number': 0, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4e2d29fc-c33c-4d30-8150-d0a0a014a682', 'name': '', 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'mac_address': 'fa:16:3e:66:ed:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:16Z', 'updated_at': '2021-12-24T05:18:21Z', 'revision_number': 5, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'subnets': [{'id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:19:06.778006 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8da826c-7563-4205-ba7e-9c1d8d9ff60a None None] The sync data for ids ['4540c62c-8273-49c3-be97-477e91b60f59'] in dv-cinder-816443-2-iscsi is: [{'id': '4540c62c-8273-49c3-be97-477e91b60f59', 'name': 'tempest-TestShelveInstance-1513497678-router', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:16Z', 'revision_number': 4, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'gw_port': {'id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:88:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_floatingips': [{'id': '17c6402f-d109-491a-95d3-8628cb99f826', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'floating_ip_address': '172.27.1.32', 'floating_network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'router_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'port_id': '2d25cf5e-4220-4a61-99ac-a037fc92718b', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f', 'mac_address': 'fa:16:3e:83:ec:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48617155-accf-48c5-bb2c-877a4d09e9c2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-24T05:19:04Z', 'updated_at': '2021-12-24T05:19:04Z', 'revision_number': 0, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4e2d29fc-c33c-4d30-8150-d0a0a014a682', 'name': '', 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'mac_address': 'fa:16:3e:66:ed:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:16Z', 'updated_at': '2021-12-24T05:18:21Z', 'revision_number': 5, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'subnets': [{'id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:19:06.991395 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47a5fc13-09cf-4b73-8cac-af077716b0a3 None None] New status for floating IP 17c6402f-d109-491a-95d3-8628cb99f826: ACTIVE {{(pid=102479) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 24 05:19:11.487178 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:19:20.608841 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:19:23.239118 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-891c9468-928d-4675-a152-cc627e62e8a3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:19:25.329993 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-a8c0df3a-d0dc-49ee-b53e-71df7c66151e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:19:26.573130 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:19:28.017432 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:19:28.593744 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:19:34.227441 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9b57785b-585f-4b93-ada1-15f536669589 req-988ef417-a1f1-4efa-b056-c753f913563c service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0413041 Dec 24 05:19:34.350536 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b57785b-585f-4b93-ada1-15f536669589 req-0db355ed-920a-4974-a017-2b0b3d949556 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:19:34.352025 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9b57785b-585f-4b93-ada1-15f536669589 req-0db355ed-920a-4974-a017-2b0b3d949556 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=274c3c6f555f48ad93189e73c71c5ffe&device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 1098 time: 0.0542743 Dec 24 05:19:34.459762 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b57785b-585f-4b93-ada1-15f536669589 req-03bea120-879c-4e87-8efa-5c8a893bdfdf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:19:34.461325 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9b57785b-585f-4b93-ada1-15f536669589 req-03bea120-879c-4e87-8efa-5c8a893bdfdf service neutron] 10.222.0.46 "GET /v2.0/networks?id=568053f6-6cfe-408d-be45-92751af5d67f HTTP/1.1" status: 200 len: 910 time: 0.0863018 Dec 24 05:19:34.535024 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9b57785b-585f-4b93-ada1-15f536669589 req-86e4ddcd-2196-4f2f-9b2d-6b547453eaf8 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=2d25cf5e-4220-4a61-99ac-a037fc92718b HTTP/1.1" status: 200 len: 1000 time: 0.0651288 Dec 24 05:19:34.597030 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b57785b-585f-4b93-ada1-15f536669589 req-8dda01b0-b61f-496f-8998-e4a840e5da4c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:19:34.598435 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9b57785b-585f-4b93-ada1-15f536669589 req-8dda01b0-b61f-496f-8998-e4a840e5da4c service neutron] 10.222.0.46 "GET /v2.0/subnets?id=0d93f37f-9870-4f45-a3dd-a7bfdf196cf7 HTTP/1.1" status: 200 len: 848 time: 0.0553818 Dec 24 05:19:34.644940 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b57785b-585f-4b93-ada1-15f536669589 req-dba0a1bd-d7d3-4639-8c43-ad8409bfb415 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:19:34.646401 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9b57785b-585f-4b93-ada1-15f536669589 req-dba0a1bd-d7d3-4639-8c43-ad8409bfb415 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=568053f6-6cfe-408d-be45-92751af5d67f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0404537 Dec 24 05:19:34.658291 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [req-9b57785b-585f-4b93-ada1-15f536669589 req-472b1fae-29b9-4b13-adaa-22ad7e21c2b7 service neutron] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102476) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 24 05:19:34.659197 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9b57785b-585f-4b93-ada1-15f536669589 req-472b1fae-29b9-4b13-adaa-22ad7e21c2b7 service neutron] 10.222.0.46 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0048366 Dec 24 05:19:34.752377 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9b57785b-585f-4b93-ada1-15f536669589 req-6bf7de7b-d51d-44e9-a83b-db895bb4c4a6 service neutron] 10.222.0.46 "GET /v2.0/networks/568053f6-6cfe-408d-be45-92751af5d67f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0857532 Dec 24 05:19:34.846716 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-9b57785b-585f-4b93-ada1-15f536669589 req-52d36db5-e25c-4df6-9463-23d07f3a1e0a service neutron] 10.222.0.46 "GET /v2.0/networks/568053f6-6cfe-408d-be45-92751af5d67f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0853999 Dec 24 05:19:48.476950 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:19:50.625335 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:19:53.238810 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-06fcd7a6-d79e-4511-b2fc-1c8c41e602ab None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:19:55.334785 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-027a1bc3-40ab-4ec3-8120-42741397a4a1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:19:56.582633 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:19:58.020601 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:19:58.585253 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:20:20.654921 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:20:23.236824 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-836f9430-8c91-4888-944d-494dbc418411 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:20:25.332578 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e31371f6-bc49-4d12-988f-44d0a16676c9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:20:25.476881 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:20:26.589672 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:20:28.024432 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:20:28.585405 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:20:34.281621 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-de123d9e-d22e-4dd8-a2b1-2aa5f483c02c req-3abb460d-8def-42b9-8066-9c8ea0402edc service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0986948 Dec 24 05:20:34.391040 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de123d9e-d22e-4dd8-a2b1-2aa5f483c02c req-bf8a396c-6653-4eb5-a8bf-b0662fea484a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:20:34.392546 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-de123d9e-d22e-4dd8-a2b1-2aa5f483c02c req-bf8a396c-6653-4eb5-a8bf-b0662fea484a service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=274c3c6f555f48ad93189e73c71c5ffe&device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 1098 time: 0.0464220 Dec 24 05:20:34.503568 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de123d9e-d22e-4dd8-a2b1-2aa5f483c02c req-b2a5f8e9-c5e3-4ed2-b012-13534e97c71d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:20:34.504966 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-de123d9e-d22e-4dd8-a2b1-2aa5f483c02c req-b2a5f8e9-c5e3-4ed2-b012-13534e97c71d service neutron] 10.222.0.46 "GET /v2.0/networks?id=568053f6-6cfe-408d-be45-92751af5d67f HTTP/1.1" status: 200 len: 910 time: 0.0914404 Dec 24 05:20:34.572822 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-de123d9e-d22e-4dd8-a2b1-2aa5f483c02c req-7356e20f-c444-4eb6-896b-9c3ab3d53595 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=2d25cf5e-4220-4a61-99ac-a037fc92718b HTTP/1.1" status: 200 len: 1000 time: 0.0592434 Dec 24 05:20:34.622322 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de123d9e-d22e-4dd8-a2b1-2aa5f483c02c req-228ca89d-8298-48d5-a776-ec54dbcf4631 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:20:34.623721 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-de123d9e-d22e-4dd8-a2b1-2aa5f483c02c req-228ca89d-8298-48d5-a776-ec54dbcf4631 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=0d93f37f-9870-4f45-a3dd-a7bfdf196cf7 HTTP/1.1" status: 200 len: 848 time: 0.0436425 Dec 24 05:20:34.669397 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de123d9e-d22e-4dd8-a2b1-2aa5f483c02c req-2810c531-6c59-4521-a6bc-8468250c6987 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:20:34.670836 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-de123d9e-d22e-4dd8-a2b1-2aa5f483c02c req-2810c531-6c59-4521-a6bc-8468250c6987 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=568053f6-6cfe-408d-be45-92751af5d67f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0396199 Dec 24 05:20:34.768648 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-de123d9e-d22e-4dd8-a2b1-2aa5f483c02c req-1b8299db-acc8-4f37-a91c-ccf12f240e2d service neutron] 10.222.0.46 "GET /v2.0/networks/568053f6-6cfe-408d-be45-92751af5d67f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0904405 Dec 24 05:20:34.857195 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-de123d9e-d22e-4dd8-a2b1-2aa5f483c02c req-f24c5765-c7ba-45c6-a1a7-fcab1e5658f2 service neutron] 10.222.0.46 "GET /v2.0/networks/568053f6-6cfe-408d-be45-92751af5d67f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0815825 Dec 24 05:20:50.681041 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:20:53.237143 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-60694239-d271-476d-8e06-ec5e657f48a5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:20:55.336769 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-526c3df8-1b0d-48e4-a2c2-731aae19b28f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:20:56.583577 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:20:58.028516 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:20:58.591038 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:21:02.485525 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:21:20.206431 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d23bb5f-2c19-43fd-be96-d92ca97b4a6d req-57c54942-a7a4-4bda-9895-a5d533a52c9b tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:20.208180 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3d23bb5f-2c19-43fd-be96-d92ca97b4a6d req-57c54942-a7a4-4bda-9895-a5d533a52c9b tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 945 time: 0.1088777 Dec 24 05:21:20.258597 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3d23bb5f-2c19-43fd-be96-d92ca97b4a6d req-6f9d814a-d3ca-422e-8515-bec5be3fef79 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440714 Dec 24 05:21:20.714734 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:21:21.438372 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e916b21c-7216-4139-abb3-06975624e539 req-59f00649-f435-4619-b3e6-9cabc6fb0203 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:21.439850 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e916b21c-7216-4139-abb3-06975624e539 req-59f00649-f435-4619-b3e6-9cabc6fb0203 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 945 time: 0.1028605 Dec 24 05:21:21.496010 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-e916b21c-7216-4139-abb3-06975624e539 req-fbe22ba3-3b28-4c7e-a56d-8585b9ecb868 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0501776 Dec 24 05:21:22.637413 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55f2c600-5ca4-4e55-b3e3-a7205e7e0fa3 req-0c5ca242-0fe1-4f27-bccc-d674006e9c9c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:22.638795 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-55f2c600-5ca4-4e55-b3e3-a7205e7e0fa3 req-0c5ca242-0fe1-4f27-bccc-d674006e9c9c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 945 time: 0.0582149 Dec 24 05:21:22.691740 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-55f2c600-5ca4-4e55-b3e3-a7205e7e0fa3 req-85a550bc-3568-4320-8e0e-a02717f115b2 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437162 Dec 24 05:21:23.236446 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-fd11a840-f1cb-49d0-9455-11e3cfc5a3ce None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:21:23.828514 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-700246ca-44c9-4998-935c-15bfe58fe8df req-f8a68301-a2ea-47fc-b203-543c35736d55 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:23.830228 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-700246ca-44c9-4998-935c-15bfe58fe8df req-f8a68301-a2ea-47fc-b203-543c35736d55 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 945 time: 0.0625229 Dec 24 05:21:23.884870 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-700246ca-44c9-4998-935c-15bfe58fe8df req-907d8b8c-9392-4e51-9d7b-6a0e49665fee tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455534 Dec 24 05:21:25.015332 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d366ab3-2073-42ee-8ef7-c9d168e44527 req-aab3915a-8ade-4b76-a857-1cb1d3e1d347 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:25.016818 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4d366ab3-2073-42ee-8ef7-c9d168e44527 req-aab3915a-8ade-4b76-a857-1cb1d3e1d347 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 945 time: 0.0597377 Dec 24 05:21:25.071285 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-4d366ab3-2073-42ee-8ef7-c9d168e44527 req-2b429605-1160-4be8-8cd8-eed949ba5b87 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0475898 Dec 24 05:21:25.335723 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-71213e40-3dbb-44be-a34a-9484d4c8eba3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:21:26.212942 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d99125b-fdd0-4633-87a2-a27310c23db6 req-b1bb08cc-2310-4668-856c-e86e0e810b18 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:26.214418 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1d99125b-fdd0-4633-87a2-a27310c23db6 req-b1bb08cc-2310-4668-856c-e86e0e810b18 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 945 time: 0.0616405 Dec 24 05:21:26.268651 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-1d99125b-fdd0-4633-87a2-a27310c23db6 req-5d20cd4d-3e2a-49fc-b326-5a5a2e1c5bfe tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463734 Dec 24 05:21:26.589554 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:21:27.394227 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db47f963-3a1b-4260-8ced-c785c21ab9d1 req-91ee9eaa-4bcc-4b73-9de5-683a0d8ab222 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:27.395681 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-db47f963-3a1b-4260-8ced-c785c21ab9d1 req-91ee9eaa-4bcc-4b73-9de5-683a0d8ab222 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 945 time: 0.0515149 Dec 24 05:21:27.446249 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-db47f963-3a1b-4260-8ced-c785c21ab9d1 req-4b5b58cd-d4ba-472f-85d6-67d4948027fd tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416768 Dec 24 05:21:28.028388 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:21:28.576137 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:21:28.585051 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4015038-8682-485b-bd4b-5f233d29ce2f req-64fce8b1-5d55-4851-8c54-87d30376f4dd tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:28.586548 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a4015038-8682-485b-bd4b-5f233d29ce2f req-64fce8b1-5d55-4851-8c54-87d30376f4dd tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 945 time: 0.0632098 Dec 24 05:21:28.634664 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-a4015038-8682-485b-bd4b-5f233d29ce2f req-235a83ee-1d93-4dde-8a59-cc799cf91e86 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419958 Dec 24 05:21:29.766797 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2bdf7ce-dd09-441f-be0a-02f2f9d01f93 req-eeef5214-5710-470e-a5fd-24f416f359a2 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:29.768304 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e2bdf7ce-dd09-441f-be0a-02f2f9d01f93 req-eeef5214-5710-470e-a5fd-24f416f359a2 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 945 time: 0.0581560 Dec 24 05:21:29.817566 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-e2bdf7ce-dd09-441f-be0a-02f2f9d01f93 req-0b0b5398-31bd-4e6d-94a8-fb485e63ab37 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431612 Dec 24 05:21:30.370437 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f5611f7-f6bf-4786-8f2a-17acfc5d39a7 req-9d0ce20c-4409-4779-bd7a-d89b23a28725 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:30.371982 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3f5611f7-f6bf-4786-8f2a-17acfc5d39a7 req-9d0ce20c-4409-4779-bd7a-d89b23a28725 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=274c3c6f555f48ad93189e73c71c5ffe&device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 1098 time: 0.0501227 Dec 24 05:21:30.466241 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f5611f7-f6bf-4786-8f2a-17acfc5d39a7 req-c750c617-16ec-4b9f-8b1a-0a0fc16d04a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:30.467684 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3f5611f7-f6bf-4786-8f2a-17acfc5d39a7 req-c750c617-16ec-4b9f-8b1a-0a0fc16d04a0 service neutron] 10.222.0.46 "GET /v2.0/networks?id=568053f6-6cfe-408d-be45-92751af5d67f HTTP/1.1" status: 200 len: 910 time: 0.0881007 Dec 24 05:21:30.545942 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3f5611f7-f6bf-4786-8f2a-17acfc5d39a7 req-feaf008f-5dcd-4736-a5ab-a7b67010ddd6 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=2d25cf5e-4220-4a61-99ac-a037fc92718b HTTP/1.1" status: 200 len: 1000 time: 0.0699658 Dec 24 05:21:30.602758 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f5611f7-f6bf-4786-8f2a-17acfc5d39a7 req-d88cd8e6-b3fe-4bdc-afa2-4dde1c74eb21 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:30.604300 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3f5611f7-f6bf-4786-8f2a-17acfc5d39a7 req-d88cd8e6-b3fe-4bdc-afa2-4dde1c74eb21 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=0d93f37f-9870-4f45-a3dd-a7bfdf196cf7 HTTP/1.1" status: 200 len: 848 time: 0.0501919 Dec 24 05:21:30.655552 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f5611f7-f6bf-4786-8f2a-17acfc5d39a7 req-2d02d96c-6f3f-4ca9-9e25-59721991fd84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:30.657101 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3f5611f7-f6bf-4786-8f2a-17acfc5d39a7 req-2d02d96c-6f3f-4ca9-9e25-59721991fd84 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=568053f6-6cfe-408d-be45-92751af5d67f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0457206 Dec 24 05:21:30.750542 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3f5611f7-f6bf-4786-8f2a-17acfc5d39a7 req-6a889c52-4b91-40c7-a62f-22f8f91ee776 service neutron] 10.222.0.46 "GET /v2.0/networks/568053f6-6cfe-408d-be45-92751af5d67f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0858009 Dec 24 05:21:30.841370 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3f5611f7-f6bf-4786-8f2a-17acfc5d39a7 req-25d98be6-0ea6-4772-a846-33f5d7e49f88 service neutron] 10.222.0.46 "GET /v2.0/networks/568053f6-6cfe-408d-be45-92751af5d67f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0835226 Dec 24 05:21:30.943536 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd4aab26-64c6-4a13-a0ac-94b69ca44cce req-2b7f494d-b398-482e-a5bb-2626dd5bdb26 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:30.945056 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-bd4aab26-64c6-4a13-a0ac-94b69ca44cce req-2b7f494d-b398-482e-a5bb-2626dd5bdb26 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 945 time: 0.0542195 Dec 24 05:21:30.999134 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-bd4aab26-64c6-4a13-a0ac-94b69ca44cce req-6d90b3cd-e130-4899-a13b-2e1bc6217fa2 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454481 Dec 24 05:21:32.137511 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c073f16-4ecd-4a75-88a6-7d8c8b8e0d64 req-a948b157-6424-4baa-ad6f-6fcc5f34463c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:32.139005 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1c073f16-4ecd-4a75-88a6-7d8c8b8e0d64 req-a948b157-6424-4baa-ad6f-6fcc5f34463c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 945 time: 0.0611169 Dec 24 05:21:32.205170 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1c073f16-4ecd-4a75-88a6-7d8c8b8e0d64 req-2b95e825-d35d-426b-9c7f-478e8d70d70e tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0543826 Dec 24 05:21:33.328659 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df4eb139-6213-4382-bfda-a8d01d316258 req-34d0b0dd-83b0-4406-9d54-fccc3dd5541a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:33.330428 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-df4eb139-6213-4382-bfda-a8d01d316258 req-34d0b0dd-83b0-4406-9d54-fccc3dd5541a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 945 time: 0.0490875 Dec 24 05:21:33.386786 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-df4eb139-6213-4382-bfda-a8d01d316258 req-454c45e3-5d1b-4398-a8c4-b2a5dfae13ce tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0499954 Dec 24 05:21:33.517309 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [req-fcc834b3-624a-4046-a257-cfc9a728758e req-b01a3801-814f-477a-8c16-edf8183ea47c service neutron] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102476) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 24 05:21:33.518331 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-fcc834b3-624a-4046-a257-cfc9a728758e req-b01a3801-814f-477a-8c16-edf8183ea47c service neutron] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0588095 Dec 24 05:21:33.705686 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b2acda5-194a-4b72-956e-fd641cc691b5 req-0bb96cf5-08c5-477b-903f-44bd4cafdb58 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:33.707525 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0b2acda5-194a-4b72-956e-fd641cc691b5 req-0bb96cf5-08c5-477b-903f-44bd4cafdb58 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 945 time: 0.0744629 Dec 24 05:21:33.714359 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3b905ef0-5188-4031-81d0-64ec0a495276 req-9ef88d42-6896-4f81-aac7-680cad40b351 service neutron] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0988414 Dec 24 05:21:33.725378 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [req-3b905ef0-5188-4031-81d0-64ec0a495276 req-9eadcb7f-46a3-435c-bd86-4e86dd143783 service neutron] http://10.222.0.43:9696/v2.0/extensions returned with HTTP 200 {{(pid=102477) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 24 05:21:33.726308 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-3b905ef0-5188-4031-81d0-64ec0a495276 req-9eadcb7f-46a3-435c-bd86-4e86dd143783 service neutron] 10.222.0.43 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0054400 Dec 24 05:21:33.764482 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-0b2acda5-194a-4b72-956e-fd641cc691b5 req-5159f42c-692a-401d-b54f-8bedf64cc8d0 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0491493 Dec 24 05:21:34.883273 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12d50f69-0c35-42f8-bc5c-c34ac76aed44 req-b125171d-dd6e-496f-83f9-4c95d2859ac4 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:34.884782 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-12d50f69-0c35-42f8-bc5c-c34ac76aed44 req-b125171d-dd6e-496f-83f9-4c95d2859ac4 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 945 time: 0.0497057 Dec 24 05:21:34.937058 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-12d50f69-0c35-42f8-bc5c-c34ac76aed44 req-dc119da6-b8d3-4f5e-8a1e-668a6c86e1a0 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459473 Dec 24 05:21:35.363406 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b905ef0-5188-4031-81d0-64ec0a495276 req-ca0f09a5-1d27-4539-bb39-336053a2844d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:35.364962 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3b905ef0-5188-4031-81d0-64ec0a495276 req-ca0f09a5-1d27-4539-bb39-336053a2844d service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2&tenant_id=274c3c6f555f48ad93189e73c71c5ffe HTTP/1.1" status: 200 len: 1098 time: 0.0422084 Dec 24 05:21:35.445967 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b905ef0-5188-4031-81d0-64ec0a495276 req-87f0a037-ccd7-4020-a195-a0d9a0ad282f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:35.447423 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3b905ef0-5188-4031-81d0-64ec0a495276 req-87f0a037-ccd7-4020-a195-a0d9a0ad282f service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=274c3c6f555f48ad93189e73c71c5ffe&device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 1098 time: 0.0477905 Dec 24 05:21:35.542354 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b905ef0-5188-4031-81d0-64ec0a495276 req-94ed64e3-b85d-4649-9e8d-0a0fabad5686 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:35.543817 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3b905ef0-5188-4031-81d0-64ec0a495276 req-94ed64e3-b85d-4649-9e8d-0a0fabad5686 service neutron] 10.222.0.46 "GET /v2.0/networks?id=568053f6-6cfe-408d-be45-92751af5d67f HTTP/1.1" status: 200 len: 910 time: 0.0887830 Dec 24 05:21:35.629702 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3b905ef0-5188-4031-81d0-64ec0a495276 req-2acb4d64-002b-4756-9a78-3dfa7a9dc58a service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=2d25cf5e-4220-4a61-99ac-a037fc92718b HTTP/1.1" status: 200 len: 1000 time: 0.0750444 Dec 24 05:21:35.680044 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b905ef0-5188-4031-81d0-64ec0a495276 req-09cb1c88-b735-4e04-afdb-f4ce798960e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:35.681482 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3b905ef0-5188-4031-81d0-64ec0a495276 req-09cb1c88-b735-4e04-afdb-f4ce798960e6 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=0d93f37f-9870-4f45-a3dd-a7bfdf196cf7 HTTP/1.1" status: 200 len: 848 time: 0.0446959 Dec 24 05:21:35.728032 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b905ef0-5188-4031-81d0-64ec0a495276 req-b31e70d2-b245-42ec-8d3f-9fc0075bcb77 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:35.729508 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3b905ef0-5188-4031-81d0-64ec0a495276 req-b31e70d2-b245-42ec-8d3f-9fc0075bcb77 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=568053f6-6cfe-408d-be45-92751af5d67f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0403759 Dec 24 05:21:35.837724 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3b905ef0-5188-4031-81d0-64ec0a495276 req-ece07cb3-9002-46e8-b30f-a3dd1baec6f4 service neutron] 10.222.0.46 "GET /v2.0/networks/568053f6-6cfe-408d-be45-92751af5d67f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0998065 Dec 24 05:21:35.926835 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3b905ef0-5188-4031-81d0-64ec0a495276 req-527cf3c3-7ce7-456c-bea2-d4a333c7f1b5 service neutron] 10.222.0.46 "GET /v2.0/networks/568053f6-6cfe-408d-be45-92751af5d67f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0813491 Dec 24 05:21:36.058374 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8731ed51-c99e-4ede-b0a6-5d340a460f93 req-f14af0d2-7866-46a9-a5aa-0def8b916c2b tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:36.059840 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8731ed51-c99e-4ede-b0a6-5d340a460f93 req-f14af0d2-7866-46a9-a5aa-0def8b916c2b tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 945 time: 0.0534947 Dec 24 05:21:36.113902 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-8731ed51-c99e-4ede-b0a6-5d340a460f93 req-c1d977cf-47e2-479c-949b-2605cd06c5d4 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0480883 Dec 24 05:21:36.458104 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 2d25cf5e-4220-4a61-99ac-a037fc92718b no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:21:36.547318 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:21:36.570732 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '48617155-accf-48c5-bb2c-877a4d09e9c2', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2d25cf5e-4220-4a61-99ac-a037fc92718b'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:21:36.573404 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3f2dfc10-cb05-4c49-b9a5-63d5cdf43911" -d '{"events": [{"server_uuid": "48617155-accf-48c5-bb2c-877a4d09e9c2", "name": "network-vif-unplugged", "status": "completed", "tag": "2d25cf5e-4220-4a61-99ac-a037fc92718b"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:21:36.589357 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 2d25cf5e-4220-4a61-99ac-a037fc92718b, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=2d25cf5e-4220-4a61-99ac-a037fc92718b,segment=NetworkSegment(752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5),segment_id=752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:21:36.596552 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:21:36.619461 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Fri, 24 Dec 2021 05:21:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d2f247c4-8a69-4060-9ca8-7e9ded9b7ac0 x-openstack-request-id: req-d2f247c4-8a69-4060-9ca8-7e9ded9b7ac0 {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:21:36.619747 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "48617155-accf-48c5-bb2c-877a4d09e9c2", "name": "network-vif-unplugged", "status": "completed", "tag": "2d25cf5e-4220-4a61-99ac-a037fc92718b", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:21:36.619996 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-d2f247c4-8a69-4060-9ca8-7e9ded9b7ac0 {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:21:36.620383 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '48617155-accf-48c5-bb2c-877a4d09e9c2', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2d25cf5e-4220-4a61-99ac-a037fc92718b', 'code': 200} Dec 24 05:21:36.644712 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=2d25cf5e-4220-4a61-99ac-a037fc92718b,revision_number=6']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:21:36.651530 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:21:36.651878 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:21:36.652226 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:21:36.652613 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:21:36.652940 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:21:36.653256 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:21:36.653579 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:21:36.653902 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:21:36.654224 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:21:36.654552 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:21:36.654866 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:21:36.655189 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:21:36.655508 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:21:37.237664 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46c9cbf4-f243-43ee-93a5-8a16084d1496 req-59736eab-c5a7-4222-8853-b8fdc2dd1ec3 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:37.239183 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-46c9cbf4-f243-43ee-93a5-8a16084d1496 req-59736eab-c5a7-4222-8853-b8fdc2dd1ec3 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 943 time: 0.0508323 Dec 24 05:21:37.293121 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-46c9cbf4-f243-43ee-93a5-8a16084d1496 req-a9f17c99-ec5a-40ad-abe6-dcbc1e82bf16 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451417 Dec 24 05:21:38.434653 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a74c4d2-c3a8-4193-a81d-94856e6c11d1 req-b30599be-7987-4957-a86d-d64414bd908a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:38.436168 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3a74c4d2-c3a8-4193-a81d-94856e6c11d1 req-b30599be-7987-4957-a86d-d64414bd908a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 943 time: 0.0638421 Dec 24 05:21:38.487554 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-3a74c4d2-c3a8-4193-a81d-94856e6c11d1 req-214ffbec-25de-4816-9b25-7bf6740cb441 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440416 Dec 24 05:21:39.481293 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:21:39.613738 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dfaacd5-af4e-45ec-9e35-3c86c4708526 req-476fb9c2-4d0c-403c-8b82-f203a81e056b tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:39.615137 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-2dfaacd5-af4e-45ec-9e35-3c86c4708526 req-476fb9c2-4d0c-403c-8b82-f203a81e056b tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 943 time: 0.0593770 Dec 24 05:21:39.663679 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-2dfaacd5-af4e-45ec-9e35-3c86c4708526 req-a7e2b4cd-ef55-4c7e-81b3-bb6d806e3d2e tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423958 Dec 24 05:21:40.793580 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3787e9d-0103-4167-9e34-1fce8063d4a8 req-c02c7e48-7de6-4d86-9097-a72509bbde5a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:40.795056 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a3787e9d-0103-4167-9e34-1fce8063d4a8 req-c02c7e48-7de6-4d86-9097-a72509bbde5a tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 943 time: 0.0506711 Dec 24 05:21:40.844813 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a3787e9d-0103-4167-9e34-1fce8063d4a8 req-dbfa84a5-121a-43b2-825d-34d02312432b tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435236 Dec 24 05:21:41.989873 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae472dee-7eb5-43cd-8fca-694510e455da req-72cc9a15-b827-42ad-99ed-f08ee1c55124 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:41.991524 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ae472dee-7eb5-43cd-8fca-694510e455da req-72cc9a15-b827-42ad-99ed-f08ee1c55124 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 943 time: 0.0649848 Dec 24 05:21:42.043024 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-ae472dee-7eb5-43cd-8fca-694510e455da req-8879b36f-4dc2-4f9f-8a33-00e38bd38909 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454049 Dec 24 05:21:42.945064 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d196d9d-e93e-4eee-8b21-3ddecb4ae35d req-ccc04b6d-ede3-4548-a1f1-bb8bd1a92e53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:42.946539 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8d196d9d-e93e-4eee-8b21-3ddecb4ae35d req-ccc04b6d-ede3-4548-a1f1-bb8bd1a92e53 service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 1096 time: 0.0485854 Dec 24 05:21:42.997180 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-8d196d9d-e93e-4eee-8b21-3ddecb4ae35d req-c342aa75-529b-47b9-82b9-b6bd3e231fc7 service neutron] 10.222.0.46 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433357 Dec 24 05:21:43.164084 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88206368-dee1-4256-bd57-67ee14e1cd66 req-ec236a54-62a8-4ba7-a409-ebfec9293b34 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:43.165588 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-88206368-dee1-4256-bd57-67ee14e1cd66 req-ec236a54-62a8-4ba7-a409-ebfec9293b34 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 943 time: 0.0494885 Dec 24 05:21:43.215188 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-88206368-dee1-4256-bd57-67ee14e1cd66 req-01df716d-1b20-49c2-a706-4ca2cfd8149d tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435500 Dec 24 05:21:44.344425 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-385b832b-a526-4f3e-857e-5ec4c52c36db req-04fb9137-f600-4347-9e22-0e331c70ed96 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:44.346373 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-385b832b-a526-4f3e-857e-5ec4c52c36db req-04fb9137-f600-4347-9e22-0e331c70ed96 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 943 time: 0.0521274 Dec 24 05:21:44.398785 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-385b832b-a526-4f3e-857e-5ec4c52c36db req-a1f92510-6435-415d-9246-8fb4af346e05 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462492 Dec 24 05:21:44.496083 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 2d25cf5e-4220-4a61-99ac-a037fc92718b details requested by agent hyperv_hv-cinder-81644 with host hv-cinder-81644 {{(pid=102478) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 24 05:21:44.594293 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 2d25cf5e-4220-4a61-99ac-a037fc92718b, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=2d25cf5e-4220-4a61-99ac-a037fc92718b,segment=NetworkSegment(752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5),segment_id=752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:21:44.605813 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Returning: {'device': '2d25cf5e-4220-4a61-99ac-a037fc92718b', 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f', 'port_id': '2d25cf5e-4220-4a61-99ac-a037fc92718b', 'mac_address': 'fa:16:3e:83:ec:4c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 121, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102478) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 24 05:21:44.648219 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:21:44.675441 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2d25cf5e-4220-4a61-99ac-a037fc92718b {{(pid=102478) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 24 05:21:44.696939 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 2d25cf5e-4220-4a61-99ac-a037fc92718b, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=2d25cf5e-4220-4a61-99ac-a037fc92718b,segment=NetworkSegment(752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5),segment_id=752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:21:44.704126 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:21:44.752467 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=2d25cf5e-4220-4a61-99ac-a037fc92718b,revision_number=7']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:21:45.154065 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] get_ports_and_sgs() called for port_ids ['2d25cf5e-4220-4a61-99ac-a037fc92718b'] {{(pid=102478) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 24 05:21:45.514679 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fbf97cb-08b9-4fd3-8aaa-461f5cb6aa75 req-965231c8-95ae-4399-b2b8-d5cb73d3c523 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:21:45.516160 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5fbf97cb-08b9-4fd3-8aaa-461f5cb6aa75 req-965231c8-95ae-4399-b2b8-d5cb73d3c523 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 944 time: 0.0486345 Dec 24 05:21:45.569740 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-5fbf97cb-08b9-4fd3-8aaa-461f5cb6aa75 req-50669611-0331-4439-aaef-493aa666c7d0 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469596 Dec 24 05:21:46.529902 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 2d25cf5e-4220-4a61-99ac-a037fc92718b up at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 24 05:21:46.579771 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.provisioning_blocks [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Provisioning complete for port 2d25cf5e-4220-4a61-99ac-a037fc92718b triggered by entity L2. {{(pid=102478) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 24 05:21:46.580050 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3594549'] for port, provisioning_complete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:21:46.660514 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-3782640'] for port, before_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:21:46.684178 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '48617155-accf-48c5-bb2c-877a4d09e9c2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2d25cf5e-4220-4a61-99ac-a037fc92718b'}] {{(pid=102478) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:21:46.686443 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}01ab50e53bc9cdaf9c449f8cd9c2f42eb34b32d98e33eeb658344b4dcba81391" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-245497df-75a9-42d5-aa73-6dd634905310" -d '{"events": [{"server_uuid": "48617155-accf-48c5-bb2c-877a4d09e9c2", "name": "network-vif-plugged", "status": "completed", "tag": "2d25cf5e-4220-4a61-99ac-a037fc92718b"}]}' {{(pid=102478) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:21:46.699057 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] For port 2d25cf5e-4220-4a61-99ac-a037fc92718b, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=2d25cf5e-4220-4a61-99ac-a037fc92718b,segment=NetworkSegment(752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5),segment_id=752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5)] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:21:46.706602 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8750578065201', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8750577499019', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8750577499037'] for port, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:21:46.729222 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:21:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c6b9508d-6398-49f4-a1b7-d4c816328383 x-openstack-request-id: req-c6b9508d-6398-49f4-a1b7-d4c816328383 {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:21:46.729512 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "48617155-accf-48c5-bb2c-877a4d09e9c2", "name": "network-vif-plugged", "status": "completed", "tag": "2d25cf5e-4220-4a61-99ac-a037fc92718b", "code": 200}]} {{(pid=102478) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:21:46.729759 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-c6b9508d-6398-49f4-a1b7-d4c816328383 {{(pid=102478) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:21:46.730144 dv-cinder-816443-2-iscsi neutron-server[102478]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '48617155-accf-48c5-bb2c-877a4d09e9c2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2d25cf5e-4220-4a61-99ac-a037fc92718b', 'code': 200} Dec 24 05:21:46.754753 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Pushing event updated for resources: {'Port': ['ID=2d25cf5e-4220-4a61-99ac-a037fc92718b,revision_number=8']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:21:50.732872 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:21:53.243883 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-be7a04cc-aee8-46e2-b2b9-7cf5f7e0b62f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:21:55.339975 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3deb56bd-73fc-4b71-9cc9-33b83a6acdb6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:21:56.599027 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:21:58.024740 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:21:58.591431 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:22:16.481400 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:22:20.726927 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:22:23.240754 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3dba9ea4-4eeb-4269-a838-e3facf39dd2b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:22:25.336723 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-be343994-6570-4d77-a991-9022ffb6aee2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:22:26.596967 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:22:28.032730 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:22:28.595002 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:22:35.207995 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0803fa03-d443-485d-9b2b-09144488d92c req-39cf369c-e174-43dc-9552-016ddc499ad3 service neutron] 10.222.0.46 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0408058 Dec 24 05:22:35.313110 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0803fa03-d443-485d-9b2b-09144488d92c req-8d225957-f5fe-444a-b7ab-ca619e907fca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:22:35.314730 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0803fa03-d443-485d-9b2b-09144488d92c req-8d225957-f5fe-444a-b7ab-ca619e907fca service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=274c3c6f555f48ad93189e73c71c5ffe&device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 1098 time: 0.0422635 Dec 24 05:22:35.423421 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0803fa03-d443-485d-9b2b-09144488d92c req-4a29fe06-fb21-4fbc-81cb-998cba4e20c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:22:35.424956 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0803fa03-d443-485d-9b2b-09144488d92c req-4a29fe06-fb21-4fbc-81cb-998cba4e20c3 service neutron] 10.222.0.46 "GET /v2.0/networks?id=568053f6-6cfe-408d-be45-92751af5d67f HTTP/1.1" status: 200 len: 910 time: 0.0891144 Dec 24 05:22:35.488510 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0803fa03-d443-485d-9b2b-09144488d92c req-4690b6ca-8483-4204-af73-227bbcdd6acd service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=2d25cf5e-4220-4a61-99ac-a037fc92718b HTTP/1.1" status: 200 len: 1000 time: 0.0562332 Dec 24 05:22:35.537950 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0803fa03-d443-485d-9b2b-09144488d92c req-704944f0-7c43-4739-8e44-9af0df8604e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:22:35.539473 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0803fa03-d443-485d-9b2b-09144488d92c req-704944f0-7c43-4739-8e44-9af0df8604e5 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=0d93f37f-9870-4f45-a3dd-a7bfdf196cf7 HTTP/1.1" status: 200 len: 848 time: 0.0432084 Dec 24 05:22:35.865917 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0803fa03-d443-485d-9b2b-09144488d92c req-1073e9c3-2b9b-4a49-97b6-2638ec7aaf28 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:22:35.867422 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0803fa03-d443-485d-9b2b-09144488d92c req-1073e9c3-2b9b-4a49-97b6-2638ec7aaf28 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=568053f6-6cfe-408d-be45-92751af5d67f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.3207879 Dec 24 05:22:35.961131 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0803fa03-d443-485d-9b2b-09144488d92c req-caaa7d8a-429f-466f-ac11-998214d8094b service neutron] 10.222.0.46 "GET /v2.0/networks/568053f6-6cfe-408d-be45-92751af5d67f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0851820 Dec 24 05:22:36.058231 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-0803fa03-d443-485d-9b2b-09144488d92c req-b370267f-438e-4930-ae32-2b4e40c6d311 service neutron] 10.222.0.46 "GET /v2.0/networks/568053f6-6cfe-408d-be45-92751af5d67f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0901778 Dec 24 05:22:50.752595 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:22:53.241625 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-d2bd02f2-b915-4863-8a70-5580489b351a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:22:53.485450 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:22:55.342521 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-72063ae8-9844-4a6c-af41-1fec27329dcc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:22:56.599486 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:22:58.040181 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:22:58.605976 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:12.371383 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 36404) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:23:12.565161 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Deleting port 73c0bcb4-ac05-4c5f-a68c-2ce2e9989263 {{(pid=102477) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:23:12.565523 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:12.645281 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:12.645550 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:12.656980 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling delete_port for 73c0bcb4-ac05-4c5f-a68c-2ce2e9989263 owned by network:floatingip {{(pid=102477) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:23:12.811526 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:12.837429 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Pushing event deleted for resources: {'Port': ['ID=73c0bcb4-ac05-4c5f-a68c-2ce2e9989263,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:23:12.849319 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:12.849675 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:12.850023 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:12.850367 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:12.850701 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:12.851038 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:12.851370 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:12.851698 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:12.852029 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:12.852367 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:12.852714 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:12.853042 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:12.853387 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102477) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:12.908553 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for floatingip, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:12.908779 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.db.l3_db [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Floating IP 17c6402f-d109-491a-95d3-8628cb99f826 disassociated (deleted). External IP: 172.27.1.32, port: 2d25cf5e-4220-4a61-99ac-a037fc92718b. Dec 24 05:23:13.124015 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Router 4540c62c-8273-49c3-be97-477e91b60f59 has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102477) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:23:13.240231 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102477) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:23:13.248167 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for floatingip, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:13.254127 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c71fd6aa-e23b-411b-8351-1a8ed56b8a37 None None] Sync routers for ids ['4540c62c-8273-49c3-be97-477e91b60f59'] in dv-cinder-816443-2-iscsi {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:23:13.264235 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c71fd6aa-e23b-411b-8351-1a8ed56b8a37 None None] Routers {'4540c62c-8273-49c3-be97-477e91b60f59'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:23:13.264892 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-c71fd6aa-e23b-411b-8351-1a8ed56b8a37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:22:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['4540c62c-8273-49c3-be97-477e91b60f59'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:23:13.276515 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-f45b7d3f-4580-46df-83ba-36e1c23a242c tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "DELETE /v2.0/floatingips/17c6402f-d109-491a-95d3-8628cb99f826 HTTP/1.1" status: 204 len: 168 time: 0.9040380 Dec 24 05:23:13.277223 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '48617155-accf-48c5-bb2c-877a4d09e9c2', 'tag': '2d25cf5e-4220-4a61-99ac-a037fc92718b'}] {{(pid=102477) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:23:13.279560 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d3e3d7a262849d185e72ba84ca6adca9bb1fee52649b04b101352e7e29a99ca8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1a97c7f3-e639-47e4-82e6-9d31708fc2ac" -d '{"events": [{"name": "network-changed", "server_uuid": "48617155-accf-48c5-bb2c-877a4d09e9c2", "tag": "2d25cf5e-4220-4a61-99ac-a037fc92718b"}]}' {{(pid=102477) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:23:13.377712 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-c71fd6aa-e23b-411b-8351-1a8ed56b8a37 None None] Set router 4540c62c-8273-49c3-be97-477e91b60f59 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:23:13.484005 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 24 Dec 2021 05:23:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7a31789e-8be2-458f-9b4b-0f3788c66439 x-openstack-request-id: req-7a31789e-8be2-458f-9b4b-0f3788c66439 {{(pid=102477) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:23:13.484554 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "48617155-accf-48c5-bb2c-877a4d09e9c2", "tag": "2d25cf5e-4220-4a61-99ac-a037fc92718b", "status": "completed", "code": 200}]} {{(pid=102477) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:23:13.484726 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-7a31789e-8be2-458f-9b4b-0f3788c66439 {{(pid=102477) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:23:13.485220 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '48617155-accf-48c5-bb2c-877a4d09e9c2', 'tag': '2d25cf5e-4220-4a61-99ac-a037fc92718b', 'status': 'completed', 'code': 200} Dec 24 05:23:13.583189 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1b1827b-ae53-43d8-b07c-fac2c30e6861 req-4c5952b5-7873-4dd2-b89c-d29b14b2e451 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:23:13.584727 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c1b1827b-ae53-43d8-b07c-fac2c30e6861 req-4c5952b5-7873-4dd2-b89c-d29b14b2e451 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 945 time: 0.0756328 Dec 24 05:23:13.599466 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a97c7f3-e639-47e4-82e6-9d31708fc2ac req-d8e607b3-ed82-4fbf-a557-1c3b11869456 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:23:13.600932 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1a97c7f3-e639-47e4-82e6-9d31708fc2ac req-d8e607b3-ed82-4fbf-a557-1c3b11869456 service neutron] 10.222.0.46 "GET /v2.0/ports?tenant_id=274c3c6f555f48ad93189e73c71c5ffe&device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 1098 time: 0.0634964 Dec 24 05:23:13.603748 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-c71fd6aa-e23b-411b-8351-1a8ed56b8a37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4540c62c-8273-49c3-be97-477e91b60f59', 'name': 'tempest-TestShelveInstance-1513497678-router', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:16Z', 'revision_number': 4, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'gw_port': {'id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:88:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '4e2d29fc-c33c-4d30-8150-d0a0a014a682', 'name': '', 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'mac_address': 'fa:16:3e:66:ed:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:16Z', 'updated_at': '2021-12-24T05:18:21Z', 'revision_number': 5, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'subnets': [{'id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:23:13.630033 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c71fd6aa-e23b-411b-8351-1a8ed56b8a37 None None] Checking router: 4540c62c-8273-49c3-be97-477e91b60f59 for host: dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:23:13.638791 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c71fd6aa-e23b-411b-8351-1a8ed56b8a37 None None] Routers {'4540c62c-8273-49c3-be97-477e91b60f59'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:23:13.639430 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-c71fd6aa-e23b-411b-8351-1a8ed56b8a37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:22:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['4540c62c-8273-49c3-be97-477e91b60f59'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:23:13.695224 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-c1b1827b-ae53-43d8-b07c-fac2c30e6861 req-14586490-4ca6-4242-adb7-24b4645b7ca4 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1033599 Dec 24 05:23:13.722922 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a97c7f3-e639-47e4-82e6-9d31708fc2ac req-0b28724d-3872-4e53-bc17-a1aa58ec283f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:23:13.724509 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1a97c7f3-e639-47e4-82e6-9d31708fc2ac req-0b28724d-3872-4e53-bc17-a1aa58ec283f service neutron] 10.222.0.46 "GET /v2.0/networks?id=568053f6-6cfe-408d-be45-92751af5d67f HTTP/1.1" status: 200 len: 910 time: 0.1141160 Dec 24 05:23:13.745256 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-c71fd6aa-e23b-411b-8351-1a8ed56b8a37 None None] Set router 4540c62c-8273-49c3-be97-477e91b60f59 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:23:13.767190 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1a97c7f3-e639-47e4-82e6-9d31708fc2ac req-be89184e-d640-4d29-9ef0-83fae08e33c4 service neutron] 10.222.0.46 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=2d25cf5e-4220-4a61-99ac-a037fc92718b HTTP/1.1" status: 200 len: 217 time: 0.0333371 Dec 24 05:23:13.823005 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a97c7f3-e639-47e4-82e6-9d31708fc2ac req-8daf04b0-8d44-4e2d-ad69-f038c71b75a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:23:13.825344 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1a97c7f3-e639-47e4-82e6-9d31708fc2ac req-8daf04b0-8d44-4e2d-ad69-f038c71b75a1 service neutron] 10.222.0.46 "GET /v2.0/subnets?id=0d93f37f-9870-4f45-a3dd-a7bfdf196cf7 HTTP/1.1" status: 200 len: 848 time: 0.0498202 Dec 24 05:23:13.876587 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a97c7f3-e639-47e4-82e6-9d31708fc2ac req-d31302a9-24d1-441c-962d-4e694f166de3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:23:13.877982 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1a97c7f3-e639-47e4-82e6-9d31708fc2ac req-d31302a9-24d1-441c-962d-4e694f166de3 service neutron] 10.222.0.46 "GET /v2.0/ports?network_id=568053f6-6cfe-408d-be45-92751af5d67f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0449243 Dec 24 05:23:13.946028 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-c71fd6aa-e23b-411b-8351-1a8ed56b8a37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4540c62c-8273-49c3-be97-477e91b60f59', 'name': 'tempest-TestShelveInstance-1513497678-router', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:16Z', 'revision_number': 4, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'gw_port': {'id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:88:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '4e2d29fc-c33c-4d30-8150-d0a0a014a682', 'name': '', 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'mac_address': 'fa:16:3e:66:ed:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:16Z', 'updated_at': '2021-12-24T05:18:21Z', 'revision_number': 5, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'subnets': [{'id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:23:13.972095 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1a97c7f3-e639-47e4-82e6-9d31708fc2ac req-80ecd697-d26a-462e-83ea-6ea3ea10ab79 service neutron] 10.222.0.46 "GET /v2.0/networks/568053f6-6cfe-408d-be45-92751af5d67f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0856898 Dec 24 05:23:13.975508 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c71fd6aa-e23b-411b-8351-1a8ed56b8a37 None None] The sync data for ids ['4540c62c-8273-49c3-be97-477e91b60f59'] in dv-cinder-816443-2-iscsi is: [{'id': '4540c62c-8273-49c3-be97-477e91b60f59', 'name': 'tempest-TestShelveInstance-1513497678-router', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:16Z', 'revision_number': 4, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'gw_port': {'id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:88:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi', '_interfaces': [{'id': '4e2d29fc-c33c-4d30-8150-d0a0a014a682', 'name': '', 'network_id': '568053f6-6cfe-408d-be45-92751af5d67f', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'mac_address': 'fa:16:3e:66:ed:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:16Z', 'updated_at': '2021-12-24T05:18:21Z', 'revision_number': 5, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'subnets': [{'id': '0d93f37f-9870-4f45-a3dd-a7bfdf196cf7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:23:14.067448 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-1a97c7f3-e639-47e4-82e6-9d31708fc2ac req-81210818-b502-4e0d-b36c-807e8f625b29 service neutron] 10.222.0.46 "GET /v2.0/networks/568053f6-6cfe-408d-be45-92751af5d67f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0861976 Dec 24 05:23:14.194702 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-88566806-6daf-4d58-9b2f-e0565b36466a None None] New status for floating IP 17c6402f-d109-491a-95d3-8628cb99f826: DOWN {{(pid=102479) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 24 05:23:14.830138 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39a09789-52ab-4b00-998b-98ffc3ff14e7 req-9264905e-13a5-4bb1-95b3-ecd796115cd6 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102477) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:23:14.831642 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-39a09789-52ab-4b00-998b-98ffc3ff14e7 req-9264905e-13a5-4bb1-95b3-ecd796115cd6 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 945 time: 0.0539982 Dec 24 05:23:14.881248 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-39a09789-52ab-4b00-998b-98ffc3ff14e7 req-b15426a1-f2f7-46ba-bc27-babba2c2eb55 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/security-groups?id=c7dba9cf-1323-4832-9e0e-1333add8e816&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431333 Dec 24 05:23:15.363517 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2311e16-7d26-4347-b0eb-76718d394c62 req-e7130b05-68f9-4fd7-9742-9668836769d4 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102476) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 24 05:23:15.364978 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a2311e16-7d26-4347-b0eb-76718d394c62 req-e7130b05-68f9-4fd7-9742-9668836769d4 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.46 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 945 time: 0.0555587 Dec 24 05:23:15.461649 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-a2311e16-7d26-4347-b0eb-76718d394c62 req-8acf1beb-a745-472c-b068-29498ecb2587 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Deleting port 2d25cf5e-4220-4a61-99ac-a037fc92718b {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:23:15.462016 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-a2311e16-7d26-4347-b0eb-76718d394c62 req-8acf1beb-a745-472c-b068-29498ecb2587 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:15.565354 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [req-a2311e16-7d26-4347-b0eb-76718d394c62 req-8acf1beb-a745-472c-b068-29498ecb2587 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] For port 2d25cf5e-4220-4a61-99ac-a037fc92718b, host hv-cinder-81644, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81644',level=0,port_id=2d25cf5e-4220-4a61-99ac-a037fc92718b,segment=NetworkSegment(752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5),segment_id=752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:23:15.565724 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-a2311e16-7d26-4347-b0eb-76718d394c62 req-8acf1beb-a745-472c-b068-29498ecb2587 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:15.582906 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [req-a2311e16-7d26-4347-b0eb-76718d394c62 req-8acf1beb-a745-472c-b068-29498ecb2587 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Calling delete_port for 2d25cf5e-4220-4a61-99ac-a037fc92718b owned by compute:nova {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:23:15.721466 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-a2311e16-7d26-4347-b0eb-76718d394c62 req-8acf1beb-a745-472c-b068-29498ecb2587 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:15.752595 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8acf1beb-a745-472c-b068-29498ecb2587 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Pushing event deleted for resources: {'Port': ['ID=2d25cf5e-4220-4a61-99ac-a037fc92718b,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:23:15.781808 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8acf1beb-a745-472c-b068-29498ecb2587 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:15.782164 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8acf1beb-a745-472c-b068-29498ecb2587 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:15.782504 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8acf1beb-a745-472c-b068-29498ecb2587 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:15.782832 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8acf1beb-a745-472c-b068-29498ecb2587 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:15.783155 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8acf1beb-a745-472c-b068-29498ecb2587 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:15.783478 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8acf1beb-a745-472c-b068-29498ecb2587 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:15.783796 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8acf1beb-a745-472c-b068-29498ecb2587 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:15.784115 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8acf1beb-a745-472c-b068-29498ecb2587 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:15.784415 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8acf1beb-a745-472c-b068-29498ecb2587 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:15.784757 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8acf1beb-a745-472c-b068-29498ecb2587 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:15.785074 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8acf1beb-a745-472c-b068-29498ecb2587 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:15.785388 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8acf1beb-a745-472c-b068-29498ecb2587 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:15.785708 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8acf1beb-a745-472c-b068-29498ecb2587 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102476) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:15.806506 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [req-a2311e16-7d26-4347-b0eb-76718d394c62 req-8acf1beb-a745-472c-b068-29498ecb2587 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] No DVR routers for this DVR port 2d25cf5e-4220-4a61-99ac-a037fc92718b on host hv-cinder-81644 {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:23:15.809075 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [req-a2311e16-7d26-4347-b0eb-76718d394c62 req-8acf1beb-a745-472c-b068-29498ecb2587 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-913326'] for port, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:15.812445 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [req-a2311e16-7d26-4347-b0eb-76718d394c62 req-8acf1beb-a745-472c-b068-29498ecb2587 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.46 "DELETE /v2.0/ports/2d25cf5e-4220-4a61-99ac-a037fc92718b HTTP/1.1" status: 204 len: 173 time: 0.4413922 Dec 24 05:23:15.812883 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '48617155-accf-48c5-bb2c-877a4d09e9c2', 'name': 'network-vif-deleted', 'tag': '2d25cf5e-4220-4a61-99ac-a037fc92718b'}] {{(pid=102476) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 24 05:23:15.815140 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.43/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8de6662864ff6ff568d50c94676cb7e811ddb58c5ff9c122b0b9e9126a5b25f4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-153249fc-09ce-44be-aff6-6871ed57baf8" -d '{"events": [{"server_uuid": "48617155-accf-48c5-bb2c-877a4d09e9c2", "name": "network-vif-deleted", "tag": "2d25cf5e-4220-4a61-99ac-a037fc92718b"}]}' {{(pid=102476) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 24 05:23:15.915269 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 24 Dec 2021 05:23:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a0918809-288d-4b9e-8aba-4da4d8f88dd2 x-openstack-request-id: req-a0918809-288d-4b9e-8aba-4da4d8f88dd2 {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 24 05:23:15.915562 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "48617155-accf-48c5-bb2c-877a4d09e9c2", "name": "network-vif-deleted", "tag": "2d25cf5e-4220-4a61-99ac-a037fc92718b", "status": "completed", "code": 200}]} {{(pid=102476) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 24 05:23:15.915809 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.43/compute/v2.1/os-server-external-events used request id req-a0918809-288d-4b9e-8aba-4da4d8f88dd2 {{(pid=102476) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 24 05:23:15.916203 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '48617155-accf-48c5-bb2c-877a4d09e9c2', 'name': 'network-vif-deleted', 'tag': '2d25cf5e-4220-4a61-99ac-a037fc92718b', 'status': 'completed', 'code': 200} Dec 24 05:23:15.976975 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [req-40d08bd9-f785-48fb-856d-9a97e7cb14fe req-1a6b2bd6-6d66-48a3-9e8d-d3f18cd7ccbb tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "GET /v2.0/ports?device_id=48617155-accf-48c5-bb2c-877a4d09e9c2 HTTP/1.1" status: 200 len: 210 time: 0.0264115 Dec 24 05:23:17.047137 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 36434) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:23:17.103709 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b0203b8c-c21c-4a8a-8fd0-4abc20dd2ef5 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:17.129576 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b0203b8c-c21c-4a8a-8fd0-4abc20dd2ef5 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:17.197280 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b0203b8c-c21c-4a8a-8fd0-4abc20dd2ef5 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:17.199907 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-b0203b8c-c21c-4a8a-8fd0-4abc20dd2ef5 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:17.201115 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-b0203b8c-c21c-4a8a-8fd0-4abc20dd2ef5 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] 10.222.0.43 "DELETE /v2.0/security-groups/c7dba9cf-1323-4832-9e0e-1333add8e816 HTTP/1.1" status: 204 len: 168 time: 0.1529987 Dec 24 05:23:17.211436 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0203b8c-c21c-4a8a-8fd0-4abc20dd2ef5 tempest-TestShelveInstance-1517437880 tempest-TestShelveInstance-1517437880-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c7dba9cf-1323-4832-9e0e-1333add8e816,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:23:17.247103 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 36438) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:23:18.004664 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ca368f52-9f58-4a8b-b01d-797c474d87dc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-548364'] for router_interface, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:18.260391 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-ca368f52-9f58-4a8b-b01d-797c474d87dc admin admin] Deleting port 4e2d29fc-c33c-4d30-8150-d0a0a014a682 {{(pid=102477) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:23:18.261130 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ca368f52-9f58-4a8b-b01d-797c474d87dc admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:18.347710 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.db [None req-ca368f52-9f58-4a8b-b01d-797c474d87dc admin admin] For port 4e2d29fc-c33c-4d30-8150-d0a0a014a682, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=4e2d29fc-c33c-4d30-8150-d0a0a014a682,segment=NetworkSegment(752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5),segment_id=752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5)] {{(pid=102477) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:23:18.348106 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ca368f52-9f58-4a8b-b01d-797c474d87dc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:18.364292 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-ca368f52-9f58-4a8b-b01d-797c474d87dc admin admin] Calling delete_port for 4e2d29fc-c33c-4d30-8150-d0a0a014a682 owned by network:router_interface {{(pid=102477) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:23:18.546741 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ca368f52-9f58-4a8b-b01d-797c474d87dc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:18.569629 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca368f52-9f58-4a8b-b01d-797c474d87dc admin admin] Pushing event deleted for resources: {'Port': ['ID=4e2d29fc-c33c-4d30-8150-d0a0a014a682,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:23:18.732026 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-ca368f52-9f58-4a8b-b01d-797c474d87dc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-627465', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-548448'] for router_interface, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:18.908005 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 2d25cf5e-4220-4a61-99ac-a037fc92718b no longer exists at agent hyperv_hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:23:18.928190 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] No Port match for: 2d25cf5e-4220-4a61-99ac-a037fc92718b {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:23:18.928569 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Device 2d25cf5e-4220-4a61-99ac-a037fc92718b not bound to the agent host hv-cinder-81644 {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:23:18.942979 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ca368f52-9f58-4a8b-b01d-797c474d87dc admin admin] Router 4540c62c-8273-49c3-be97-477e91b60f59 has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102477) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:23:19.054718 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ca368f52-9f58-4a8b-b01d-797c474d87dc admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102477) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:23:19.061744 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-ca368f52-9f58-4a8b-b01d-797c474d87dc admin admin] 10.222.0.43 "PUT /v2.0/routers/4540c62c-8273-49c3-be97-477e91b60f59/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8135109 Dec 24 05:23:19.064440 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 36442) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:23:19.067036 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-607478c3-382d-4cb6-9083-ec52d77e9428 None None] Sync routers for ids ['4540c62c-8273-49c3-be97-477e91b60f59'] in dv-cinder-816443-2-iscsi {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:23:19.077814 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-607478c3-382d-4cb6-9083-ec52d77e9428 None None] Routers {'4540c62c-8273-49c3-be97-477e91b60f59'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:23:19.078378 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-607478c3-382d-4cb6-9083-ec52d77e9428 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:22:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['4540c62c-8273-49c3-be97-477e91b60f59'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:23:19.165598 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-8964b1e9-5fa2-44b6-8a20-35c6347ca916 admin admin] Publish callbacks [] for router, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:19.181123 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-607478c3-382d-4cb6-9083-ec52d77e9428 None None] Set router 4540c62c-8273-49c3-be97-477e91b60f59 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:23:19.268338 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-8964b1e9-5fa2-44b6-8a20-35c6347ca916 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:19.324016 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-8964b1e9-5fa2-44b6-8a20-35c6347ca916 admin admin] Deleting port dfc571f6-d53d-4920-be50-bf7e0c29ff2e {{(pid=102477) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:23:19.324358 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-8964b1e9-5fa2-44b6-8a20-35c6347ca916 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:19.407855 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.db [None req-8964b1e9-5fa2-44b6-8a20-35c6347ca916 admin admin] For port dfc571f6-d53d-4920-be50-bf7e0c29ff2e, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=dfc571f6-d53d-4920-be50-bf7e0c29ff2e,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102477) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:23:19.408243 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-8964b1e9-5fa2-44b6-8a20-35c6347ca916 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:19.421643 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-8964b1e9-5fa2-44b6-8a20-35c6347ca916 admin admin] Calling delete_port for dfc571f6-d53d-4920-be50-bf7e0c29ff2e owned by network:router_gateway {{(pid=102477) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:23:19.499348 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-607478c3-382d-4cb6-9083-ec52d77e9428 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4540c62c-8273-49c3-be97-477e91b60f59', 'name': 'tempest-TestShelveInstance-1513497678-router', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29'}], 'enable_snat': True}, 'gw_port_id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:23:18Z', 'revision_number': 5, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'gw_port': {'id': 'dfc571f6-d53d-4920-be50-bf7e0c29ff2e', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:88:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4540c62c-8273-49c3-be97-477e91b60f59', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:18:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:23:19.525059 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-607478c3-382d-4cb6-9083-ec52d77e9428 None None] Checking router: 4540c62c-8273-49c3-be97-477e91b60f59 for host: dv-cinder-816443-2-iscsi {{(pid=102478) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:23:19.534359 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-607478c3-382d-4cb6-9083-ec52d77e9428 None None] Routers {'4540c62c-8273-49c3-be97-477e91b60f59'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102478) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:23:19.534988 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-607478c3-382d-4cb6-9083-ec52d77e9428 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:22:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['4540c62c-8273-49c3-be97-477e91b60f59'], 'active': True} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:23:19.589963 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-8964b1e9-5fa2-44b6-8a20-35c6347ca916 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:19.619569 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvr_db [None req-607478c3-382d-4cb6-9083-ec52d77e9428 None None] Set router 4540c62c-8273-49c3-be97-477e91b60f59 gateway port host: None {{(pid=102478) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:23:19.619835 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8964b1e9-5fa2-44b6-8a20-35c6347ca916 admin admin] Pushing event deleted for resources: {'Port': ['ID=dfc571f6-d53d-4920-be50-bf7e0c29ff2e,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:23:19.671786 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_hamode_db [None req-607478c3-382d-4cb6-9083-ec52d77e9428 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4540c62c-8273-49c3-be97-477e91b60f59', 'name': 'tempest-TestShelveInstance-1513497678-router', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:23:19Z', 'revision_number': 6, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'gw_port_host': None}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102478) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:23:19.679521 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-8964b1e9-5fa2-44b6-8a20-35c6347ca916 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-545986'] for router_gateway, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:19.697919 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-607478c3-382d-4cb6-9083-ec52d77e9428 None None] The sync data for ids ['4540c62c-8273-49c3-be97-477e91b60f59'] in dv-cinder-816443-2-iscsi is: [{'id': '4540c62c-8273-49c3-be97-477e91b60f59', 'name': 'tempest-TestShelveInstance-1513497678-router', 'tenant_id': '274c3c6f555f48ad93189e73c71c5ffe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:18:14Z', 'updated_at': '2021-12-24T05:23:19Z', 'revision_number': 6, 'project_id': '274c3c6f555f48ad93189e73c71c5ffe', 'gw_port_host': None}] {{(pid=102478) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:23:19.771451 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-8964b1e9-5fa2-44b6-8a20-35c6347ca916 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-546088', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2070312'] for router, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:19.773669 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-8964b1e9-5fa2-44b6-8a20-35c6347ca916 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:19.821499 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-8964b1e9-5fa2-44b6-8a20-35c6347ca916 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-546081'] for router, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:19.822038 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8964b1e9-5fa2-44b6-8a20-35c6347ca916 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4540c62c-8273-49c3-be97-477e91b60f59 {{(pid=102477) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 24 05:23:19.826353 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-8964b1e9-5fa2-44b6-8a20-35c6347ca916 admin admin] Publish callbacks [] for router, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:19.827509 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-8964b1e9-5fa2-44b6-8a20-35c6347ca916 admin admin] 10.222.0.43 "DELETE /v2.0/routers/4540c62c-8273-49c3-be97-477e91b60f59 HTTP/1.1" status: 204 len: 168 time: 0.7621334 Dec 24 05:23:19.830244 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 36444) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:23:19.873680 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.db_base_plugin_v2 [None req-f992e72c-20c7-449c-a652-40a9f87ef060 admin admin] Deleting subnet 0d93f37f-9870-4f45-a3dd-a7bfdf196cf7 {{(pid=102477) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Dec 24 05:23:19.877182 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f992e72c-20c7-449c-a652-40a9f87ef060 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:19.911374 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f992e72c-20c7-449c-a652-40a9f87ef060 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-29535554'] for subnet, precommit_delete_associations {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:19.989341 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f992e72c-20c7-449c-a652-40a9f87ef060 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3590439'] for subnet, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:20.053319 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f992e72c-20c7-449c-a652-40a9f87ef060 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3590440', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-29535541', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-29853072'] for subnet, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:20.082892 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f992e72c-20c7-449c-a652-40a9f87ef060 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0d93f37f-9870-4f45-a3dd-a7bfdf196cf7,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:23:20.084865 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-f992e72c-20c7-449c-a652-40a9f87ef060 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for subnet, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:20.088085 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-f992e72c-20c7-449c-a652-40a9f87ef060 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/0d93f37f-9870-4f45-a3dd-a7bfdf196cf7 HTTP/1.1" status: 204 len: 168 time: 0.2569048 Dec 24 05:23:20.089183 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c5861b2-6d8e-450b-be46-d8ab46da4e02 None None] Network 568053f6-6cfe-408d-be45-92751af5d67f requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:23:20.090902 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 36446) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:23:20.167480 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-80995e6c-79b7-4278-bbed-786f14f35ec7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3741433'] for network, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:20.223300 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-80995e6c-79b7-4278-bbed-786f14f35ec7 admin admin] Deleting port 46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489 {{(pid=102477) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:23:20.223643 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-80995e6c-79b7-4278-bbed-786f14f35ec7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:20.283518 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.db [None req-80995e6c-79b7-4278-bbed-786f14f35ec7 admin admin] For port 46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489,segment=NetworkSegment(752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5),segment_id=752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5)] {{(pid=102477) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:23:20.284181 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-80995e6c-79b7-4278-bbed-786f14f35ec7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:20.296501 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.plugin [None req-80995e6c-79b7-4278-bbed-786f14f35ec7 admin admin] Calling delete_port for 46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489 owned by network:dhcp {{(pid=102477) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:23:20.379130 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-80995e6c-79b7-4278-bbed-786f14f35ec7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-29535558'] for port, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:20.404571 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80995e6c-79b7-4278-bbed-786f14f35ec7 admin admin] Pushing event deleted for resources: {'Port': ['ID=46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:23:20.408010 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80995e6c-79b7-4278-bbed-786f14f35ec7 admin admin] No DVR routers for this DVR port 46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489 on host dv-cinder-816443-2-iscsi {{(pid=102477) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:23:20.487141 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-80995e6c-79b7-4278-bbed-786f14f35ec7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3595960', 'neutron.services.segments.db._delete_segments_for_network-8750577966942'] for network, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:20.488010 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-16af9eff-f4f6-47bd-a38c-b0bee7b5fb9a None None] DHCP port deletion for 568053f6-6cfe-408d-be45-92751af5d67f request from dv-cinder-816443-2-iscsi {{(pid=102478) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 24 05:23:20.514007 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.services.segments.db [None req-80995e6c-79b7-4278-bbed-786f14f35ec7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['568053f6-6cfe-408d-be45-92751af5d67f']}} {{(pid=102477) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:23:20.525240 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.services.segments.db [None req-80995e6c-79b7-4278-bbed-786f14f35ec7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5') {'for_net_delete': True} {{(pid=102477) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:23:20.525651 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.services.segments.db [None req-80995e6c-79b7-4278-bbed-786f14f35ec7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '752efd6f-2244-4e2f-bfbc-dbd44b8cc5c5') {} {{(pid=102477) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:23:20.536494 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-80995e6c-79b7-4278-bbed-786f14f35ec7 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750577970535', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-29535605'] for segment, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:20.545663 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 4e2d29fc-c33c-4d30-8150-d0a0a014a682 no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:23:20.553039 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-80995e6c-79b7-4278-bbed-786f14f35ec7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:20.560029 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-80995e6c-79b7-4278-bbed-786f14f35ec7 admin admin] Releasing vlan 121 on physical network physnet1 to pool {{(pid=102477) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 24 05:23:20.560648 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-80995e6c-79b7-4278-bbed-786f14f35ec7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-29532823'] for segment, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: warnings.warn(msg) Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: Traceback (most recent call last): Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: timer() Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: cb(*args, **kw) Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: return func(*args, **kwargs) Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: self._notify() Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: self.callback(batched_events) Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: event.method(event) Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: aggregate_uuid = self.p_client.list_aggregates( Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: return f(self, *a, **k) Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: return self._get(url).json() Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: return self.request(url, 'GET', **kwargs) Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: base_url = self.get_endpoint(auth, allow=allow, Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 24 05:23:20.562780 dv-cinder-816443-2-iscsi neutron-server[102477]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 24 05:23:20.572183 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: 4e2d29fc-c33c-4d30-8150-d0a0a014a682 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:23:20.572559 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 4e2d29fc-c33c-4d30-8150-d0a0a014a682 not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:23:20.573200 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device dfc571f6-d53d-4920-be50-bf7e0c29ff2e no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:23:20.594910 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: dfc571f6-d53d-4920-be50-bf7e0c29ff2e {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:23:20.595268 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device dfc571f6-d53d-4920-be50-bf7e0c29ff2e not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:23:20.595708 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489 no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:23:20.615504 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: 46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:23:20.615920 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 46bbaaf7-23a9-4d1a-8f7c-6f7d891b2489 not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:23:20.620064 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-80995e6c-79b7-4278-bbed-786f14f35ec7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3595937', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-546046'] for network, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:20.625579 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-80995e6c-79b7-4278-bbed-786f14f35ec7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:20.631505 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-80995e6c-79b7-4278-bbed-786f14f35ec7 admin admin] 10.222.0.43 "DELETE /v2.0/networks/568053f6-6cfe-408d-be45-92751af5d67f HTTP/1.1" status: 204 len: 168 time: 0.5367234 Dec 24 05:23:20.632548 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 36448) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:23:20.644557 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80995e6c-79b7-4278-bbed-786f14f35ec7 admin admin] Pushing event deleted for resources: {'Network': ['ID=568053f6-6cfe-408d-be45-92751af5d67f,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:23:20.764483 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:21.005608 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1c022b68-a8af-4be4-9f17-4a065fe97e8b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-548364'] for router_interface, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:21.265778 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-1c022b68-a8af-4be4-9f17-4a065fe97e8b admin admin] Deleting port 7d1d24df-2ff5-4879-aa4d-464654d25167 {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:23:21.266428 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1c022b68-a8af-4be4-9f17-4a065fe97e8b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:21.346528 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [None req-1c022b68-a8af-4be4-9f17-4a065fe97e8b admin admin] For port 7d1d24df-2ff5-4879-aa4d-464654d25167, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=7d1d24df-2ff5-4879-aa4d-464654d25167,segment=NetworkSegment(3ef2ef73-c5aa-47a0-8142-1f727875c8dd),segment_id=3ef2ef73-c5aa-47a0-8142-1f727875c8dd)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:23:21.346930 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1c022b68-a8af-4be4-9f17-4a065fe97e8b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:21.359372 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-1c022b68-a8af-4be4-9f17-4a065fe97e8b admin admin] Calling delete_port for 7d1d24df-2ff5-4879-aa4d-464654d25167 owned by network:router_interface {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:23:21.551466 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1c022b68-a8af-4be4-9f17-4a065fe97e8b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:21.580407 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c022b68-a8af-4be4-9f17-4a065fe97e8b admin admin] Pushing event deleted for resources: {'Port': ['ID=7d1d24df-2ff5-4879-aa4d-464654d25167,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:23:21.752035 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-1c022b68-a8af-4be4-9f17-4a065fe97e8b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-627465', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-548448'] for router_interface, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:21.967773 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1c022b68-a8af-4be4-9f17-4a065fe97e8b admin admin] Router 87b3737e-7166-4758-b8b4-aa00f9989409 has already been hosted by L3 agent 81769614-5814-4858-b2fa-ca0736b5ae49 {{(pid=102476) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 24 05:23:22.090088 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1c022b68-a8af-4be4-9f17-4a065fe97e8b admin admin] Notify agent at l3_agent.dv-cinder-816443-2-iscsi the message routers_updated {{(pid=102476) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 24 05:23:22.096225 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-1c022b68-a8af-4be4-9f17-4a065fe97e8b admin admin] 10.222.0.43 "PUT /v2.0/routers/87b3737e-7166-4758-b8b4-aa00f9989409/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4633944 Dec 24 05:23:22.098973 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 36450) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:23:22.101597 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3edf1961-d518-4fe0-8ec4-429c92c4df18 None None] Sync routers for ids ['87b3737e-7166-4758-b8b4-aa00f9989409'] in dv-cinder-816443-2-iscsi {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 24 05:23:22.115704 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3edf1961-d518-4fe0-8ec4-429c92c4df18 None None] Routers {'87b3737e-7166-4758-b8b4-aa00f9989409'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:23:22.116320 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-3edf1961-d518-4fe0-8ec4-429c92c4df18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:22:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['87b3737e-7166-4758-b8b4-aa00f9989409'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:23:22.202245 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-370b4530-dd3a-404c-85f0-8e11a3627c4f admin admin] Publish callbacks [] for router, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:22.221363 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-3edf1961-d518-4fe0-8ec4-429c92c4df18 None None] Set router 87b3737e-7166-4758-b8b4-aa00f9989409 gateway port host: dv-cinder-816443-2-iscsi {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:23:22.302900 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-370b4530-dd3a-404c-85f0-8e11a3627c4f admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:22.361892 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-370b4530-dd3a-404c-85f0-8e11a3627c4f admin admin] Deleting port d6978734-b7c5-4b75-aefa-c920ccba2639 {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:23:22.362225 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-370b4530-dd3a-404c-85f0-8e11a3627c4f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:22.399099 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-3edf1961-d518-4fe0-8ec4-429c92c4df18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87b3737e-7166-4758-b8b4-aa00f9989409', 'name': 'tempest-TestShelveInstance-1766906089-router', 'tenant_id': '905e5afd4e554da8aa686e9236199822', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'external_fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.144'}], 'enable_snat': True}, 'gw_port_id': 'd6978734-b7c5-4b75-aefa-c920ccba2639', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:18:18Z', 'updated_at': '2021-12-24T05:23:21Z', 'revision_number': 5, 'project_id': '905e5afd4e554da8aa686e9236199822', 'gw_port': {'id': 'd6978734-b7c5-4b75-aefa-c920ccba2639', 'name': '', 'network_id': '9b4e4b31-551f-45a9-b26a-cb44ee20a17d', 'tenant_id': '', 'mac_address': 'fa:16:3e:46:2e:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '87b3737e-7166-4758-b8b4-aa00f9989409', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'ip_address': '172.27.1.144', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816443-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-24T05:18:19Z', 'updated_at': '2021-12-24T05:18:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f277b899-8779-420e-8a8d-bfcd5eb7f012', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816443-2-iscsi'}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:23:22.430244 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3edf1961-d518-4fe0-8ec4-429c92c4df18 None None] Checking router: 87b3737e-7166-4758-b8b4-aa00f9989409 for host: dv-cinder-816443-2-iscsi {{(pid=102479) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 24 05:23:22.443492 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3edf1961-d518-4fe0-8ec4-429c92c4df18 None None] Routers {'87b3737e-7166-4758-b8b4-aa00f9989409'} bound to L3 agent in host dv-cinder-816443-2-iscsi {{(pid=102479) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 24 05:23:22.443669 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [None req-370b4530-dd3a-404c-85f0-8e11a3627c4f admin admin] For port d6978734-b7c5-4b75-aefa-c920ccba2639, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=d6978734-b7c5-4b75-aefa-c920ccba2639,segment=NetworkSegment(826ebba6-2eef-449f-97d0-d8ba20232e56),segment_id=826ebba6-2eef-449f-97d0-d8ba20232e56)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:23:22.444129 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-370b4530-dd3a-404c-85f0-8e11a3627c4f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:22.444247 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-3edf1961-d518-4fe0-8ec4-429c92c4df18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816443-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-24T04:51:25Z,description=,heartbeat_timestamp=2021-12-24T05:22:55Z,host='dv-cinder-816443-2-iscsi',id=81769614-5814-4858-b2fa-ca0736b5ae49,load=0,resource_versions=,resources_synced=,started_at=2021-12-24T04:51:25Z,topic='l3_agent')) {'router_ids': ['87b3737e-7166-4758-b8b4-aa00f9989409'], 'active': True} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:23:22.455968 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-370b4530-dd3a-404c-85f0-8e11a3627c4f admin admin] Calling delete_port for d6978734-b7c5-4b75-aefa-c920ccba2639 owned by network:router_gateway {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:23:22.537546 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_dvr_db [None req-3edf1961-d518-4fe0-8ec4-429c92c4df18 None None] Set router 87b3737e-7166-4758-b8b4-aa00f9989409 gateway port host: None {{(pid=102479) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 24 05:23:22.591443 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.l3_hamode_db [None req-3edf1961-d518-4fe0-8ec4-429c92c4df18 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '87b3737e-7166-4758-b8b4-aa00f9989409', 'name': 'tempest-TestShelveInstance-1766906089-router', 'tenant_id': '905e5afd4e554da8aa686e9236199822', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:18:18Z', 'updated_at': '2021-12-24T05:23:22Z', 'revision_number': 6, 'project_id': '905e5afd4e554da8aa686e9236199822', 'gw_port_host': None}], 'dv-cinder-816443-2-iscsi', False) {} {{(pid=102479) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:23:22.617336 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3edf1961-d518-4fe0-8ec4-429c92c4df18 None None] The sync data for ids ['87b3737e-7166-4758-b8b4-aa00f9989409'] in dv-cinder-816443-2-iscsi is: [{'id': '87b3737e-7166-4758-b8b4-aa00f9989409', 'name': 'tempest-TestShelveInstance-1766906089-router', 'tenant_id': '905e5afd4e554da8aa686e9236199822', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-24T05:18:18Z', 'updated_at': '2021-12-24T05:23:22Z', 'revision_number': 6, 'project_id': '905e5afd4e554da8aa686e9236199822', 'gw_port_host': None}] {{(pid=102479) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 24 05:23:22.633839 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-370b4530-dd3a-404c-85f0-8e11a3627c4f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:22.662789 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-370b4530-dd3a-404c-85f0-8e11a3627c4f admin admin] Pushing event deleted for resources: {'Port': ['ID=d6978734-b7c5-4b75-aefa-c920ccba2639,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:23:22.720654 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-370b4530-dd3a-404c-85f0-8e11a3627c4f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-545986'] for router_gateway, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:22.813920 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-370b4530-dd3a-404c-85f0-8e11a3627c4f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-546088', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2070312'] for router, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:22.816190 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-370b4530-dd3a-404c-85f0-8e11a3627c4f admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:22.863299 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-370b4530-dd3a-404c-85f0-8e11a3627c4f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-546081'] for router, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:22.863886 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-370b4530-dd3a-404c-85f0-8e11a3627c4f admin admin] Fanout notify agent at l3_agent the message router_deleted on router 87b3737e-7166-4758-b8b4-aa00f9989409 {{(pid=102476) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 24 05:23:22.868868 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-370b4530-dd3a-404c-85f0-8e11a3627c4f admin admin] Publish callbacks [] for router, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:22.870040 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-370b4530-dd3a-404c-85f0-8e11a3627c4f admin admin] 10.222.0.43 "DELETE /v2.0/routers/87b3737e-7166-4758-b8b4-aa00f9989409 HTTP/1.1" status: 204 len: 168 time: 0.7688065 Dec 24 05:23:22.872541 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 36452) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:23:22.919571 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.db_base_plugin_v2 [None req-6e28daa6-c457-4c93-9c82-71f04c75a9b0 admin admin] Deleting subnet ff102b47-664d-4cd0-a913-67c8b37fa995 {{(pid=102476) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Dec 24 05:23:22.922833 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6e28daa6-c457-4c93-9c82-71f04c75a9b0 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:22.959362 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6e28daa6-c457-4c93-9c82-71f04c75a9b0 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-32509714'] for subnet, precommit_delete_associations {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:23.044351 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6e28daa6-c457-4c93-9c82-71f04c75a9b0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3590439'] for subnet, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:23.096413 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6e28daa6-c457-4c93-9c82-71f04c75a9b0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3590440', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-538784', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-32528482', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-32970397'] for subnet, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:23.121520 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e28daa6-c457-4c93-9c82-71f04c75a9b0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ff102b47-664d-4cd0-a913-67c8b37fa995,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:23:23.125096 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-6e28daa6-c457-4c93-9c82-71f04c75a9b0 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:23.128551 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-6e28daa6-c457-4c93-9c82-71f04c75a9b0 admin admin] 10.222.0.43 "DELETE /v2.0/subnets/ff102b47-664d-4cd0-a913-67c8b37fa995 HTTP/1.1" status: 204 len: 168 time: 0.2550094 Dec 24 05:23:23.131058 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 36454) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:23:23.133726 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f88fdfe-8cf2-45a3-a3d9-58fa39685931 None None] Network 1aa8f896-bce9-42d4-9fed-ab613f3c849d requested from dv-cinder-816443-2-iscsi {{(pid=102478) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 24 05:23:23.203099 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-35908c39-3572-4d9d-a968-6adad6e83f8e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3741433'] for network, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:23.238803 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-600624cd-be48-4e8e-960c-d4af22857d82 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:23.258323 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-35908c39-3572-4d9d-a968-6adad6e83f8e admin admin] Deleting port 58b0d62e-b026-4bd6-8b85-7faeb9c52285 {{(pid=102476) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:23:23.258659 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-35908c39-3572-4d9d-a968-6adad6e83f8e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:23.318059 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.db [None req-35908c39-3572-4d9d-a968-6adad6e83f8e admin admin] For port 58b0d62e-b026-4bd6-8b85-7faeb9c52285, host dv-cinder-816443-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816443-2-iscsi',level=0,port_id=58b0d62e-b026-4bd6-8b85-7faeb9c52285,segment=NetworkSegment(3ef2ef73-c5aa-47a0-8142-1f727875c8dd),segment_id=3ef2ef73-c5aa-47a0-8142-1f727875c8dd)] {{(pid=102476) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:23:23.318452 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-35908c39-3572-4d9d-a968-6adad6e83f8e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:23.331408 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.plugin [None req-35908c39-3572-4d9d-a968-6adad6e83f8e admin admin] Calling delete_port for 58b0d62e-b026-4bd6-8b85-7faeb9c52285 owned by network:dhcp {{(pid=102476) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:23:23.354492 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88c53abd-fbb7-441b-b88f-5001680bc00d None None] DHCP port deletion for 1aa8f896-bce9-42d4-9fed-ab613f3c849d request from dv-cinder-816443-2-iscsi {{(pid=102478) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 24 05:23:23.412027 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-88c53abd-fbb7-441b-b88f-5001680bc00d None None] Deleting port 58b0d62e-b026-4bd6-8b85-7faeb9c52285 {{(pid=102478) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1959}} Dec 24 05:23:23.412431 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-88c53abd-fbb7-441b-b88f-5001680bc00d None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8750577912140'] for port, before_delete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:23.414925 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-35908c39-3572-4d9d-a968-6adad6e83f8e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-32528401'] for port, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:23.441806 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35908c39-3572-4d9d-a968-6adad6e83f8e admin admin] Pushing event deleted for resources: {'Port': ['ID=58b0d62e-b026-4bd6-8b85-7faeb9c52285,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:23:23.443719 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35908c39-3572-4d9d-a968-6adad6e83f8e admin admin] No DVR routers for this DVR port 58b0d62e-b026-4bd6-8b85-7faeb9c52285 on host dv-cinder-816443-2-iscsi {{(pid=102476) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:23:23.475670 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.db [None req-88c53abd-fbb7-441b-b88f-5001680bc00d None None] For port 58b0d62e-b026-4bd6-8b85-7faeb9c52285, host dv-cinder-816443-2-iscsi, got binding levels [] {{(pid=102478) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 24 05:23:23.476127 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-88c53abd-fbb7-441b-b88f-5001680bc00d None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-406147'] for port, precommit_delete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:23.488589 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-88c53abd-fbb7-441b-b88f-5001680bc00d None None] Calling delete_port for 58b0d62e-b026-4bd6-8b85-7faeb9c52285 owned by network:dhcp {{(pid=102478) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2037}} Dec 24 05:23:23.491458 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.ipam_backend_mixin [None req-88c53abd-fbb7-441b-b88f-5001680bc00d None None] Port 58b0d62e-b026-4bd6-8b85-7faeb9c52285 was not found and therefore no delete operation was performed {{(pid=102478) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 24 05:23:23.492724 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-88c53abd-fbb7-441b-b88f-5001680bc00d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-3782583', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-877099', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8750578065183', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8750577499010'] for port, after_delete {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:23.521161 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88c53abd-fbb7-441b-b88f-5001680bc00d None None] Pushing event deleted for resources: {'Port': ['ID=58b0d62e-b026-4bd6-8b85-7faeb9c52285,revision_number=None']} {{(pid=102478) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:23:23.522566 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-35908c39-3572-4d9d-a968-6adad6e83f8e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3595960', 'neutron.services.segments.db._delete_segments_for_network-8750577966942'] for network, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:23.525470 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88c53abd-fbb7-441b-b88f-5001680bc00d None None] No DVR routers for this DVR port 58b0d62e-b026-4bd6-8b85-7faeb9c52285 on host dv-cinder-816443-2-iscsi {{(pid=102478) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 24 05:23:23.531415 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88c53abd-fbb7-441b-b88f-5001680bc00d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:23.531914 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88c53abd-fbb7-441b-b88f-5001680bc00d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:23.532092 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88c53abd-fbb7-441b-b88f-5001680bc00d None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:23.532433 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88c53abd-fbb7-441b-b88f-5001680bc00d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:23.532810 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88c53abd-fbb7-441b-b88f-5001680bc00d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:23.533045 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88c53abd-fbb7-441b-b88f-5001680bc00d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:23.533397 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88c53abd-fbb7-441b-b88f-5001680bc00d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:23.533710 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88c53abd-fbb7-441b-b88f-5001680bc00d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:23.534005 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88c53abd-fbb7-441b-b88f-5001680bc00d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:23.534323 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88c53abd-fbb7-441b-b88f-5001680bc00d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:23.534631 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88c53abd-fbb7-441b-b88f-5001680bc00d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:23.534946 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88c53abd-fbb7-441b-b88f-5001680bc00d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:23.535601 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88c53abd-fbb7-441b-b88f-5001680bc00d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816443-2-iscsi {{(pid=102478) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 24 05:23:23.548301 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-35908c39-3572-4d9d-a968-6adad6e83f8e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1aa8f896-bce9-42d4-9fed-ab613f3c849d']}} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:23:23.558623 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-35908c39-3572-4d9d-a968-6adad6e83f8e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3ef2ef73-c5aa-47a0-8142-1f727875c8dd') {'for_net_delete': True} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:23:23.558917 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.services.segments.db [None req-35908c39-3572-4d9d-a968-6adad6e83f8e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3ef2ef73-c5aa-47a0-8142-1f727875c8dd') {} {{(pid=102476) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 24 05:23:23.568998 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-35908c39-3572-4d9d-a968-6adad6e83f8e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8750577970535', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-32509733'] for segment, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:23.583287 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-35908c39-3572-4d9d-a968-6adad6e83f8e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464'] for segment, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:23.589568 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-35908c39-3572-4d9d-a968-6adad6e83f8e admin admin] Releasing vlan 116 on physical network physnet1 to pool {{(pid=102476) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 24 05:23:23.589949 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-35908c39-3572-4d9d-a968-6adad6e83f8e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3591464', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-32528320'] for segment, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:network_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:physical_network failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_network:provider:segmentation_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:profile failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:host_id failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_type failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy rule:get_port:binding:vif_details failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: warnings.warn(msg) Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: Traceback (most recent call last): Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: timer() Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: cb(*args, **kw) Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: return func(*args, **kwargs) Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: self._notify() Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: self.callback(batched_events) Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: event.method(event) Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: aggregate_uuid = self.p_client.list_aggregates( Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: return f(self, *a, **k) Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: return self._get(url).json() Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: return self.request(url, 'GET', **kwargs) Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: base_url = self.get_endpoint(auth, allow=allow, Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 24 05:23:23.591756 dv-cinder-816443-2-iscsi neutron-server[102476]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 24 05:23:23.649164 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-35908c39-3572-4d9d-a968-6adad6e83f8e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3595937', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533842', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-627456', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-546046'] for network, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:23.655615 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-35908c39-3572-4d9d-a968-6adad6e83f8e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-627698'] for network, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:23.659021 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-35908c39-3572-4d9d-a968-6adad6e83f8e admin admin] 10.222.0.43 "DELETE /v2.0/networks/1aa8f896-bce9-42d4-9fed-ab613f3c849d HTTP/1.1" status: 204 len: 168 time: 0.5271919 Dec 24 05:23:23.671088 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35908c39-3572-4d9d-a968-6adad6e83f8e admin admin] Pushing event deleted for resources: {'Network': ['ID=1aa8f896-bce9-42d4-9fed-ab613f3c849d,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:23:23.774050 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 36458) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:23:23.834766 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-e0f7e2a5-877c-48cd-8cd6-ac1043de57af admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=274c3c6f555f48ad93189e73c71c5ffe&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0592363 Dec 24 05:23:23.837511 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [-] (102476) accepted ('10.222.0.43', 36460) {{(pid=102476) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:23:23.893184 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-30d192f5-6123-45a5-9ad0-d15d861bc525 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:23.914431 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-30d192f5-6123-45a5-9ad0-d15d861bc525 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:23.962702 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-30d192f5-6123-45a5-9ad0-d15d861bc525 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:23.965262 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron_lib.callbacks.manager [None req-30d192f5-6123-45a5-9ad0-d15d861bc525 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102476) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:23.966412 dv-cinder-816443-2-iscsi neutron-server[102476]: INFO neutron.wsgi [None req-30d192f5-6123-45a5-9ad0-d15d861bc525 admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/6bc58421-6994-4803-b407-9231f83d7d34 HTTP/1.1" status: 204 len: 168 time: 0.1278305 Dec 24 05:23:23.974295 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30d192f5-6123-45a5-9ad0-d15d861bc525 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6bc58421-6994-4803-b407-9231f83d7d34,revision_number=None']} {{(pid=102476) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:23:24.304984 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 36466) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:23:24.349897 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-ac3eef1f-ae36-44c5-aa53-2a664c1ddc66 admin admin] 10.222.0.43 "GET /v2.0/security-groups?tenant_id=905e5afd4e554da8aa686e9236199822&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0436103 Dec 24 05:23:24.352557 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.wsgi [-] (102477) accepted ('10.222.0.43', 36468) {{(pid=102477) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 24 05:23:24.404378 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-bd9cc26a-4e0e-41d5-ac04-f73bac5c0d0f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:24.426791 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-bd9cc26a-4e0e-41d5-ac04-f73bac5c0d0f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:24.455825 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 7d1d24df-2ff5-4879-aa4d-464654d25167 no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:23:24.475963 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-bd9cc26a-4e0e-41d5-ac04-f73bac5c0d0f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533763'] for security_group, after_delete {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:24.477132 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: 7d1d24df-2ff5-4879-aa4d-464654d25167 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:23:24.477478 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 7d1d24df-2ff5-4879-aa4d-464654d25167 not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:23:24.477894 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device d6978734-b7c5-4b75-aefa-c920ccba2639 no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:23:24.478577 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron_lib.callbacks.manager [None req-bd9cc26a-4e0e-41d5-ac04-f73bac5c0d0f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102477) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:24.482373 dv-cinder-816443-2-iscsi neutron-server[102477]: INFO neutron.wsgi [None req-bd9cc26a-4e0e-41d5-ac04-f73bac5c0d0f admin admin] 10.222.0.43 "DELETE /v2.0/security-groups/ceed43b3-5676-4acd-99c9-5e2ede3dcbab HTTP/1.1" status: 204 len: 168 time: 0.1262856 Dec 24 05:23:24.489255 dv-cinder-816443-2-iscsi neutron-server[102477]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd9cc26a-4e0e-41d5-ac04-f73bac5c0d0f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ceed43b3-5676-4acd-99c9-5e2ede3dcbab,revision_number=None']} {{(pid=102477) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 24 05:23:24.496837 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: d6978734-b7c5-4b75-aefa-c920ccba2639 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:23:24.497382 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device d6978734-b7c5-4b75-aefa-c920ccba2639 not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:23:24.497805 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 58b0d62e-b026-4bd6-8b85-7faeb9c52285 no longer exists at agent ovs-agent-dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 24 05:23:24.522171 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.plugin [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] No Port match for: 58b0d62e-b026-4bd6-8b85-7faeb9c52285 {{(pid=102478) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2295}} Dec 24 05:23:24.522513 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron.plugins.ml2.rpc [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Device 58b0d62e-b026-4bd6-8b85-7faeb9c52285 not bound to the agent host dv-cinder-816443-2-iscsi {{(pid=102478) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 24 05:23:25.328309 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-cbb236dd-46a3-4eae-967a-a35f9fab4645 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:26.599700 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:28.033373 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:28.602531 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:30.487681 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:23:50.763692 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:53.239423 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-fc5f1480-62fe-48dc-a135-8abf2e9472b8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:55.330257 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-af160ae5-ce71-4e29-a627-1f914f8c35e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:56.610022 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:58.045943 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:23:58.595584 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:24:07.493823 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:24:20.774573 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:24:23.239921 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-6f30acd9-0cc0-47eb-9eec-c2464c06074c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:24:25.337078 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-0e825bd0-8624-466e-86f5-7fed4f3318a3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:24:26.617574 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:24:28.044592 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:24:28.592765 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:24:44.487633 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:24:45.974723 dv-cinder-816443-2-iscsi neutron-server[102476]: DEBUG neutron.wsgi [req-ecb760f8-8c73-44a4-946d-7d9a39ca3bdc req-c416f0e6-f983-4ff4-ba4d-cde7f1c5d178 service neutron] (102476) timed out ('10.222.0.46', 62336) {{(pid=102476) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 24 05:24:50.781353 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:24:53.246666 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-c3a30594-59c7-401d-be77-966e82591b55 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:24:55.330104 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-0ab149e3-2505-4795-b231-f173a577f9cc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:24:56.616608 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:24:58.055337 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:24:58.591195 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:25:20.794891 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:25:21.492723 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:25:23.240167 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-7e668054-6303-414a-a414-04dc26fa57c4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:25:25.328466 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-47d3590d-5e02-4399-8703-830c23ee8c57 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:25:26.621470 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:25:28.059328 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:25:28.587150 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:25:50.801901 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:25:53.247082 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-79759a19-d6e2-4c6b-a6db-2cbe0b6419ba None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:25:55.324641 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-524f6a6a-5137-40fe-9086-85383906ac27 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:25:56.630412 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:25:58.061943 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:25:58.497120 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:25:58.588314 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:26:20.796925 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:26:23.234063 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-05cc2e5c-f91e-411a-9308-0adf43e13123 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:26:25.337119 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8112b248-308d-41ae-953e-35578dfe885a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:26:26.629351 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:26:28.060707 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:26:28.587115 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:26:35.502464 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:26:50.788765 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:26:53.233584 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-9898fd96-33a6-4833-a671-9bd0b0faa007 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:26:55.341220 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-4126f443-f6af-4db9-a2b4-0389983c1e91 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:26:56.632711 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:26:58.067079 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:26:58.585029 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:27:12.507524 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:27:20.816367 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:27:23.233363 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-86b2ebcf-a946-4711-a319-bc62f312c84a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:27:25.338057 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-c0f1ffa9-78cc-4a0a-afe7-504540359cc8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:27:26.634207 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:27:28.066279 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:27:28.588273 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:27:49.511306 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:27:50.805676 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:27:53.238083 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-ccdcb260-ce73-49db-8a90-4224b8f055e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:27:55.340366 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-ca7b46fd-cd4c-4f64-90ac-da4599e8f987 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:27:56.637000 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:27:58.076719 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:27:58.589874 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:28:20.803129 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:28:23.243663 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-ac898850-bdfc-40bf-b233-3e8f2f48ce6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:28:25.342966 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-ec9b4a7b-08c9-439a-9fd5-8d375af08219 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:28:26.513970 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 24 05:28:26.643916 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:28:28.084448 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:28:28.593741 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:28:50.838237 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-b8a43c3c-6a51-464e-b48d-556c5d868462 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:28:53.240380 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-134360b7-6833-4323-8aa8-cc25344308ff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:28:55.341187 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-cfb6db05-550d-43fc-ad6e-f40f6d703b64 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:28:56.644804 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-e6510841-02dc-4811-a123-89bc8eb65e35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:28:58.088573 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-3accc60c-302f-4c40-80d3-2044aca1814c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:28:58.589156 dv-cinder-816443-2-iscsi neutron-server[102478]: DEBUG neutron_lib.callbacks.manager [None req-8b121165-7a59-492d-af92-c10061bf5c02 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8750577966924', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3595234'] for agent, after_update {{(pid=102478) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 24 05:29:03.517855 dv-cinder-816443-2-iscsi neutron-server[102479]: DEBUG neutron.db.agents_db [None req-243f86ea-b729-4db9-847a-adcda29c55a7 None None] Agent healthcheck: found 6 active agents {{(pid=102479) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}}